2024-09-05T07:16:44.524 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-05T07:16:44.546 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-05T07:16:44.652 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7890022 branch: squid description: fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/5 tasks/dbench validater/valgrind} email: ceph-qa@ceph.com first_in_suite: false job_id: '7890022' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 5 session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mds beacon grace: 60 mds heartbeat grace: 60 osd heartbeat grace: 60 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds valgrind exit: true mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon osd crush smoke test: false mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow request - SLOW_OPS - MON_DOWN sha1: 91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes watchdog: daemon_restart: normal ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: valgrind: - --tool=memcheck - --leak-check=full - --show-reachable=yes check-counter: counters: mds: - mds.exported - mds.imported install: ceph: debuginfo: true flavor: default sha1: 91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 1743 sha1: 91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 sleep_before_teardown: 0 subset: 459/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi017.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGlakx+H/0gkL7nThlXmfGN121a9AGCu9bedNSO0U1C+8aSAJMNfUTvdMqffQ/S23vqMkDKG4BGhaj67MdhpYDg= smithi026.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPHKIliJBVVrBFnFtQGvIjgFfZLCGofljG8z7SemgEl1LlCS8IHxisxlMmXRsnB/8wlDv0y/rdTUWcEBk4PROUk= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-04_21:24:16 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-05T07:16:44.652 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/qa; will attempt to use it 2024-09-05T07:16:44.653 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/qa/tasks 2024-09-05T07:16:44.653 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-05T07:16:44.654 INFO:teuthology.task.internal:Checking packages... 2024-09-05T07:16:44.675 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4' 2024-09-05T07:16:44.675 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-05T07:16:44.675 INFO:teuthology.packaging:ref: None 2024-09-05T07:16:44.675 INFO:teuthology.packaging:tag: None 2024-09-05T07:16:44.675 INFO:teuthology.packaging:branch: squid 2024-09-05T07:16:44.675 INFO:teuthology.packaging:sha1: 91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 2024-09-05T07:16:44.676 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-05T07:16:44.872 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-259.g91c8a7e5 2024-09-05T07:16:44.874 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-05T07:16:44.881 INFO:teuthology.task.internal:no buildpackages task found 2024-09-05T07:16:44.881 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-05T07:16:44.890 INFO:teuthology.task.internal:Saving configuration 2024-09-05T07:16:44.909 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-05T07:16:44.916 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-05T07:16:44.935 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7890022', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-05 07:12:05.250094', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGlakx+H/0gkL7nThlXmfGN121a9AGCu9bedNSO0U1C+8aSAJMNfUTvdMqffQ/S23vqMkDKG4BGhaj67MdhpYDg='} 2024-09-05T07:16:44.953 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7890022', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-05 07:12:05.251516', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPHKIliJBVVrBFnFtQGvIjgFfZLCGofljG8z7SemgEl1LlCS8IHxisxlMmXRsnB/8wlDv0y/rdTUWcEBk4PROUk='} 2024-09-05T07:16:44.953 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-05T07:16:44.959 INFO:teuthology.task.internal:roles: ubuntu@smithi017.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-09-05T07:16:44.959 INFO:teuthology.task.internal:roles: ubuntu@smithi026.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-09-05T07:16:44.959 INFO:teuthology.run_tasks:Running task console_log... 2024-09-05T07:16:45.013 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7efc631e4040>, signals=[15]) 2024-09-05T07:16:45.013 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-05T07:16:45.018 INFO:teuthology.task.internal:Opening connections... 2024-09-05T07:16:45.018 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi017.front.sepia.ceph.com 2024-09-05T07:16:45.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T07:16:45.100 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi026.front.sepia.ceph.com 2024-09-05T07:16:45.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T07:16:45.176 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-05T07:16:45.183 DEBUG:teuthology.orchestra.run.smithi017:> uname -m 2024-09-05T07:16:45.202 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2024-09-05T07:16:45.202 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2024-09-05T07:16:45.260 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream" 2024-09-05T07:16:45.260 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="9" 2024-09-05T07:16:45.260 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos" 2024-09-05T07:16:45.260 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora" 2024-09-05T07:16:45.260 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="9" 2024-09-05T07:16:45.260 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el9" 2024-09-05T07:16:45.260 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-05T07:16:45.260 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2024-09-05T07:16:45.260 INFO:teuthology.orchestra.run.smithi017.stdout:LOGO="fedora-logo-icon" 2024-09-05T07:16:45.261 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-05T07:16:45.261 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/" 2024-09-05T07:16:45.261 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-05T07:16:45.261 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-05T07:16:45.261 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-05T07:16:45.261 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2024-09-05T07:16:45.279 DEBUG:teuthology.orchestra.run.smithi026:> uname -m 2024-09-05T07:16:45.297 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2024-09-05T07:16:45.298 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2024-09-05T07:16:45.355 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream" 2024-09-05T07:16:45.355 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="9" 2024-09-05T07:16:45.355 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos" 2024-09-05T07:16:45.356 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora" 2024-09-05T07:16:45.356 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="9" 2024-09-05T07:16:45.356 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el9" 2024-09-05T07:16:45.356 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-05T07:16:45.356 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2024-09-05T07:16:45.356 INFO:teuthology.orchestra.run.smithi026.stdout:LOGO="fedora-logo-icon" 2024-09-05T07:16:45.356 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-05T07:16:45.356 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/" 2024-09-05T07:16:45.356 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-05T07:16:45.356 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-05T07:16:45.356 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-05T07:16:45.357 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2024-09-05T07:16:45.378 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-05T07:16:45.387 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-05T07:16:45.393 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-05T07:16:45.393 DEBUG:teuthology.orchestra.run.smithi017:> test '!' -e /home/ubuntu/cephtest 2024-09-05T07:16:45.395 DEBUG:teuthology.orchestra.run.smithi026:> test '!' -e /home/ubuntu/cephtest 2024-09-05T07:16:45.412 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-05T07:16:45.418 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-05T07:16:45.419 DEBUG:teuthology.orchestra.run.smithi017:> test -z $(ls -A /var/lib/ceph) 2024-09-05T07:16:45.453 DEBUG:teuthology.orchestra.run.smithi026:> test -z $(ls -A /var/lib/ceph) 2024-09-05T07:16:45.482 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-05T07:16:45.534 INFO:teuthology.run_tasks:Running task kernel... 2024-09-05T07:16:45.547 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-05T07:16:45.547 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-05T07:16:45.548 DEBUG:teuthology.orchestra.run.smithi017:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-05T07:16:45.548 DEBUG:teuthology.orchestra.run.smithi026:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-05T07:16:45.565 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T07:16:45.565 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2024-09-05T07:16:45.566 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T07:16:45.566 DEBUG:teuthology.orchestra.run.smithi026:> uname -r 2024-09-05T07:16:45.622 INFO:teuthology.orchestra.run.smithi017.stdout:5.14.0-503.el9.x86_64 2024-09-05T07:16:45.623 INFO:teuthology.task.kernel:Running kernel on smithi017: 5.14.0-503.el9.x86_64 2024-09-05T07:16:45.623 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum install -y kernel 2024-09-05T07:16:45.624 INFO:teuthology.orchestra.run.smithi026.stdout:5.14.0-503.el9.x86_64 2024-09-05T07:16:45.624 INFO:teuthology.task.kernel:Running kernel on smithi026: 5.14.0-503.el9.x86_64 2024-09-05T07:16:45.624 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum install -y kernel 2024-09-05T07:16:49.220 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.2 MB 00:01 2024-09-05T07:16:50.350 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - BaseOS 2.7 MB/s | 8.2 MB 00:03 2024-09-05T07:16:51.179 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-05T07:16:52.910 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - AppStream 15 MB/s | 20 MB 00:01 2024-09-05T07:16:57.780 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 6.5 MB 00:02 2024-09-05T07:16:58.519 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.5 MB 00:01 2024-09-05T07:16:59.213 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - Extras packages 99 kB/s | 19 kB 00:00 2024-09-05T07:16:59.968 INFO:teuthology.orchestra.run.smithi026.stdout:Extra Packages for Enterprise Linux 36 MB/s | 23 MB 00:00 2024-09-05T07:17:00.919 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - Extras packages 16 kB/s | 19 kB 00:01 2024-09-05T07:17:01.806 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-05T07:17:05.623 INFO:teuthology.orchestra.run.smithi026.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-05T07:17:07.371 INFO:teuthology.orchestra.run.smithi017.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-05T07:17:07.688 INFO:teuthology.orchestra.run.smithi026.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-05T07:17:07.688 INFO:teuthology.orchestra.run.smithi026.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-05T07:17:07.768 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-09-05T07:17:07.769 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2024-09-05T07:17:07.769 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-09-05T07:17:07.855 DEBUG:teuthology.orchestra.run.smithi026:> echo no | sudo yum reinstall kernel || true 2024-09-05T07:17:08.406 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:00:03 ago on Thu 05 Sep 2024 07:17:05 AM UTC. 2024-09-05T07:17:08.562 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-09-05T07:17:08.567 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-05T07:17:08.567 INFO:teuthology.orchestra.run.smithi026.stdout: Package Architecture Version Repository Size 2024-09-05T07:17:08.567 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-05T07:17:08.567 INFO:teuthology.orchestra.run.smithi026.stdout:Reinstalling: 2024-09-05T07:17:08.567 INFO:teuthology.orchestra.run.smithi026.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-09-05T07:17:08.567 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:17:08.568 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-09-05T07:17:08.568 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-05T07:17:08.568 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:17:08.568 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 1.9 M 2024-09-05T07:17:08.568 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 0 2024-09-05T07:17:08.569 INFO:teuthology.orchestra.run.smithi026.stderr:Operation aborted. 2024-09-05T07:17:08.631 INFO:teuthology.orchestra.run.smithi026.stdout:Is this ok [y/N]: 2024-09-05T07:17:08.631 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum reinstall -y kernel || true 2024-09-05T07:17:09.181 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:00:04 ago on Thu 05 Sep 2024 07:17:05 AM UTC. 2024-09-05T07:17:09.314 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-09-05T07:17:09.314 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-05T07:17:09.315 INFO:teuthology.orchestra.run.smithi026.stdout: Package Architecture Version Repository Size 2024-09-05T07:17:09.315 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-05T07:17:09.315 INFO:teuthology.orchestra.run.smithi026.stdout:Reinstalling: 2024-09-05T07:17:09.315 INFO:teuthology.orchestra.run.smithi026.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-09-05T07:17:09.315 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:17:09.315 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-09-05T07:17:09.315 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-05T07:17:09.315 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:17:09.315 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 1.9 M 2024-09-05T07:17:09.315 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 0 2024-09-05T07:17:09.315 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-09-05T07:17:09.419 INFO:teuthology.orchestra.run.smithi017.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-05T07:17:09.419 INFO:teuthology.orchestra.run.smithi017.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-05T07:17:09.509 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-05T07:17:09.510 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-09-05T07:17:09.510 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-05T07:17:09.634 DEBUG:teuthology.orchestra.run.smithi017:> echo no | sudo yum reinstall kernel || true 2024-09-05T07:17:10.182 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:03 ago on Thu 05 Sep 2024 07:17:07 AM UTC. 2024-09-05T07:17:10.328 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-05T07:17:10.340 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-05T07:17:10.340 INFO:teuthology.orchestra.run.smithi017.stdout: Package Architecture Version Repository Size 2024-09-05T07:17:10.340 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-05T07:17:10.341 INFO:teuthology.orchestra.run.smithi017.stdout:Reinstalling: 2024-09-05T07:17:10.341 INFO:teuthology.orchestra.run.smithi017.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-09-05T07:17:10.341 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:17:10.341 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-05T07:17:10.341 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-05T07:17:10.341 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:17:10.341 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 1.9 M 2024-09-05T07:17:10.341 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 0 2024-09-05T07:17:10.341 INFO:teuthology.orchestra.run.smithi017.stderr:Operation aborted. 2024-09-05T07:17:10.403 INFO:teuthology.orchestra.run.smithi017.stdout:Is this ok [y/N]: 2024-09-05T07:17:10.403 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum reinstall -y kernel || true 2024-09-05T07:17:10.584 INFO:teuthology.orchestra.run.smithi026.stdout:kernel-5.14.0-503.el9.x86_64.rpm 1.9 MB/s | 1.9 MB 00:01 2024-09-05T07:17:10.584 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-09-05T07:17:10.584 INFO:teuthology.orchestra.run.smithi026.stdout:Total 1.5 MB/s | 1.9 MB 00:01 2024-09-05T07:17:10.625 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-09-05T07:17:10.876 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-09-05T07:17:10.876 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-09-05T07:17:10.907 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-09-05T07:17:10.908 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-09-05T07:17:10.949 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:03 ago on Thu 05 Sep 2024 07:17:07 AM UTC. 2024-09-05T07:17:11.081 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-05T07:17:11.082 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-05T07:17:11.082 INFO:teuthology.orchestra.run.smithi017.stdout: Package Architecture Version Repository Size 2024-09-05T07:17:11.082 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-05T07:17:11.082 INFO:teuthology.orchestra.run.smithi017.stdout:Reinstalling: 2024-09-05T07:17:11.082 INFO:teuthology.orchestra.run.smithi017.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-09-05T07:17:11.082 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:17:11.082 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-05T07:17:11.083 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-05T07:17:11.083 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:17:11.083 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 1.9 M 2024-09-05T07:17:11.083 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 0 2024-09-05T07:17:11.083 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-05T07:17:11.083 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-09-05T07:17:11.202 INFO:teuthology.orchestra.run.smithi026.stdout: Reinstalling : kernel-5.14.0-503.el9.x86_64 1/2 2024-09-05T07:17:11.202 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : kernel-5.14.0-503.el9.x86_64 2/2 2024-09-05T07:17:11.823 INFO:teuthology.orchestra.run.smithi017.stdout:kernel-5.14.0-503.el9.x86_64.rpm 2.9 MB/s | 1.9 MB 00:00 2024-09-05T07:17:11.823 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-05T07:17:11.823 INFO:teuthology.orchestra.run.smithi017.stdout:Total 2.5 MB/s | 1.9 MB 00:00 2024-09-05T07:17:11.861 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-05T07:17:11.949 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: kernel-5.14.0-503.el9.x86_64 2/2 2024-09-05T07:17:11.949 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 1/2 2024-09-05T07:17:12.121 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-05T07:17:12.121 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-05T07:17:12.152 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-05T07:17:12.152 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-05T07:17:12.324 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-05T07:17:12.434 INFO:teuthology.orchestra.run.smithi017.stdout: Reinstalling : kernel-5.14.0-503.el9.x86_64 1/2 2024-09-05T07:17:12.434 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : kernel-5.14.0-503.el9.x86_64 2/2 2024-09-05T07:17:12.673 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 2/2 2024-09-05T07:17:12.673 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:17:12.673 INFO:teuthology.orchestra.run.smithi026.stdout:Reinstalled: 2024-09-05T07:17:12.673 INFO:teuthology.orchestra.run.smithi026.stdout: kernel-5.14.0-503.el9.x86_64 2024-09-05T07:17:12.673 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:17:12.674 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-09-05T07:17:12.847 DEBUG:teuthology.orchestra.run.smithi026:> rpm -q kernel | sort -rV | head -n 1 2024-09-05T07:17:12.906 INFO:teuthology.orchestra.run.smithi026.stdout:kernel-5.14.0-503.el9.x86_64 2024-09-05T07:17:12.907 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-503.el9.x86_64 2024-09-05T07:17:12.907 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-09-05T07:17:12.907 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-05T07:17:12.907 DEBUG:teuthology.orchestra.run.smithi026:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-05T07:17:12.944 INFO:teuthology.orchestra.run.smithi026.stdout:ttyS1 2024-09-05T07:17:12.965 DEBUG:teuthology.parallel:result is None 2024-09-05T07:17:13.192 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-5.14.0-503.el9.x86_64 2/2 2024-09-05T07:17:13.192 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 1/2 2024-09-05T07:17:13.898 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 2/2 2024-09-05T07:17:13.899 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:17:13.899 INFO:teuthology.orchestra.run.smithi017.stdout:Reinstalled: 2024-09-05T07:17:13.899 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-5.14.0-503.el9.x86_64 2024-09-05T07:17:13.899 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:17:13.899 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-05T07:17:14.093 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q kernel | sort -rV | head -n 1 2024-09-05T07:17:14.152 INFO:teuthology.orchestra.run.smithi017.stdout:kernel-5.14.0-503.el9.x86_64 2024-09-05T07:17:14.153 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-503.el9.x86_64 2024-09-05T07:17:14.153 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-09-05T07:17:14.153 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-05T07:17:14.153 DEBUG:teuthology.orchestra.run.smithi017:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-05T07:17:14.191 INFO:teuthology.orchestra.run.smithi017.stdout:ttyS1 2024-09-05T07:17:14.216 DEBUG:teuthology.parallel:result is None 2024-09-05T07:17:14.217 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-05T07:17:14.223 INFO:teuthology.task.internal:Creating test directory... 2024-09-05T07:17:14.223 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-05T07:17:14.259 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-05T07:17:14.278 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-05T07:17:14.284 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-05T07:17:14.296 INFO:teuthology.task.internal:Creating archive directory... 2024-09-05T07:17:14.296 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-05T07:17:14.314 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-05T07:17:14.343 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-05T07:17:14.349 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-05T07:17:14.350 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-05T07:17:14.378 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-05T07:17:14.417 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-05T07:17:14.427 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-05T07:17:14.428 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-05T07:17:14.437 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-05T07:17:14.439 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-05T07:17:14.445 INFO:teuthology.task.internal:Configuring sudo... 2024-09-05T07:17:14.445 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-05T07:17:14.447 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-05T07:17:14.498 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-05T07:17:14.507 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-05T07:17:14.507 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-05T07:17:14.512 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-05T07:17:14.555 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-05T07:17:14.607 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-05T07:17:14.652 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-05T07:17:14.735 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-05T07:17:14.774 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-05T07:17:14.774 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-05T07:17:14.838 DEBUG:teuthology.orchestra.run.smithi026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-05T07:17:14.880 DEBUG:teuthology.orchestra.run.smithi026:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-05T07:17:14.937 DEBUG:teuthology.orchestra.run.smithi026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-05T07:17:15.021 DEBUG:teuthology.orchestra.run.smithi026:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-05T07:17:15.066 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-05T07:17:15.066 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-05T07:17:15.132 DEBUG:teuthology.orchestra.run.smithi017:> sudo service rsyslog restart 2024-09-05T07:17:15.135 DEBUG:teuthology.orchestra.run.smithi026:> sudo service rsyslog restart 2024-09-05T07:17:15.168 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-05T07:17:15.216 INFO:teuthology.orchestra.run.smithi026.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-05T07:17:15.570 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-05T07:17:15.578 INFO:teuthology.task.internal:Starting timer... 2024-09-05T07:17:15.579 INFO:teuthology.run_tasks:Running task pcp... 2024-09-05T07:17:15.589 INFO:teuthology.run_tasks:Running task selinux... 2024-09-05T07:17:15.598 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-05T07:17:15.598 DEBUG:teuthology.orchestra.run.smithi017:> sudo service auditd rotate 2024-09-05T07:17:15.632 INFO:teuthology.orchestra.run.smithi017.stdout:Rotating logs: 2024-09-05T07:17:15.633 DEBUG:teuthology.orchestra.run.smithi026:> sudo service auditd rotate 2024-09-05T07:17:15.680 INFO:teuthology.orchestra.run.smithi026.stdout:Rotating logs: 2024-09-05T07:17:15.682 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-05T07:17:15.682 DEBUG:teuthology.orchestra.run.smithi017:> /usr/sbin/getenforce 2024-09-05T07:17:15.701 INFO:teuthology.orchestra.run.smithi017.stdout:Permissive 2024-09-05T07:17:15.701 DEBUG:teuthology.orchestra.run.smithi026:> /usr/sbin/getenforce 2024-09-05T07:17:15.728 INFO:teuthology.orchestra.run.smithi026.stdout:Permissive 2024-09-05T07:17:15.729 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi017.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi026.front.sepia.ceph.com': 'permissive'} 2024-09-05T07:17:15.729 DEBUG:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-05T07:17:15.767 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T07:17:15.768 DEBUG:teuthology.orchestra.run.smithi026:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-05T07:17:15.795 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T07:17:15.795 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-05T07:17:15.796 DEBUG:teuthology.orchestra.run.smithi017:> sudo /usr/sbin/setenforce permissive 2024-09-05T07:17:15.835 DEBUG:teuthology.orchestra.run.smithi026:> sudo /usr/sbin/setenforce permissive 2024-09-05T07:17:15.871 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-05T07:17:15.880 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-05T07:17:15.891 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-05T07:17:15.892 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi017.front.sepia.ceph.com,smithi026.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-05T07:20:55.490 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi017.front.sepia.ceph.com'), Remote(name='ubuntu@smithi026.front.sepia.ceph.com')] 2024-09-05T07:20:55.491 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-05T07:20:55.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T07:20:55.573 DEBUG:teuthology.orchestra.run.smithi017:> true 2024-09-05T07:20:55.657 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-05T07:20:55.657 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-09-05T07:20:55.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T07:20:55.734 DEBUG:teuthology.orchestra.run.smithi026:> true 2024-09-05T07:20:55.813 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-09-05T07:20:55.814 INFO:teuthology.run_tasks:Running task clock... 2024-09-05T07:20:55.825 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-05T07:20:55.825 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-05T07:20:55.825 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-05T07:20:55.828 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-05T07:20:55.828 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-05T07:20:55.858 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-05T07:20:55.874 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-05T07:20:55.885 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-05T07:20:55.899 INFO:teuthology.orchestra.run.smithi017.stderr:sudo: ntpd: command not found 2024-09-05T07:20:55.900 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-05T07:20:55.911 INFO:teuthology.orchestra.run.smithi017.stdout:506 Cannot talk to daemon 2024-09-05T07:20:55.926 INFO:teuthology.orchestra.run.smithi026.stderr:sudo: ntpd: command not found 2024-09-05T07:20:55.926 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-05T07:20:55.937 INFO:teuthology.orchestra.run.smithi026.stdout:506 Cannot talk to daemon 2024-09-05T07:20:55.940 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-05T07:20:55.951 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-05T07:20:55.966 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-05T07:20:55.999 INFO:teuthology.orchestra.run.smithi017.stderr:bash: line 1: ntpq: command not found 2024-09-05T07:20:56.002 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-05T07:20:56.002 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2024-09-05T07:20:56.002 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T07:20:56.002 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T07:20:56.002 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T07:20:56.002 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T07:20:56.022 INFO:teuthology.orchestra.run.smithi026.stderr:bash: line 1: ntpq: command not found 2024-09-05T07:20:56.026 INFO:teuthology.orchestra.run.smithi026.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-05T07:20:56.026 INFO:teuthology.orchestra.run.smithi026.stdout:=============================================================================== 2024-09-05T07:20:56.027 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T07:20:56.027 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T07:20:56.027 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T07:20:56.027 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T07:20:56.027 INFO:teuthology.run_tasks:Running task install... 2024-09-05T07:20:56.035 DEBUG:teuthology.task.install:project ceph 2024-09-05T07:20:56.035 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4'}} 2024-09-05T07:20:56.035 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4'} 2024-09-05T07:20:56.035 INFO:teuthology.task.install:Using flavor: default 2024-09-05T07:20:56.041 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2024-09-05T07:20:56.041 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-05T07:20:56.041 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4', 'tag': None, 'wait_for_package': False} 2024-09-05T07:20:56.042 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 2024-09-05T07:20:56.044 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4', 'tag': None, 'wait_for_package': False} 2024-09-05T07:20:56.044 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 2024-09-05T07:20:56.185 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/flavors/default/ 2024-09-05T07:20:56.185 INFO:teuthology.task.install.rpm:Package version is 19.1.1-259.g91c8a7e5 2024-09-05T07:20:56.191 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/flavors/default/ 2024-09-05T07:20:56.191 INFO:teuthology.task.install.rpm:Package version is 19.1.1-259.g91c8a7e5 2024-09-05T07:20:56.485 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-05T07:20:56.486 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-05T07:20:56.486 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-05T07:20:56.497 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-05T07:20:56.497 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-05T07:20:56.497 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-05T07:20:56.512 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-05T07:20:56.513 DEBUG:teuthology.orchestra.run.smithi017:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-05T07:20:56.524 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-05T07:20:56.524 DEBUG:teuthology.orchestra.run.smithi026:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-05T07:20:56.580 DEBUG:teuthology.orchestra.run.smithi017:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-05T07:20:56.591 DEBUG:teuthology.orchestra.run.smithi026:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-05T07:20:56.656 DEBUG:teuthology.orchestra.run.smithi017:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-05T07:20:56.667 DEBUG:teuthology.orchestra.run.smithi026:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-05T07:20:56.720 INFO:teuthology.orchestra.run.smithi017.stdout:check_obsoletes = 1 2024-09-05T07:20:56.721 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum clean all 2024-09-05T07:20:56.731 INFO:teuthology.orchestra.run.smithi026.stdout:check_obsoletes = 1 2024-09-05T07:20:56.733 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum clean all 2024-09-05T07:20:56.954 INFO:teuthology.orchestra.run.smithi017.stdout:45 files removed 2024-09-05T07:20:56.964 INFO:teuthology.orchestra.run.smithi026.stdout:45 files removed 2024-09-05T07:20:56.980 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-05T07:20:56.991 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-05T07:20:57.835 INFO:teuthology.orchestra.run.smithi026.stdout:ceph packages for x86_64 148 kB/s | 84 kB 00:00 2024-09-05T07:20:57.844 INFO:teuthology.orchestra.run.smithi017.stdout:ceph packages for x86_64 144 kB/s | 84 kB 00:00 2024-09-05T07:20:58.135 INFO:teuthology.orchestra.run.smithi026.stdout:ceph noarch packages 46 kB/s | 12 kB 00:00 2024-09-05T07:20:58.153 INFO:teuthology.orchestra.run.smithi017.stdout:ceph noarch packages 44 kB/s | 12 kB 00:00 2024-09-05T07:20:58.419 INFO:teuthology.orchestra.run.smithi026.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-05T07:20:58.437 INFO:teuthology.orchestra.run.smithi017.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-05T07:20:59.112 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-05T07:20:59.711 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - BaseOS 6.6 MB/s | 8.2 MB 00:01 2024-09-05T07:21:03.496 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - AppStream 7.7 MB/s | 20 MB 00:02 2024-09-05T07:21:03.730 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - AppStream 5.9 MB/s | 20 MB 00:03 2024-09-05T07:21:08.089 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-05T07:21:10.062 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 6.5 MB 00:02 2024-09-05T07:21:10.482 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 19 kB 00:01 2024-09-05T07:21:11.580 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - Extras packages 79 kB/s | 19 kB 00:00 2024-09-05T07:21:11.719 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-05T07:21:12.667 INFO:teuthology.orchestra.run.smithi026.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-05T07:21:17.400 INFO:teuthology.orchestra.run.smithi017.stdout:lab-extras 24 kB/s | 1.7 kB 00:00 2024-09-05T07:21:18.348 INFO:teuthology.orchestra.run.smithi026.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-05T07:21:19.711 INFO:teuthology.orchestra.run.smithi017.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-05T07:21:19.712 INFO:teuthology.orchestra.run.smithi017.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-05T07:21:19.740 INFO:teuthology.orchestra.run.smithi017.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-05T07:21:19.741 INFO:teuthology.orchestra.run.smithi017.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-05T07:21:19.742 INFO:teuthology.orchestra.run.smithi017.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-05T07:21:19.742 INFO:teuthology.orchestra.run.smithi017.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-05T07:21:19.744 INFO:teuthology.orchestra.run.smithi017.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-05T07:21:19.747 INFO:teuthology.orchestra.run.smithi017.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-05T07:21:19.747 INFO:teuthology.orchestra.run.smithi017.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-05T07:21:19.815 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-05T07:21:19.826 INFO:teuthology.orchestra.run.smithi017.stdout:============================================================================================== 2024-09-05T07:21:19.826 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-09-05T07:21:19.826 INFO:teuthology.orchestra.run.smithi017.stdout:============================================================================================== 2024-09-05T07:21:19.826 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-05T07:21:19.826 INFO:teuthology.orchestra.run.smithi017.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-05T07:21:19.826 INFO:teuthology.orchestra.run.smithi017.stdout: ceph x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 6.6 k 2024-09-05T07:21:19.826 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 5.4 M 2024-09-05T07:21:19.826 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 69 M 2024-09-05T07:21:19.827 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 454 M 2024-09-05T07:21:19.827 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 896 k 2024-09-05T07:21:19.827 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 6.1 M 2024-09-05T07:21:19.827 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 145 k 2024-09-05T07:21:19.827 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 1.5 M 2024-09-05T07:21:19.827 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 54 M 2024-09-05T07:21:19.827 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 1.5 M 2024-09-05T07:21:19.827 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 146 k 2024-09-05T07:21:19.827 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 3.6 M 2024-09-05T07:21:19.827 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 20 M 2024-09-05T07:21:19.827 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 7.4 M 2024-09-05T07:21:19.827 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 49 k 2024-09-05T07:21:19.827 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 99 M 2024-09-05T07:21:19.828 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 290 M 2024-09-05T07:21:19.828 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 11 M 2024-09-05T07:21:19.828 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 189 M 2024-09-05T07:21:19.828 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 49 M 2024-09-05T07:21:19.828 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 697 M 2024-09-05T07:21:19.828 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-volume noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 285 k 2024-09-05T07:21:19.828 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 765 k 2024-09-05T07:21:19.828 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-mirror x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 224 k 2024-09-05T07:21:19.828 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-shell x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 27 k 2024-09-05T07:21:19.828 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-top noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 18 k 2024-09-05T07:21:19.828 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-05T07:21:19.828 INFO:teuthology.orchestra.run.smithi017.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-05T07:21:19.829 INFO:teuthology.orchestra.run.smithi017.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-05T07:21:19.829 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 32 k 2024-09-05T07:21:19.829 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 752 k 2024-09-05T07:21:19.829 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 5.5 M 2024-09-05T07:21:19.829 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 127 k 2024-09-05T07:21:19.829 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 109 k 2024-09-05T07:21:19.829 INFO:teuthology.orchestra.run.smithi017.stdout: librados2-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 46 M 2024-09-05T07:21:19.829 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 52 M 2024-09-05T07:21:19.829 INFO:teuthology.orchestra.run.smithi017.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-05T07:21:19.829 INFO:teuthology.orchestra.run.smithi017.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-05T07:21:19.829 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-devel x86_64 1:3.2.2-4.el9 appstream 4.4 M 2024-09-05T07:21:19.830 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-05T07:21:19.830 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-05T07:21:19.830 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-05T07:21:19.830 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 162 k 2024-09-05T07:21:19.830 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 615 k 2024-09-05T07:21:19.830 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 321 k 2024-09-05T07:21:19.830 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 768 k 2024-09-05T07:21:19.830 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 301 k 2024-09-05T07:21:19.830 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 1.1 M 2024-09-05T07:21:19.830 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 99 k 2024-09-05T07:21:19.830 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 337 k 2024-09-05T07:21:19.830 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 85 k 2024-09-05T07:21:19.830 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 517 k 2024-09-05T07:21:19.831 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 3.1 M 2024-09-05T07:21:19.831 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 52 M 2024-09-05T07:21:19.831 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 170 k 2024-09-05T07:21:19.831 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 1.3 M 2024-09-05T07:21:19.831 INFO:teuthology.orchestra.run.smithi017.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-05T07:21:19.831 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrading: 2024-09-05T07:21:19.831 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager x86_64 1:1.48.10-1.el9 baseos 2.3 M 2024-09-05T07:21:19.831 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-libnm x86_64 1:1.48.10-1.el9 baseos 1.8 M 2024-09-05T07:21:19.831 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-team x86_64 1:1.48.10-1.el9 baseos 40 k 2024-09-05T07:21:19.831 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-tui x86_64 1:1.48.10-1.el9 baseos 248 k 2024-09-05T07:21:19.831 INFO:teuthology.orchestra.run.smithi017.stdout: librados2 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 3.4 M 2024-09-05T07:21:19.831 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 3.2 M 2024-09-05T07:21:19.831 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-09-05T07:21:19.832 INFO:teuthology.orchestra.run.smithi017.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-05T07:21:19.832 INFO:teuthology.orchestra.run.smithi017.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-05T07:21:19.832 INFO:teuthology.orchestra.run.smithi017.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-05T07:21:19.832 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 21 M 2024-09-05T07:21:19.832 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 23 M 2024-09-05T07:21:19.832 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 32 k 2024-09-05T07:21:19.832 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 2.4 M 2024-09-05T07:21:19.832 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 249 k 2024-09-05T07:21:19.832 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 4.7 M 2024-09-05T07:21:19.832 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 17 M 2024-09-05T07:21:19.832 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 16 k 2024-09-05T07:21:19.832 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 25 k 2024-09-05T07:21:19.832 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-05T07:21:19.833 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-05T07:21:19.833 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-05T07:21:19.833 INFO:teuthology.orchestra.run.smithi017.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-05T07:21:19.833 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-05T07:21:19.833 INFO:teuthology.orchestra.run.smithi017.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-05T07:21:19.833 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-05T07:21:19.833 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-05T07:21:19.833 INFO:teuthology.orchestra.run.smithi017.stdout: libcephsqlite x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 163 k 2024-09-05T07:21:19.833 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-05T07:21:19.833 INFO:teuthology.orchestra.run.smithi017.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-05T07:21:19.833 INFO:teuthology.orchestra.run.smithi017.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-05T07:21:19.833 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-05T07:21:19.833 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-05T07:21:19.834 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 506 k 2024-09-05T07:21:19.834 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-05T07:21:19.834 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 5.3 M 2024-09-05T07:21:19.834 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-05T07:21:19.834 INFO:teuthology.orchestra.run.smithi017.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-05T07:21:19.834 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-05T07:21:19.834 INFO:teuthology.orchestra.run.smithi017.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-05T07:21:19.834 INFO:teuthology.orchestra.run.smithi017.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-05T07:21:19.834 INFO:teuthology.orchestra.run.smithi017.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-05T07:21:19.834 INFO:teuthology.orchestra.run.smithi017.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-05T07:21:19.834 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-05T07:21:19.834 INFO:teuthology.orchestra.run.smithi017.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-05T07:21:19.834 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-05T07:21:19.835 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-05T07:21:19.835 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-05T07:21:19.835 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-05T07:21:19.835 INFO:teuthology.orchestra.run.smithi017.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-05T07:21:19.835 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-05T07:21:19.835 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-05T07:21:19.835 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-05T07:21:19.835 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 45 k 2024-09-05T07:21:19.835 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 136 k 2024-09-05T07:21:19.835 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-05T07:21:19.835 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-05T07:21:19.835 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-05T07:21:19.835 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-05T07:21:19.836 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-05T07:21:19.836 INFO:teuthology.orchestra.run.smithi017.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-05T07:21:19.836 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-05T07:21:19.836 INFO:teuthology.orchestra.run.smithi017.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-05T07:21:19.836 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-05T07:21:19.836 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-05T07:21:19.836 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-05T07:21:19.836 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-05T07:21:19.836 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-05T07:21:19.836 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-05T07:21:19.836 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-05T07:21:19.836 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-05T07:21:19.836 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-05T07:21:19.837 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-05T07:21:19.837 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-05T07:21:19.837 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-05T07:21:19.837 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-05T07:21:19.837 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-05T07:21:19.837 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-05T07:21:19.837 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-05T07:21:19.837 INFO:teuthology.orchestra.run.smithi017.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-05T07:21:19.837 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-05T07:21:19.837 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-05T07:21:19.837 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-05T07:21:19.837 INFO:teuthology.orchestra.run.smithi017.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-05T07:21:19.837 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-05T07:21:19.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-05T07:21:19.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-05T07:21:19.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-05T07:21:19.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-05T07:21:19.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-05T07:21:19.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-05T07:21:19.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-05T07:21:19.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-05T07:21:19.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-05T07:21:19.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-05T07:21:19.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-05T07:21:19.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-05T07:21:19.838 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-05T07:21:19.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-05T07:21:19.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-05T07:21:19.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-05T07:21:19.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-05T07:21:19.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-05T07:21:19.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-05T07:21:19.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-05T07:21:19.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-05T07:21:19.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-05T07:21:19.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-05T07:21:19.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-05T07:21:19.839 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-05T07:21:19.839 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-05T07:21:19.840 INFO:teuthology.orchestra.run.smithi017.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-05T07:21:19.840 INFO:teuthology.orchestra.run.smithi017.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-05T07:21:19.840 INFO:teuthology.orchestra.run.smithi017.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-05T07:21:19.840 INFO:teuthology.orchestra.run.smithi017.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-05T07:21:19.840 INFO:teuthology.orchestra.run.smithi017.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-05T07:21:19.840 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-05T07:21:19.840 INFO:teuthology.orchestra.run.smithi017.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-05T07:21:19.840 INFO:teuthology.orchestra.run.smithi017.stdout:Installing weak dependencies: 2024-09-05T07:21:19.840 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-05T07:21:19.840 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:21:19.840 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-05T07:21:19.840 INFO:teuthology.orchestra.run.smithi017.stdout:============================================================================================== 2024-09-05T07:21:19.840 INFO:teuthology.orchestra.run.smithi017.stdout:Install 170 Packages 2024-09-05T07:21:19.841 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrade 6 Packages 2024-09-05T07:21:19.841 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:21:19.841 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 2.2 G 2024-09-05T07:21:19.841 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-05T07:21:20.743 INFO:teuthology.orchestra.run.smithi026.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-05T07:21:20.743 INFO:teuthology.orchestra.run.smithi026.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-05T07:21:20.772 INFO:teuthology.orchestra.run.smithi026.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-05T07:21:20.773 INFO:teuthology.orchestra.run.smithi026.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-05T07:21:20.774 INFO:teuthology.orchestra.run.smithi026.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-05T07:21:20.775 INFO:teuthology.orchestra.run.smithi026.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-05T07:21:20.776 INFO:teuthology.orchestra.run.smithi026.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-05T07:21:20.779 INFO:teuthology.orchestra.run.smithi026.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-05T07:21:20.780 INFO:teuthology.orchestra.run.smithi026.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-05T07:21:20.785 INFO:teuthology.orchestra.run.smithi017.stdout:(1/176): ceph-19.1.1-259.g91c8a7e5.el9.x86_64.r 46 kB/s | 6.6 kB 00:00 2024-09-05T07:21:20.849 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-09-05T07:21:20.860 INFO:teuthology.orchestra.run.smithi026.stdout:============================================================================================== 2024-09-05T07:21:20.860 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2024-09-05T07:21:20.860 INFO:teuthology.orchestra.run.smithi026.stdout:============================================================================================== 2024-09-05T07:21:20.860 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-09-05T07:21:20.860 INFO:teuthology.orchestra.run.smithi026.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-05T07:21:20.860 INFO:teuthology.orchestra.run.smithi026.stdout: ceph x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 6.6 k 2024-09-05T07:21:20.860 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-base x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 5.4 M 2024-09-05T07:21:20.860 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-base-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 69 M 2024-09-05T07:21:20.860 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-common-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 454 M 2024-09-05T07:21:20.860 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-fuse x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 896 k 2024-09-05T07:21:20.860 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-fuse-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 6.1 M 2024-09-05T07:21:20.860 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 145 k 2024-09-05T07:21:20.861 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 1.5 M 2024-09-05T07:21:20.861 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mds-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 54 M 2024-09-05T07:21:20.861 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 1.5 M 2024-09-05T07:21:20.861 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-cephadm noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 146 k 2024-09-05T07:21:20.861 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-dashboard noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 3.6 M 2024-09-05T07:21:20.861 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 20 M 2024-09-05T07:21:20.861 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 7.4 M 2024-09-05T07:21:20.861 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-rook noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 49 k 2024-09-05T07:21:20.861 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mon-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 99 M 2024-09-05T07:21:20.861 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-osd-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 290 M 2024-09-05T07:21:20.861 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-radosgw x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 11 M 2024-09-05T07:21:20.861 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-radosgw-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 189 M 2024-09-05T07:21:20.862 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-test x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 49 M 2024-09-05T07:21:20.862 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-test-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 697 M 2024-09-05T07:21:20.862 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-volume noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 285 k 2024-09-05T07:21:20.862 INFO:teuthology.orchestra.run.smithi026.stdout: cephadm noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 765 k 2024-09-05T07:21:20.862 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-mirror x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 224 k 2024-09-05T07:21:20.862 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-shell x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 27 k 2024-09-05T07:21:20.862 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-top noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 18 k 2024-09-05T07:21:20.862 INFO:teuthology.orchestra.run.smithi026.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-05T07:21:20.862 INFO:teuthology.orchestra.run.smithi026.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-05T07:21:20.862 INFO:teuthology.orchestra.run.smithi026.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-05T07:21:20.862 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs-devel x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 32 k 2024-09-05T07:21:20.862 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs2 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 752 k 2024-09-05T07:21:20.863 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs2-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 5.5 M 2024-09-05T07:21:20.863 INFO:teuthology.orchestra.run.smithi026.stdout: librados-devel x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 127 k 2024-09-05T07:21:20.863 INFO:teuthology.orchestra.run.smithi026.stdout: librados-devel-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 109 k 2024-09-05T07:21:20.863 INFO:teuthology.orchestra.run.smithi026.stdout: librados2-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 46 M 2024-09-05T07:21:20.863 INFO:teuthology.orchestra.run.smithi026.stdout: librbd1-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 52 M 2024-09-05T07:21:20.863 INFO:teuthology.orchestra.run.smithi026.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-05T07:21:20.863 INFO:teuthology.orchestra.run.smithi026.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-05T07:21:20.863 INFO:teuthology.orchestra.run.smithi026.stdout: openssl-devel x86_64 1:3.2.2-4.el9 appstream 4.4 M 2024-09-05T07:21:20.863 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-05T07:21:20.863 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-05T07:21:20.863 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-05T07:21:20.863 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cephfs x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 162 k 2024-09-05T07:21:20.864 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cephfs-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 615 k 2024-09-05T07:21:20.864 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 321 k 2024-09-05T07:21:20.864 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 768 k 2024-09-05T07:21:20.864 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rbd x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 301 k 2024-09-05T07:21:20.864 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rbd-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 1.1 M 2024-09-05T07:21:20.864 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rgw x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 99 k 2024-09-05T07:21:20.864 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rgw-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 337 k 2024-09-05T07:21:20.864 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-fuse x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 85 k 2024-09-05T07:21:20.864 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-fuse-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 517 k 2024-09-05T07:21:20.864 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-mirror x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 3.1 M 2024-09-05T07:21:20.864 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-mirror-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 52 M 2024-09-05T07:21:20.864 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-nbd x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 170 k 2024-09-05T07:21:20.864 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-nbd-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 1.3 M 2024-09-05T07:21:20.865 INFO:teuthology.orchestra.run.smithi026.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-05T07:21:20.865 INFO:teuthology.orchestra.run.smithi026.stdout:Upgrading: 2024-09-05T07:21:20.865 INFO:teuthology.orchestra.run.smithi026.stdout: NetworkManager x86_64 1:1.48.10-1.el9 baseos 2.3 M 2024-09-05T07:21:20.865 INFO:teuthology.orchestra.run.smithi026.stdout: NetworkManager-libnm x86_64 1:1.48.10-1.el9 baseos 1.8 M 2024-09-05T07:21:20.865 INFO:teuthology.orchestra.run.smithi026.stdout: NetworkManager-team x86_64 1:1.48.10-1.el9 baseos 40 k 2024-09-05T07:21:20.865 INFO:teuthology.orchestra.run.smithi026.stdout: NetworkManager-tui x86_64 1:1.48.10-1.el9 baseos 248 k 2024-09-05T07:21:20.865 INFO:teuthology.orchestra.run.smithi026.stdout: librados2 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 3.4 M 2024-09-05T07:21:20.865 INFO:teuthology.orchestra.run.smithi026.stdout: librbd1 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 3.2 M 2024-09-05T07:21:20.865 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2024-09-05T07:21:20.865 INFO:teuthology.orchestra.run.smithi026.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-05T07:21:20.865 INFO:teuthology.orchestra.run.smithi026.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-05T07:21:20.865 INFO:teuthology.orchestra.run.smithi026.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-05T07:21:20.865 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-common x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 21 M 2024-09-05T07:21:20.865 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-debuginfo x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 23 M 2024-09-05T07:21:20.866 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-grafana-dashboards noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 32 k 2024-09-05T07:21:20.866 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mds x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 2.4 M 2024-09-05T07:21:20.866 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-modules-core noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 249 k 2024-09-05T07:21:20.866 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mon x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 4.7 M 2024-09-05T07:21:20.866 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-osd x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 17 M 2024-09-05T07:21:20.866 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-prometheus-alerts noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 16 k 2024-09-05T07:21:20.866 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-selinux x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 25 k 2024-09-05T07:21:20.866 INFO:teuthology.orchestra.run.smithi026.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-05T07:21:20.866 INFO:teuthology.orchestra.run.smithi026.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-05T07:21:20.866 INFO:teuthology.orchestra.run.smithi026.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-05T07:21:20.866 INFO:teuthology.orchestra.run.smithi026.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-05T07:21:20.866 INFO:teuthology.orchestra.run.smithi026.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-05T07:21:20.867 INFO:teuthology.orchestra.run.smithi026.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-05T07:21:20.867 INFO:teuthology.orchestra.run.smithi026.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-05T07:21:20.867 INFO:teuthology.orchestra.run.smithi026.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-05T07:21:20.867 INFO:teuthology.orchestra.run.smithi026.stdout: libcephsqlite x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 163 k 2024-09-05T07:21:20.867 INFO:teuthology.orchestra.run.smithi026.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-05T07:21:20.867 INFO:teuthology.orchestra.run.smithi026.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-05T07:21:20.867 INFO:teuthology.orchestra.run.smithi026.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-05T07:21:20.867 INFO:teuthology.orchestra.run.smithi026.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-05T07:21:20.867 INFO:teuthology.orchestra.run.smithi026.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-05T07:21:20.867 INFO:teuthology.orchestra.run.smithi026.stdout: libradosstriper1 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 506 k 2024-09-05T07:21:20.867 INFO:teuthology.orchestra.run.smithi026.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-05T07:21:20.868 INFO:teuthology.orchestra.run.smithi026.stdout: librgw2 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 5.3 M 2024-09-05T07:21:20.868 INFO:teuthology.orchestra.run.smithi026.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-05T07:21:20.868 INFO:teuthology.orchestra.run.smithi026.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-05T07:21:20.868 INFO:teuthology.orchestra.run.smithi026.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-05T07:21:20.868 INFO:teuthology.orchestra.run.smithi026.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-05T07:21:20.868 INFO:teuthology.orchestra.run.smithi026.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-05T07:21:20.868 INFO:teuthology.orchestra.run.smithi026.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-05T07:21:20.868 INFO:teuthology.orchestra.run.smithi026.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-05T07:21:20.868 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-05T07:21:20.868 INFO:teuthology.orchestra.run.smithi026.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-05T07:21:20.868 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-05T07:21:20.868 INFO:teuthology.orchestra.run.smithi026.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-05T07:21:20.868 INFO:teuthology.orchestra.run.smithi026.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-05T07:21:20.869 INFO:teuthology.orchestra.run.smithi026.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-05T07:21:20.869 INFO:teuthology.orchestra.run.smithi026.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-05T07:21:20.869 INFO:teuthology.orchestra.run.smithi026.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-05T07:21:20.869 INFO:teuthology.orchestra.run.smithi026.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-05T07:21:20.869 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-05T07:21:20.869 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-argparse x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 45 k 2024-09-05T07:21:20.869 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-common x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 136 k 2024-09-05T07:21:20.869 INFO:teuthology.orchestra.run.smithi026.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-05T07:21:20.869 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-05T07:21:20.869 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-05T07:21:20.869 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-05T07:21:20.869 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-05T07:21:20.869 INFO:teuthology.orchestra.run.smithi026.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-05T07:21:20.869 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-05T07:21:20.870 INFO:teuthology.orchestra.run.smithi026.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-05T07:21:20.870 INFO:teuthology.orchestra.run.smithi026.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-05T07:21:20.870 INFO:teuthology.orchestra.run.smithi026.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-05T07:21:20.870 INFO:teuthology.orchestra.run.smithi026.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-05T07:21:20.870 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-05T07:21:20.870 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-05T07:21:20.870 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-05T07:21:20.870 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-05T07:21:20.870 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-05T07:21:20.870 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-05T07:21:20.870 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-05T07:21:20.870 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-05T07:21:20.871 INFO:teuthology.orchestra.run.smithi026.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-05T07:21:20.871 INFO:teuthology.orchestra.run.smithi026.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-05T07:21:20.871 INFO:teuthology.orchestra.run.smithi026.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-05T07:21:20.871 INFO:teuthology.orchestra.run.smithi026.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-05T07:21:20.871 INFO:teuthology.orchestra.run.smithi026.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-05T07:21:20.871 INFO:teuthology.orchestra.run.smithi026.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-05T07:21:20.871 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-05T07:21:20.871 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-05T07:21:20.871 INFO:teuthology.orchestra.run.smithi026.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-05T07:21:20.871 INFO:teuthology.orchestra.run.smithi026.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-05T07:21:20.871 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-05T07:21:20.871 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-05T07:21:20.871 INFO:teuthology.orchestra.run.smithi026.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-05T07:21:20.871 INFO:teuthology.orchestra.run.smithi026.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-05T07:21:20.872 INFO:teuthology.orchestra.run.smithi026.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-05T07:21:20.872 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-05T07:21:20.872 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-05T07:21:20.872 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-05T07:21:20.872 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-05T07:21:20.872 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-05T07:21:20.872 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-05T07:21:20.872 INFO:teuthology.orchestra.run.smithi026.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-05T07:21:20.872 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-05T07:21:20.872 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-05T07:21:20.872 INFO:teuthology.orchestra.run.smithi026.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-05T07:21:20.872 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-05T07:21:20.873 INFO:teuthology.orchestra.run.smithi026.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-05T07:21:20.873 INFO:teuthology.orchestra.run.smithi026.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-05T07:21:20.873 INFO:teuthology.orchestra.run.smithi026.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-05T07:21:20.873 INFO:teuthology.orchestra.run.smithi026.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-05T07:21:20.873 INFO:teuthology.orchestra.run.smithi026.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-05T07:21:20.873 INFO:teuthology.orchestra.run.smithi026.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-05T07:21:20.873 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-05T07:21:20.873 INFO:teuthology.orchestra.run.smithi026.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-05T07:21:20.873 INFO:teuthology.orchestra.run.smithi026.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-05T07:21:20.873 INFO:teuthology.orchestra.run.smithi026.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-05T07:21:20.873 INFO:teuthology.orchestra.run.smithi026.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-05T07:21:20.874 INFO:teuthology.orchestra.run.smithi026.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-05T07:21:20.874 INFO:teuthology.orchestra.run.smithi026.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-05T07:21:20.874 INFO:teuthology.orchestra.run.smithi026.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-05T07:21:20.874 INFO:teuthology.orchestra.run.smithi026.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-05T07:21:20.874 INFO:teuthology.orchestra.run.smithi026.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-05T07:21:20.874 INFO:teuthology.orchestra.run.smithi026.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-05T07:21:20.874 INFO:teuthology.orchestra.run.smithi026.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-05T07:21:20.874 INFO:teuthology.orchestra.run.smithi026.stdout:Installing weak dependencies: 2024-09-05T07:21:20.874 INFO:teuthology.orchestra.run.smithi026.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-05T07:21:20.874 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:21:20.874 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-09-05T07:21:20.874 INFO:teuthology.orchestra.run.smithi026.stdout:============================================================================================== 2024-09-05T07:21:20.874 INFO:teuthology.orchestra.run.smithi026.stdout:Install 170 Packages 2024-09-05T07:21:20.874 INFO:teuthology.orchestra.run.smithi026.stdout:Upgrade 6 Packages 2024-09-05T07:21:20.875 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:21:20.875 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 2.2 G 2024-09-05T07:21:20.875 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-09-05T07:21:21.102 INFO:teuthology.orchestra.run.smithi017.stdout:(2/176): ceph-base-19.1.1-259.g91c8a7e5.el9.x86 12 MB/s | 5.4 MB 00:00 2024-09-05T07:21:21.533 INFO:teuthology.orchestra.run.smithi026.stdout:(1/176): ceph-19.1.1-259.g91c8a7e5.el9.x86_64.r 22 kB/s | 6.6 kB 00:00 2024-09-05T07:21:23.469 INFO:teuthology.orchestra.run.smithi017.stdout:(3/176): ceph-common-19.1.1-259.g91c8a7e5.el9.x 7.9 MB/s | 21 MB 00:02 2024-09-05T07:21:24.661 INFO:teuthology.orchestra.run.smithi017.stdout:(4/176): ceph-base-debuginfo-19.1.1-259.g91c8a7 17 MB/s | 69 MB 00:04 2024-09-05T07:21:24.786 INFO:teuthology.orchestra.run.smithi017.stdout:(5/176): ceph-fuse-19.1.1-259.g91c8a7e5.el9.x86 7.0 MB/s | 896 kB 00:00 2024-09-05T07:21:25.245 INFO:teuthology.orchestra.run.smithi017.stdout:(6/176): ceph-fuse-debuginfo-19.1.1-259.g91c8a7 13 MB/s | 6.1 MB 00:00 2024-09-05T07:21:25.495 INFO:teuthology.orchestra.run.smithi017.stdout:(7/176): ceph-debuginfo-19.1.1-259.g91c8a7e5.el 12 MB/s | 23 MB 00:02 2024-09-05T07:21:25.520 INFO:teuthology.orchestra.run.smithi017.stdout:(8/176): ceph-immutable-object-cache-19.1.1-259 529 kB/s | 145 kB 00:00 2024-09-05T07:21:25.533 INFO:teuthology.orchestra.run.smithi026.stdout:(2/176): ceph-common-19.1.1-259.g91c8a7e5.el9.x 5.3 MB/s | 21 MB 00:03 2024-09-05T07:21:25.579 INFO:teuthology.orchestra.run.smithi017.stdout:(9/176): ceph-immutable-object-cache-debuginfo- 18 MB/s | 1.5 MB 00:00 2024-09-05T07:21:25.729 INFO:teuthology.orchestra.run.smithi017.stdout:(10/176): ceph-mds-19.1.1-259.g91c8a7e5.el9.x86 11 MB/s | 2.4 MB 00:00 2024-09-05T07:21:25.791 INFO:teuthology.orchestra.run.smithi026.stdout:(3/176): ceph-base-19.1.1-259.g91c8a7e5.el9.x86 1.2 MB/s | 5.4 MB 00:04 2024-09-05T07:21:25.887 INFO:teuthology.orchestra.run.smithi017.stdout:(11/176): ceph-mgr-19.1.1-259.g91c8a7e5.el9.x86 9.6 MB/s | 1.5 MB 00:00 2024-09-05T07:21:27.338 INFO:teuthology.orchestra.run.smithi017.stdout:(12/176): ceph-mgr-debuginfo-19.1.1-259.g91c8a7 14 MB/s | 20 MB 00:01 2024-09-05T07:21:27.663 INFO:teuthology.orchestra.run.smithi017.stdout:(13/176): ceph-mon-19.1.1-259.g91c8a7e5.el9.x86 14 MB/s | 4.7 MB 00:00 2024-09-05T07:21:29.271 INFO:teuthology.orchestra.run.smithi017.stdout:(14/176): ceph-mds-debuginfo-19.1.1-259.g91c8a7 15 MB/s | 54 MB 00:03 2024-09-05T07:21:30.463 INFO:teuthology.orchestra.run.smithi017.stdout:(15/176): ceph-osd-19.1.1-259.g91c8a7e5.el9.x86 14 MB/s | 17 MB 00:01 2024-09-05T07:21:34.580 INFO:teuthology.orchestra.run.smithi017.stdout:(16/176): ceph-mon-debuginfo-19.1.1-259.g91c8a7 14 MB/s | 99 MB 00:06 2024-09-05T07:21:34.757 INFO:teuthology.orchestra.run.smithi026.stdout:(4/176): ceph-debuginfo-19.1.1-259.g91c8a7e5.el 2.6 MB/s | 23 MB 00:08 2024-09-05T07:21:35.199 INFO:teuthology.orchestra.run.smithi026.stdout:(5/176): ceph-fuse-19.1.1-259.g91c8a7e5.el9.x86 2.0 MB/s | 896 kB 00:00 2024-09-05T07:21:35.347 INFO:teuthology.orchestra.run.smithi017.stdout:(17/176): ceph-radosgw-19.1.1-259.g91c8a7e5.el9 14 MB/s | 11 MB 00:00 2024-09-05T07:21:37.415 INFO:teuthology.orchestra.run.smithi026.stdout:(6/176): ceph-fuse-debuginfo-19.1.1-259.g91c8a7 2.8 MB/s | 6.1 MB 00:02 2024-09-05T07:21:37.632 INFO:teuthology.orchestra.run.smithi026.stdout:(7/176): ceph-immutable-object-cache-19.1.1-259 673 kB/s | 145 kB 00:00 2024-09-05T07:21:38.282 INFO:teuthology.orchestra.run.smithi026.stdout:(8/176): ceph-immutable-object-cache-debuginfo- 2.2 MB/s | 1.5 MB 00:00 2024-09-05T07:21:39.299 INFO:teuthology.orchestra.run.smithi026.stdout:(9/176): ceph-mds-19.1.1-259.g91c8a7e5.el9.x86_ 2.3 MB/s | 2.4 MB 00:01 2024-09-05T07:21:51.546 INFO:teuthology.orchestra.run.smithi017.stdout:(18/176): ceph-osd-debuginfo-19.1.1-259.g91c8a7 14 MB/s | 290 MB 00:21 2024-09-05T07:21:51.688 INFO:teuthology.orchestra.run.smithi017.stdout:(19/176): ceph-selinux-19.1.1-259.g91c8a7e5.el9 178 kB/s | 25 kB 00:00 2024-09-05T07:21:52.206 INFO:teuthology.orchestra.run.smithi026.stdout:(10/176): ceph-base-debuginfo-19.1.1-259.g91c8a 2.2 MB/s | 69 MB 00:30 2024-09-05T07:21:53.281 INFO:teuthology.orchestra.run.smithi026.stdout:(11/176): ceph-mgr-19.1.1-259.g91c8a7e5.el9.x86 1.4 MB/s | 1.5 MB 00:01 2024-09-05T07:21:56.188 INFO:teuthology.orchestra.run.smithi017.stdout:(20/176): ceph-test-19.1.1-259.g91c8a7e5.el9.x8 11 MB/s | 49 MB 00:04 2024-09-05T07:21:59.348 INFO:teuthology.orchestra.run.smithi026.stdout:(12/176): ceph-mds-debuginfo-19.1.1-259.g91c8a7 2.7 MB/s | 54 MB 00:20 2024-09-05T07:22:01.132 INFO:teuthology.orchestra.run.smithi026.stdout:(13/176): ceph-mon-19.1.1-259.g91c8a7e5.el9.x86 2.6 MB/s | 4.7 MB 00:01 2024-09-05T07:22:01.865 INFO:teuthology.orchestra.run.smithi026.stdout:(14/176): ceph-mgr-debuginfo-19.1.1-259.g91c8a7 2.4 MB/s | 20 MB 00:08 2024-09-05T07:22:02.788 INFO:teuthology.orchestra.run.smithi017.stdout:(21/176): ceph-radosgw-debuginfo-19.1.1-259.g91 6.9 MB/s | 189 MB 00:27 2024-09-05T07:22:02.921 INFO:teuthology.orchestra.run.smithi017.stdout:(22/176): cephfs-mirror-19.1.1-259.g91c8a7e5.el 1.7 MB/s | 224 kB 00:00 2024-09-05T07:22:02.972 INFO:teuthology.orchestra.run.smithi017.stdout:(23/176): cephfs-shell-19.1.1-259.g91c8a7e5.el9 544 kB/s | 27 kB 00:00 2024-09-05T07:22:03.022 INFO:teuthology.orchestra.run.smithi017.stdout:(24/176): libcephfs-devel-19.1.1-259.g91c8a7e5. 637 kB/s | 32 kB 00:00 2024-09-05T07:22:03.222 INFO:teuthology.orchestra.run.smithi017.stdout:(25/176): libcephfs2-19.1.1-259.g91c8a7e5.el9.x 3.7 MB/s | 752 kB 00:00 2024-09-05T07:22:04.339 INFO:teuthology.orchestra.run.smithi017.stdout:(26/176): libcephfs2-debuginfo-19.1.1-259.g91c8 4.9 MB/s | 5.5 MB 00:01 2024-09-05T07:22:04.398 INFO:teuthology.orchestra.run.smithi017.stdout:(27/176): libcephsqlite-19.1.1-259.g91c8a7e5.el 2.7 MB/s | 163 kB 00:00 2024-09-05T07:22:04.465 INFO:teuthology.orchestra.run.smithi017.stdout:(28/176): librados-devel-19.1.1-259.g91c8a7e5.e 1.9 MB/s | 127 kB 00:00 2024-09-05T07:22:04.532 INFO:teuthology.orchestra.run.smithi017.stdout:(29/176): librados-devel-debuginfo-19.1.1-259.g 1.6 MB/s | 109 kB 00:00 2024-09-05T07:22:04.682 INFO:teuthology.orchestra.run.smithi026.stdout:(15/176): ceph-osd-19.1.1-259.g91c8a7e5.el9.x86 6.0 MB/s | 17 MB 00:02 2024-09-05T07:22:10.515 INFO:teuthology.orchestra.run.smithi026.stdout:(16/176): ceph-mon-debuginfo-19.1.1-259.g91c8a7 11 MB/s | 99 MB 00:09 2024-09-05T07:22:11.048 INFO:teuthology.orchestra.run.smithi026.stdout:(17/176): ceph-radosgw-19.1.1-259.g91c8a7e5.el9 20 MB/s | 11 MB 00:00 2024-09-05T07:22:12.173 INFO:teuthology.orchestra.run.smithi017.stdout:(30/176): ceph-common-debuginfo-19.1.1-259.g91c 8.9 MB/s | 454 MB 00:51 2024-09-05T07:22:12.482 INFO:teuthology.orchestra.run.smithi017.stdout:(31/176): libradosstriper1-19.1.1-259.g91c8a7e5 1.6 MB/s | 506 kB 00:00 2024-09-05T07:22:14.340 INFO:teuthology.orchestra.run.smithi017.stdout:(32/176): librados2-debuginfo-19.1.1-259.g91c8a 4.6 MB/s | 46 MB 00:09 2024-09-05T07:22:15.432 INFO:teuthology.orchestra.run.smithi017.stdout:(33/176): librgw2-19.1.1-259.g91c8a7e5.el9.x86_ 4.9 MB/s | 5.3 MB 00:01 2024-09-05T07:22:15.532 INFO:teuthology.orchestra.run.smithi017.stdout:(34/176): python3-ceph-argparse-19.1.1-259.g91c 451 kB/s | 45 kB 00:00 2024-09-05T07:22:15.633 INFO:teuthology.orchestra.run.smithi017.stdout:(35/176): python3-ceph-common-19.1.1-259.g91c8a 1.3 MB/s | 136 kB 00:00 2024-09-05T07:22:15.733 INFO:teuthology.orchestra.run.smithi017.stdout:(36/176): python3-cephfs-19.1.1-259.g91c8a7e5.e 1.6 MB/s | 162 kB 00:00 2024-09-05T07:22:15.983 INFO:teuthology.orchestra.run.smithi017.stdout:(37/176): python3-cephfs-debuginfo-19.1.1-259.g 2.4 MB/s | 615 kB 00:00 2024-09-05T07:22:16.083 INFO:teuthology.orchestra.run.smithi017.stdout:(38/176): python3-rados-19.1.1-259.g91c8a7e5.el 3.1 MB/s | 321 kB 00:00 2024-09-05T07:22:16.325 INFO:teuthology.orchestra.run.smithi017.stdout:(39/176): python3-rados-debuginfo-19.1.1-259.g9 3.1 MB/s | 768 kB 00:00 2024-09-05T07:22:16.417 INFO:teuthology.orchestra.run.smithi017.stdout:(40/176): python3-rbd-19.1.1-259.g91c8a7e5.el9. 3.2 MB/s | 301 kB 00:00 2024-09-05T07:22:16.726 INFO:teuthology.orchestra.run.smithi017.stdout:(41/176): python3-rbd-debuginfo-19.1.1-259.g91c 3.7 MB/s | 1.1 MB 00:00 2024-09-05T07:22:16.817 INFO:teuthology.orchestra.run.smithi017.stdout:(42/176): python3-rgw-19.1.1-259.g91c8a7e5.el9. 1.1 MB/s | 99 kB 00:00 2024-09-05T07:22:16.918 INFO:teuthology.orchestra.run.smithi017.stdout:(43/176): python3-rgw-debuginfo-19.1.1-259.g91c 3.3 MB/s | 337 kB 00:00 2024-09-05T07:22:17.010 INFO:teuthology.orchestra.run.smithi017.stdout:(44/176): rbd-fuse-19.1.1-259.g91c8a7e5.el9.x86 931 kB/s | 85 kB 00:00 2024-09-05T07:22:17.185 INFO:teuthology.orchestra.run.smithi017.stdout:(45/176): rbd-fuse-debuginfo-19.1.1-259.g91c8a7 2.9 MB/s | 517 kB 00:00 2024-09-05T07:22:17.902 INFO:teuthology.orchestra.run.smithi017.stdout:(46/176): rbd-mirror-19.1.1-259.g91c8a7e5.el9.x 4.3 MB/s | 3.1 MB 00:00 2024-09-05T07:22:20.655 INFO:teuthology.orchestra.run.smithi026.stdout:(18/176): ceph-radosgw-debuginfo-19.1.1-259.g91 20 MB/s | 189 MB 00:09 2024-09-05T07:22:20.764 INFO:teuthology.orchestra.run.smithi026.stdout:(19/176): ceph-selinux-19.1.1-259.g91c8a7e5.el9 233 kB/s | 25 kB 00:00 2024-09-05T07:22:23.169 INFO:teuthology.orchestra.run.smithi017.stdout:(47/176): librbd1-debuginfo-19.1.1-259.g91c8a7e 4.9 MB/s | 52 MB 00:10 2024-09-05T07:22:23.294 INFO:teuthology.orchestra.run.smithi017.stdout:(48/176): rbd-nbd-19.1.1-259.g91c8a7e5.el9.x86_ 1.3 MB/s | 170 kB 00:00 2024-09-05T07:22:23.661 INFO:teuthology.orchestra.run.smithi017.stdout:(49/176): rbd-nbd-debuginfo-19.1.1-259.g91c8a7e 3.5 MB/s | 1.3 MB 00:00 2024-09-05T07:22:23.736 INFO:teuthology.orchestra.run.smithi017.stdout:(50/176): ceph-grafana-dashboards-19.1.1-259.g9 425 kB/s | 32 kB 00:00 2024-09-05T07:22:23.811 INFO:teuthology.orchestra.run.smithi017.stdout:(51/176): ceph-mgr-cephadm-19.1.1-259.g91c8a7e5 1.9 MB/s | 146 kB 00:00 2024-09-05T07:22:24.395 INFO:teuthology.orchestra.run.smithi017.stdout:(52/176): ceph-mgr-dashboard-19.1.1-259.g91c8a7 6.1 MB/s | 3.6 MB 00:00 2024-09-05T07:22:25.262 INFO:teuthology.orchestra.run.smithi017.stdout:(53/176): rbd-mirror-debuginfo-19.1.1-259.g91c8 7.1 MB/s | 52 MB 00:07 2024-09-05T07:22:25.329 INFO:teuthology.orchestra.run.smithi017.stdout:(54/176): ceph-mgr-modules-core-19.1.1-259.g91c 3.7 MB/s | 249 kB 00:00 2024-09-05T07:22:25.396 INFO:teuthology.orchestra.run.smithi017.stdout:(55/176): ceph-mgr-rook-19.1.1-259.g91c8a7e5.el 744 kB/s | 49 kB 00:00 2024-09-05T07:22:25.454 INFO:teuthology.orchestra.run.smithi017.stdout:(56/176): ceph-prometheus-alerts-19.1.1-259.g91 283 kB/s | 16 kB 00:00 2024-09-05T07:22:25.564 INFO:teuthology.orchestra.run.smithi017.stdout:(57/176): ceph-mgr-diskprediction-local-19.1.1- 6.3 MB/s | 7.4 MB 00:01 2024-09-05T07:22:25.589 INFO:teuthology.orchestra.run.smithi017.stdout:(58/176): ceph-volume-19.1.1-259.g91c8a7e5.el9. 2.1 MB/s | 285 kB 00:00 2024-09-05T07:22:25.630 INFO:teuthology.orchestra.run.smithi017.stdout:(59/176): cephfs-top-19.1.1-259.g91c8a7e5.el9.n 440 kB/s | 18 kB 00:00 2024-09-05T07:22:25.672 INFO:teuthology.orchestra.run.smithi017.stdout:(60/176): cephadm-19.1.1-259.g91c8a7e5.el9.noar 6.9 MB/s | 765 kB 00:00 2024-09-05T07:22:26.056 INFO:teuthology.orchestra.run.smithi017.stdout:(61/176): fuse-2.9.9-16.el9.x86_64.rpm 188 kB/s | 80 kB 00:00 2024-09-05T07:22:26.080 INFO:teuthology.orchestra.run.smithi026.stdout:(20/176): ceph-common-debuginfo-19.1.1-259.g91c 7.5 MB/s | 454 MB 01:00 2024-09-05T07:22:26.323 INFO:teuthology.orchestra.run.smithi017.stdout:(62/176): libquadmath-11.5.0-2.el9.x86_64.rpm 717 kB/s | 191 kB 00:00 2024-09-05T07:22:26.440 INFO:teuthology.orchestra.run.smithi017.stdout:(63/176): libgfortran-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 801 kB 00:00 2024-09-05T07:22:26.507 INFO:teuthology.orchestra.run.smithi017.stdout:(64/176): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-09-05T07:22:26.616 INFO:teuthology.orchestra.run.smithi017.stdout:(65/176): python3-ply-3.11-14.el9.noarch.rpm 984 kB/s | 106 kB 00:00 2024-09-05T07:22:26.724 INFO:teuthology.orchestra.run.smithi017.stdout:(66/176): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-09-05T07:22:26.759 INFO:teuthology.orchestra.run.smithi017.stdout:(67/176): python3-cryptography-36.0.1-4.el9.x86 3.8 MB/s | 1.2 MB 00:00 2024-09-05T07:22:26.818 INFO:teuthology.orchestra.run.smithi017.stdout:(68/176): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-09-05T07:22:26.868 INFO:teuthology.orchestra.run.smithi017.stdout:(69/176): python3-urllib3-1.26.5-6.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-09-05T07:22:26.986 INFO:teuthology.orchestra.run.smithi017.stdout:(70/176): automake-1.16.2-8.el9.noarch.rpm 4.0 MB/s | 689 kB 00:00 2024-09-05T07:22:27.028 INFO:teuthology.orchestra.run.smithi017.stdout:(71/176): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-09-05T07:22:27.061 INFO:teuthology.orchestra.run.smithi017.stdout:(72/176): elfutils-libelf-devel-0.191-4.el9.x86 656 kB/s | 22 kB 00:00 2024-09-05T07:22:27.103 INFO:teuthology.orchestra.run.smithi017.stdout:(73/176): flex-2.6.4-9.el9.x86_64.rpm 7.4 MB/s | 313 kB 00:00 2024-09-05T07:22:27.145 INFO:teuthology.orchestra.run.smithi017.stdout:(74/176): bison-3.7.4-5.el9.x86_64.rpm 3.3 MB/s | 943 kB 00:00 2024-09-05T07:22:27.162 INFO:teuthology.orchestra.run.smithi017.stdout:(75/176): flexiblas-3.0.4-8.el9.x86_64.rpm 557 kB/s | 33 kB 00:00 2024-09-05T07:22:27.189 INFO:teuthology.orchestra.run.smithi026.stdout:(21/176): ceph-test-19.1.1-259.g91c8a7e5.el9.x8 7.6 MB/s | 49 MB 00:06 2024-09-05T07:22:27.195 INFO:teuthology.orchestra.run.smithi017.stdout:(76/176): flexiblas-openblas-openmp-3.0.4-8.el9 549 kB/s | 18 kB 00:00 2024-09-05T07:22:27.229 INFO:teuthology.orchestra.run.smithi017.stdout:(77/176): libaio-devel-0.3.111-13.el9.x86_64.rp 335 kB/s | 11 kB 00:00 2024-09-05T07:22:27.239 INFO:teuthology.orchestra.run.smithi026.stdout:(22/176): cephfs-mirror-19.1.1-259.g91c8a7e5.el 4.4 MB/s | 224 kB 00:00 2024-09-05T07:22:27.305 INFO:teuthology.orchestra.run.smithi017.stdout:(78/176): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-05T07:22:27.314 INFO:teuthology.orchestra.run.smithi026.stdout:(23/176): cephfs-shell-19.1.1-259.g91c8a7e5.el9 361 kB/s | 27 kB 00:00 2024-09-05T07:22:27.347 INFO:teuthology.orchestra.run.smithi017.stdout:(79/176): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-05T07:22:27.398 INFO:teuthology.orchestra.run.smithi026.stdout:(24/176): libcephfs-devel-19.1.1-259.g91c8a7e5. 381 kB/s | 32 kB 00:00 2024-09-05T07:22:27.539 INFO:teuthology.orchestra.run.smithi017.stdout:(80/176): librdkafka-1.6.1-102.el9.x86_64.rpm 3.4 MB/s | 662 kB 00:00 2024-09-05T07:22:27.539 INFO:teuthology.orchestra.run.smithi026.stdout:(25/176): libcephfs2-19.1.1-259.g91c8a7e5.el9.x 5.2 MB/s | 752 kB 00:00 2024-09-05T07:22:27.723 INFO:teuthology.orchestra.run.smithi017.stdout:(81/176): libtool-2.4.6-46.el9.x86_64.rpm 3.1 MB/s | 581 kB 00:00 2024-09-05T07:22:27.764 INFO:teuthology.orchestra.run.smithi017.stdout:(82/176): libuuid-devel-2.37.4-20.el9.x86_64.rp 594 kB/s | 24 kB 00:00 2024-09-05T07:22:27.806 INFO:teuthology.orchestra.run.smithi017.stdout:(83/176): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-05T07:22:27.940 INFO:teuthology.orchestra.run.smithi017.stdout:(84/176): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-09-05T07:22:28.007 INFO:teuthology.orchestra.run.smithi017.stdout:(85/176): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.5 MB/s | 3.0 MB 00:00 2024-09-05T07:22:28.015 INFO:teuthology.orchestra.run.smithi026.stdout:(26/176): libcephfs2-debuginfo-19.1.1-259.g91c8 12 MB/s | 5.5 MB 00:00 2024-09-05T07:22:28.040 INFO:teuthology.orchestra.run.smithi017.stdout:(86/176): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-05T07:22:28.066 INFO:teuthology.orchestra.run.smithi017.stdout:(87/176): openblas-0.3.26-2.el9.x86_64.rpm 657 kB/s | 38 kB 00:00 2024-09-05T07:22:28.082 INFO:teuthology.orchestra.run.smithi026.stdout:(27/176): libcephsqlite-19.1.1-259.g91c8a7e5.el 2.4 MB/s | 163 kB 00:00 2024-09-05T07:22:28.157 INFO:teuthology.orchestra.run.smithi026.stdout:(28/176): librados-devel-19.1.1-259.g91c8a7e5.e 1.7 MB/s | 127 kB 00:00 2024-09-05T07:22:28.232 INFO:teuthology.orchestra.run.smithi026.stdout:(29/176): librados-devel-debuginfo-19.1.1-259.g 1.4 MB/s | 109 kB 00:00 2024-09-05T07:22:29.308 INFO:teuthology.orchestra.run.smithi017.stdout:(88/176): openssl-devel-3.2.2-4.el9.x86_64.rpm 3.6 MB/s | 4.4 MB 00:01 2024-09-05T07:22:29.725 INFO:teuthology.orchestra.run.smithi017.stdout:(89/176): openblas-openmp-0.3.26-2.el9.x86_64.r 2.9 MB/s | 4.9 MB 00:01 2024-09-05T07:22:30.000 INFO:teuthology.orchestra.run.smithi017.stdout:(90/176): postgresql-13.16-1.el9.x86_64.rpm 2.3 MB/s | 1.6 MB 00:00 2024-09-05T07:22:30.309 INFO:teuthology.orchestra.run.smithi017.stdout:(91/176): postgresql-contrib-13.16-1.el9.x86_64 1.5 MB/s | 910 kB 00:00 2024-09-05T07:22:30.575 INFO:teuthology.orchestra.run.smithi017.stdout:(92/176): postgresql-private-libs-13.16-1.el9.x 239 kB/s | 137 kB 00:00 2024-09-05T07:22:30.901 INFO:teuthology.orchestra.run.smithi017.stdout:(93/176): protobuf-3.14.0-13.el9.x86_64.rpm 3.1 MB/s | 1.0 MB 00:00 2024-09-05T07:22:30.949 INFO:teuthology.orchestra.run.smithi026.stdout:(30/176): librados2-debuginfo-19.1.1-259.g91c8a 17 MB/s | 46 MB 00:02 2024-09-05T07:22:31.024 INFO:teuthology.orchestra.run.smithi026.stdout:(31/176): libradosstriper1-19.1.1-259.g91c8a7e5 6.6 MB/s | 506 kB 00:00 2024-09-05T07:22:31.159 INFO:teuthology.orchestra.run.smithi017.stdout:(94/176): python3-attrs-20.3.0-7.el9.noarch.rpm 339 kB/s | 87 kB 00:00 2024-09-05T07:22:31.576 INFO:teuthology.orchestra.run.smithi017.stdout:(95/176): postgresql-server-13.16-1.el9.x86_64. 4.6 MB/s | 5.8 MB 00:01 2024-09-05T07:22:31.893 INFO:teuthology.orchestra.run.smithi017.stdout:(96/176): python3-colorama-0.4.6-3.el9.noarch.r 193 kB/s | 61 kB 00:00 2024-09-05T07:22:32.185 INFO:teuthology.orchestra.run.smithi017.stdout:(97/176): python3-devel-3.9.19-8.el9.x86_64.rpm 839 kB/s | 245 kB 00:00 2024-09-05T07:22:32.436 INFO:teuthology.orchestra.run.smithi017.stdout:(98/176): python3-jinja2-2.11.3-6.el9.noarch.rp 994 kB/s | 248 kB 00:00 2024-09-05T07:22:32.694 INFO:teuthology.orchestra.run.smithi017.stdout:(99/176): python3-jsonpatch-1.21-16.el9.noarch. 99 kB/s | 26 kB 00:00 2024-09-05T07:22:32.878 INFO:teuthology.orchestra.run.smithi017.stdout:(100/176): python3-jsonpointer-2.0-4.el9.noarch 104 kB/s | 19 kB 00:00 2024-09-05T07:22:32.937 INFO:teuthology.orchestra.run.smithi017.stdout:(101/176): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-05T07:22:32.970 INFO:teuthology.orchestra.run.smithi017.stdout:(102/176): python3-markupsafe-1.1.1-12.el9.x86_ 1.0 MB/s | 35 kB 00:00 2024-09-05T07:22:33.137 INFO:teuthology.orchestra.run.smithi017.stdout:(103/176): python3-numpy-1.20.1-5.el9.x86_64.rp 31 MB/s | 5.1 MB 00:00 2024-09-05T07:22:33.188 INFO:teuthology.orchestra.run.smithi017.stdout:(104/176): python3-numpy-f2py-1.20.1-5.el9.x86_ 4.9 MB/s | 250 kB 00:00 2024-09-05T07:22:33.246 INFO:teuthology.orchestra.run.smithi017.stdout:(105/176): python3-oauthlib-3.1.1-5.el9.noarch. 3.7 MB/s | 222 kB 00:00 2024-09-05T07:22:33.288 INFO:teuthology.orchestra.run.smithi017.stdout:(106/176): python3-packaging-20.9-5.el9.noarch. 1.8 MB/s | 77 kB 00:00 2024-09-05T07:22:33.330 INFO:teuthology.orchestra.run.smithi017.stdout:(107/176): python3-prettytable-0.7.2-27.el9.noa 1.0 MB/s | 42 kB 00:00 2024-09-05T07:22:33.372 INFO:teuthology.orchestra.run.smithi017.stdout:(108/176): python3-protobuf-3.14.0-13.el9.noarc 6.3 MB/s | 269 kB 00:00 2024-09-05T07:22:33.406 INFO:teuthology.orchestra.run.smithi017.stdout:(109/176): python3-pyasn1-0.4.8-6.el9.noarch.rp 4.7 MB/s | 159 kB 00:00 2024-09-05T07:22:33.448 INFO:teuthology.orchestra.run.smithi017.stdout:(110/176): python3-pyasn1-modules-0.4.8-6.el9.n 6.5 MB/s | 279 kB 00:00 2024-09-05T07:22:33.490 INFO:teuthology.orchestra.run.smithi017.stdout:(111/176): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-05T07:22:33.532 INFO:teuthology.orchestra.run.smithi017.stdout:(112/176): python3-requests-oauthlib-1.3.0-12.e 1.3 MB/s | 54 kB 00:00 2024-09-05T07:22:33.607 INFO:teuthology.orchestra.run.smithi017.stdout:(113/176): python3-babel-2.9.1-2.el9.noarch.rpm 2.4 MB/s | 6.0 MB 00:02 2024-09-05T07:22:33.649 INFO:teuthology.orchestra.run.smithi017.stdout:(114/176): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-05T07:22:33.699 INFO:teuthology.orchestra.run.smithi017.stdout:(115/176): python3-wcwidth-0.2.5-8.el9.noarch.r 884 kB/s | 44 kB 00:00 2024-09-05T07:22:33.950 INFO:teuthology.orchestra.run.smithi017.stdout:(116/176): python3-scipy-1.6.2-8.el9.x86_64.rpm 39 MB/s | 16 MB 00:00 2024-09-05T07:22:33.975 INFO:teuthology.orchestra.run.smithi017.stdout:(117/176): qatlib-24.02.0-1.el9.x86_64.rpm 802 kB/s | 221 kB 00:00 2024-09-05T07:22:34.000 INFO:teuthology.orchestra.run.smithi017.stdout:(118/176): qatlib-service-24.02.0-1.el9.x86_64. 715 kB/s | 36 kB 00:00 2024-09-05T07:22:34.026 INFO:teuthology.orchestra.run.smithi017.stdout:(119/176): qatzip-libs-1.2.0-1.el9.x86_64.rpm 939 kB/s | 47 kB 00:00 2024-09-05T07:22:34.051 INFO:teuthology.orchestra.run.smithi017.stdout:(120/176): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-05T07:22:34.076 INFO:teuthology.orchestra.run.smithi017.stdout:(121/176): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-05T07:22:34.101 INFO:teuthology.orchestra.run.smithi017.stdout:(122/176): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-05T07:22:34.144 INFO:teuthology.orchestra.run.smithi017.stdout:(123/176): xmlstarlet-1.6.1-20.el9.x86_64.rpm 953 kB/s | 64 kB 00:00 2024-09-05T07:22:34.169 INFO:teuthology.orchestra.run.smithi017.stdout:(124/176): zlib-devel-1.2.11-41.el9.x86_64.rpm 669 kB/s | 45 kB 00:00 2024-09-05T07:22:34.252 INFO:teuthology.orchestra.run.smithi017.stdout:(125/176): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-09-05T07:22:34.299 INFO:teuthology.orchestra.run.smithi026.stdout:(32/176): librbd1-debuginfo-19.1.1-259.g91c8a7e 16 MB/s | 52 MB 00:03 2024-09-05T07:22:34.303 INFO:teuthology.orchestra.run.smithi017.stdout:(126/176): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-05T07:22:34.336 INFO:teuthology.orchestra.run.smithi017.stdout:(127/176): gperftools-libs-2.9.1-2.el9.x86_64.r 9.2 MB/s | 309 kB 00:00 2024-09-05T07:22:34.362 INFO:teuthology.orchestra.run.smithi017.stdout:(128/176): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-09-05T07:22:34.395 INFO:teuthology.orchestra.run.smithi017.stdout:(129/176): protobuf-compiler-3.14.0-13.el9.x86_ 3.7 MB/s | 863 kB 00:00 2024-09-05T07:22:34.437 INFO:teuthology.orchestra.run.smithi017.stdout:(130/176): libarrow-doc-9.0.0-11.el9.noarch.rpm 624 kB/s | 26 kB 00:00 2024-09-05T07:22:34.463 INFO:teuthology.orchestra.run.smithi017.stdout:(131/176): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-05T07:22:34.605 INFO:teuthology.orchestra.run.smithi017.stdout:(132/176): libunwind-1.6.2-1.el9.x86_64.rpm 475 kB/s | 67 kB 00:00 2024-09-05T07:22:34.655 INFO:teuthology.orchestra.run.smithi017.stdout:(133/176): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-05T07:22:34.699 INFO:teuthology.orchestra.run.smithi026.stdout:(33/176): librgw2-19.1.1-259.g91c8a7e5.el9.x86_ 13 MB/s | 5.3 MB 00:00 2024-09-05T07:22:34.713 INFO:teuthology.orchestra.run.smithi017.stdout:(134/176): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-05T07:22:34.756 INFO:teuthology.orchestra.run.smithi017.stdout:(135/176): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-05T07:22:34.758 INFO:teuthology.orchestra.run.smithi026.stdout:(34/176): python3-ceph-argparse-19.1.1-259.g91c 775 kB/s | 45 kB 00:00 2024-09-05T07:22:34.772 INFO:teuthology.orchestra.run.smithi017.stdout:(136/176): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-05T07:22:34.789 INFO:teuthology.orchestra.run.smithi017.stdout:(137/176): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-05T07:22:34.806 INFO:teuthology.orchestra.run.smithi017.stdout:(138/176): python3-certifi-2023.05.07-4.el9.noa 842 kB/s | 14 kB 00:00 2024-09-05T07:22:34.824 INFO:teuthology.orchestra.run.smithi026.stdout:(35/176): python3-ceph-common-19.1.1-259.g91c8a 2.0 MB/s | 136 kB 00:00 2024-09-05T07:22:34.840 INFO:teuthology.orchestra.run.smithi017.stdout:(139/176): python3-cheroot-8.6.0-4.el9.noarch.r 5.1 MB/s | 172 kB 00:00 2024-09-05T07:22:34.874 INFO:teuthology.orchestra.run.smithi017.stdout:(140/176): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2024-09-05T07:22:34.891 INFO:teuthology.orchestra.run.smithi026.stdout:(36/176): python3-cephfs-19.1.1-259.g91c8a7e5.e 2.4 MB/s | 162 kB 00:00 2024-09-05T07:22:34.941 INFO:teuthology.orchestra.run.smithi017.stdout:(141/176): libarrow-9.0.0-11.el9.x86_64.rpm 7.6 MB/s | 4.4 MB 00:00 2024-09-05T07:22:34.959 INFO:teuthology.orchestra.run.smithi026.stdout:(37/176): python3-cephfs-debuginfo-19.1.1-259.g 9.0 MB/s | 615 kB 00:00 2024-09-05T07:22:34.974 INFO:teuthology.orchestra.run.smithi017.stdout:(142/176): python3-google-auth-2.34.0-1.el9.noa 6.5 MB/s | 220 kB 00:00 2024-09-05T07:22:34.999 INFO:teuthology.orchestra.run.smithi017.stdout:(143/176): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.4 MB/s | 303 kB 00:00 2024-09-05T07:22:35.017 INFO:teuthology.orchestra.run.smithi026.stdout:(38/176): python3-rados-19.1.1-259.g91c8a7e5.el 5.4 MB/s | 321 kB 00:00 2024-09-05T07:22:35.033 INFO:teuthology.orchestra.run.smithi017.stdout:(144/176): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-05T07:22:35.059 INFO:teuthology.orchestra.run.smithi017.stdout:(145/176): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-05T07:22:35.084 INFO:teuthology.orchestra.run.smithi017.stdout:(146/176): python3-jaraco-classes-3.2.1-5.el9.n 715 kB/s | 18 kB 00:00 2024-09-05T07:22:35.092 INFO:teuthology.orchestra.run.smithi026.stdout:(39/176): python3-rados-debuginfo-19.1.1-259.g9 10 MB/s | 768 kB 00:00 2024-09-05T07:22:35.109 INFO:teuthology.orchestra.run.smithi017.stdout:(147/176): python3-jaraco-collections-3.0.0-8.e 930 kB/s | 23 kB 00:00 2024-09-05T07:22:35.134 INFO:teuthology.orchestra.run.smithi017.stdout:(148/176): python3-jaraco-functools-3.5.0-2.el9 778 kB/s | 19 kB 00:00 2024-09-05T07:22:35.151 INFO:teuthology.orchestra.run.smithi026.stdout:(40/176): python3-rbd-19.1.1-259.g91c8a7e5.el9. 5.0 MB/s | 301 kB 00:00 2024-09-05T07:22:35.160 INFO:teuthology.orchestra.run.smithi017.stdout:(149/176): python3-jaraco-text-3.2.0-6.el9.noar 795 kB/s | 20 kB 00:00 2024-09-05T07:22:35.210 INFO:teuthology.orchestra.run.smithi017.stdout:(150/176): python3-kubernetes-26.1.0-2.el9.noar 20 MB/s | 1.0 MB 00:00 2024-09-05T07:22:35.235 INFO:teuthology.orchestra.run.smithi017.stdout:(151/176): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-05T07:22:35.260 INFO:teuthology.orchestra.run.smithi017.stdout:(152/176): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-05T07:22:35.285 INFO:teuthology.orchestra.run.smithi026.stdout:(41/176): python3-rbd-debuginfo-19.1.1-259.g91c 8.5 MB/s | 1.1 MB 00:00 2024-09-05T07:22:35.286 INFO:teuthology.orchestra.run.smithi017.stdout:(153/176): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-05T07:22:35.328 INFO:teuthology.orchestra.run.smithi017.stdout:(154/176): python3-grpcio-1.46.7-10.el9.x86_64. 5.8 MB/s | 2.0 MB 00:00 2024-09-05T07:22:35.343 INFO:teuthology.orchestra.run.smithi026.stdout:(42/176): python3-rgw-19.1.1-259.g91c8a7e5.el9. 1.7 MB/s | 99 kB 00:00 2024-09-05T07:22:35.353 INFO:teuthology.orchestra.run.smithi017.stdout:(155/176): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-05T07:22:35.378 INFO:teuthology.orchestra.run.smithi017.stdout:(156/176): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-05T07:22:35.403 INFO:teuthology.orchestra.run.smithi017.stdout:(157/176): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-05T07:22:35.410 INFO:teuthology.orchestra.run.smithi026.stdout:(43/176): python3-rgw-debuginfo-19.1.1-259.g91c 4.9 MB/s | 337 kB 00:00 2024-09-05T07:22:35.429 INFO:teuthology.orchestra.run.smithi017.stdout:(158/176): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-09-05T07:22:35.455 INFO:teuthology.orchestra.run.smithi017.stdout:(159/176): python3-repoze-lru-0.7-16.el9.noarch 609 kB/s | 31 kB 00:00 2024-09-05T07:22:35.469 INFO:teuthology.orchestra.run.smithi026.stdout:(44/176): rbd-fuse-19.1.1-259.g91c8a7e5.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-05T07:22:35.480 INFO:teuthology.orchestra.run.smithi017.stdout:(160/176): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-05T07:22:35.505 INFO:teuthology.orchestra.run.smithi017.stdout:(161/176): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-05T07:22:35.530 INFO:teuthology.orchestra.run.smithi017.stdout:(162/176): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-05T07:22:35.544 INFO:teuthology.orchestra.run.smithi026.stdout:(45/176): rbd-fuse-debuginfo-19.1.1-259.g91c8a7 6.7 MB/s | 517 kB 00:00 2024-09-05T07:22:35.556 INFO:teuthology.orchestra.run.smithi017.stdout:(163/176): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-05T07:22:35.581 INFO:teuthology.orchestra.run.smithi017.stdout:(164/176): python3-websocket-client-1.2.3-2.el9 3.6 MB/s | 90 kB 00:00 2024-09-05T07:22:35.608 INFO:teuthology.orchestra.run.smithi017.stdout:(165/176): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-05T07:22:35.640 INFO:teuthology.orchestra.run.smithi017.stdout:(166/176): python3-zc-lockfile-2.0-10.el9.noarc 600 kB/s | 20 kB 00:00 2024-09-05T07:22:35.665 INFO:teuthology.orchestra.run.smithi017.stdout:(167/176): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-05T07:22:35.690 INFO:teuthology.orchestra.run.smithi017.stdout:(168/176): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-09-05T07:22:35.749 INFO:teuthology.orchestra.run.smithi017.stdout:(169/176): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-05T07:22:35.753 INFO:teuthology.orchestra.run.smithi026.stdout:(46/176): rbd-mirror-19.1.1-259.g91c8a7e5.el9.x 15 MB/s | 3.1 MB 00:00 2024-09-05T07:22:38.108 INFO:teuthology.orchestra.run.smithi017.stdout:(170/176): ceph-test-debuginfo-19.1.1-259.g91c8 17 MB/s | 697 MB 00:41 2024-09-05T07:22:38.191 INFO:teuthology.orchestra.run.smithi017.stdout:(171/176): librbd1-19.1.1-259.g91c8a7e5.el9.x86 1.3 MB/s | 3.2 MB 00:02 2024-09-05T07:22:38.242 INFO:teuthology.orchestra.run.smithi017.stdout:(172/176): librados2-19.1.1-259.g91c8a7e5.el9.x 1.3 MB/s | 3.4 MB 00:02 2024-09-05T07:22:38.509 INFO:teuthology.orchestra.run.smithi017.stdout:(173/176): NetworkManager-team-1.48.10-1.el9.x8 152 kB/s | 40 kB 00:00 2024-09-05T07:22:38.928 INFO:teuthology.orchestra.run.smithi026.stdout:(47/176): rbd-mirror-debuginfo-19.1.1-259.g91c8 16 MB/s | 52 MB 00:03 2024-09-05T07:22:38.995 INFO:teuthology.orchestra.run.smithi026.stdout:(48/176): rbd-nbd-19.1.1-259.g91c8a7e5.el9.x86_ 2.5 MB/s | 170 kB 00:00 2024-09-05T07:22:39.000 INFO:teuthology.orchestra.run.smithi017.stdout:(174/176): NetworkManager-1.48.10-1.el9.x86_64. 2.6 MB/s | 2.3 MB 00:00 2024-09-05T07:22:39.025 INFO:teuthology.orchestra.run.smithi017.stdout:(175/176): NetworkManager-tui-1.48.10-1.el9.x86 480 kB/s | 248 kB 00:00 2024-09-05T07:22:39.153 INFO:teuthology.orchestra.run.smithi026.stdout:(49/176): rbd-nbd-debuginfo-19.1.1-259.g91c8a7e 8.1 MB/s | 1.3 MB 00:00 2024-09-05T07:22:39.220 INFO:teuthology.orchestra.run.smithi026.stdout:(50/176): ceph-grafana-dashboards-19.1.1-259.g9 479 kB/s | 32 kB 00:00 2024-09-05T07:22:39.284 INFO:teuthology.orchestra.run.smithi017.stdout:(176/176): NetworkManager-libnm-1.48.10-1.el9.x 1.6 MB/s | 1.8 MB 00:01 2024-09-05T07:22:39.287 INFO:teuthology.orchestra.run.smithi026.stdout:(51/176): ceph-mgr-cephadm-19.1.1-259.g91c8a7e5 2.1 MB/s | 146 kB 00:00 2024-09-05T07:22:39.290 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-05T07:22:39.290 INFO:teuthology.orchestra.run.smithi017.stdout:Total 29 MB/s | 2.2 GB 01:19 2024-09-05T07:22:39.529 INFO:teuthology.orchestra.run.smithi026.stdout:(52/176): ceph-mgr-dashboard-19.1.1-259.g91c8a7 15 MB/s | 3.6 MB 00:00 2024-09-05T07:22:39.988 INFO:teuthology.orchestra.run.smithi026.stdout:(53/176): ceph-mgr-diskprediction-local-19.1.1- 16 MB/s | 7.4 MB 00:00 2024-09-05T07:22:40.091 INFO:teuthology.orchestra.run.smithi026.stdout:(54/176): ceph-mgr-modules-core-19.1.1-259.g91c 2.4 MB/s | 249 kB 00:00 2024-09-05T07:22:40.163 INFO:teuthology.orchestra.run.smithi026.stdout:(55/176): ceph-mgr-rook-19.1.1-259.g91c8a7e5.el 692 kB/s | 49 kB 00:00 2024-09-05T07:22:40.230 INFO:teuthology.orchestra.run.smithi026.stdout:(56/176): ceph-prometheus-alerts-19.1.1-259.g91 247 kB/s | 16 kB 00:00 2024-09-05T07:22:40.297 INFO:teuthology.orchestra.run.smithi026.stdout:(57/176): ceph-volume-19.1.1-259.g91c8a7e5.el9. 4.2 MB/s | 285 kB 00:00 2024-09-05T07:22:40.372 INFO:teuthology.orchestra.run.smithi026.stdout:(58/176): cephadm-19.1.1-259.g91c8a7e5.el9.noar 10 MB/s | 765 kB 00:00 2024-09-05T07:22:40.405 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-05T07:22:40.431 INFO:teuthology.orchestra.run.smithi026.stdout:(59/176): cephfs-top-19.1.1-259.g91c8a7e5.el9.n 312 kB/s | 18 kB 00:00 2024-09-05T07:22:40.556 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-05T07:22:40.556 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-05T07:22:40.573 INFO:teuthology.orchestra.run.smithi026.stdout:(60/176): fuse-2.9.9-16.el9.x86_64.rpm 565 kB/s | 80 kB 00:00 2024-09-05T07:22:40.823 INFO:teuthology.orchestra.run.smithi026.stdout:(61/176): libgfortran-11.5.0-2.el9.x86_64.rpm 3.1 MB/s | 801 kB 00:00 2024-09-05T07:22:40.898 INFO:teuthology.orchestra.run.smithi026.stdout:(62/176): libquadmath-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-09-05T07:22:41.007 INFO:teuthology.orchestra.run.smithi026.stdout:(63/176): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-05T07:22:41.340 INFO:teuthology.orchestra.run.smithi026.stdout:(64/176): python3-cryptography-36.0.1-4.el9.x86 3.7 MB/s | 1.2 MB 00:00 2024-09-05T07:22:41.391 INFO:teuthology.orchestra.run.smithi026.stdout:(65/176): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-05T07:22:41.466 INFO:teuthology.orchestra.run.smithi026.stdout:(66/176): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-09-05T07:22:41.516 INFO:teuthology.orchestra.run.smithi026.stdout:(67/176): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-05T07:22:41.600 INFO:teuthology.orchestra.run.smithi026.stdout:(68/176): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-05T07:22:41.800 INFO:teuthology.orchestra.run.smithi026.stdout:(69/176): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 689 kB 00:00 2024-09-05T07:22:42.034 INFO:teuthology.orchestra.run.smithi026.stdout:(70/176): bison-3.7.4-5.el9.x86_64.rpm 3.9 MB/s | 943 kB 00:00 2024-09-05T07:22:43.193 INFO:teuthology.orchestra.run.smithi026.stdout:(71/176): ceph-osd-debuginfo-19.1.1-259.g91c8a7 7.5 MB/s | 290 MB 00:38 2024-09-05T07:22:43.217 INFO:teuthology.orchestra.run.smithi026.stdout:(72/176): boost-program-options-1.75.0-8.el9.x8 90 kB/s | 107 kB 00:01 2024-09-05T07:22:43.268 INFO:teuthology.orchestra.run.smithi026.stdout:(73/176): elfutils-libelf-devel-0.191-4.el9.x86 290 kB/s | 22 kB 00:00 2024-09-05T07:22:43.360 INFO:teuthology.orchestra.run.smithi026.stdout:(74/176): flexiblas-3.0.4-8.el9.x86_64.rpm 357 kB/s | 33 kB 00:00 2024-09-05T07:22:43.394 INFO:teuthology.orchestra.run.smithi026.stdout:(75/176): flex-2.6.4-9.el9.x86_64.rpm 1.7 MB/s | 313 kB 00:00 2024-09-05T07:22:43.444 INFO:teuthology.orchestra.run.smithi026.stdout:(76/176): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-09-05T07:22:43.494 INFO:teuthology.orchestra.run.smithi026.stdout:(77/176): libaio-devel-0.3.111-13.el9.x86_64.rp 224 kB/s | 11 kB 00:00 2024-09-05T07:22:43.578 INFO:teuthology.orchestra.run.smithi026.stdout:(78/176): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-09-05T07:22:43.629 INFO:teuthology.orchestra.run.smithi026.stdout:(79/176): librabbitmq-0.11.0-7.el9.x86_64.rpm 907 kB/s | 45 kB 00:00 2024-09-05T07:22:43.821 INFO:teuthology.orchestra.run.smithi026.stdout:(80/176): librdkafka-1.6.1-102.el9.x86_64.rpm 3.4 MB/s | 662 kB 00:00 2024-09-05T07:22:44.012 INFO:teuthology.orchestra.run.smithi026.stdout:(81/176): libtool-2.4.6-46.el9.x86_64.rpm 3.0 MB/s | 581 kB 00:00 2024-09-05T07:22:44.062 INFO:teuthology.orchestra.run.smithi026.stdout:(82/176): libuuid-devel-2.37.4-20.el9.x86_64.rp 493 kB/s | 24 kB 00:00 2024-09-05T07:22:44.113 INFO:teuthology.orchestra.run.smithi026.stdout:(83/176): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.0 MB/s | 3.0 MB 00:00 2024-09-05T07:22:44.138 INFO:teuthology.orchestra.run.smithi026.stdout:(84/176): libzstd-devel-1.5.1-2.el9.x86_64.rpm 630 kB/s | 47 kB 00:00 2024-09-05T07:22:44.213 INFO:teuthology.orchestra.run.smithi026.stdout:(85/176): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 188 kB 00:00 2024-09-05T07:22:44.239 INFO:teuthology.orchestra.run.smithi026.stdout:(86/176): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-05T07:22:44.264 INFO:teuthology.orchestra.run.smithi026.stdout:(87/176): openblas-0.3.26-2.el9.x86_64.rpm 766 kB/s | 38 kB 00:00 2024-09-05T07:22:44.897 INFO:teuthology.orchestra.run.smithi026.stdout:(88/176): openssl-devel-3.2.2-4.el9.x86_64.rpm 7.0 MB/s | 4.4 MB 00:00 2024-09-05T07:22:45.106 INFO:teuthology.orchestra.run.smithi026.stdout:(89/176): postgresql-13.16-1.el9.x86_64.rpm 7.6 MB/s | 1.6 MB 00:00 2024-09-05T07:22:45.248 INFO:teuthology.orchestra.run.smithi026.stdout:(90/176): postgresql-contrib-13.16-1.el9.x86_64 6.3 MB/s | 910 kB 00:00 2024-09-05T07:22:45.298 INFO:teuthology.orchestra.run.smithi026.stdout:(91/176): postgresql-private-libs-13.16-1.el9.x 2.7 MB/s | 137 kB 00:00 2024-09-05T07:22:45.399 INFO:teuthology.orchestra.run.smithi026.stdout:(92/176): openblas-openmp-0.3.26-2.el9.x86_64.r 4.3 MB/s | 4.9 MB 00:01 2024-09-05T07:22:45.624 INFO:teuthology.orchestra.run.smithi026.stdout:(93/176): protobuf-3.14.0-13.el9.x86_64.rpm 4.5 MB/s | 1.0 MB 00:00 2024-09-05T07:22:45.674 INFO:teuthology.orchestra.run.smithi026.stdout:(94/176): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-09-05T07:22:46.224 INFO:teuthology.orchestra.run.smithi026.stdout:(95/176): postgresql-server-13.16-1.el9.x86_64. 6.2 MB/s | 5.8 MB 00:00 2024-09-05T07:22:46.266 INFO:teuthology.orchestra.run.smithi026.stdout:(96/176): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-05T07:22:46.350 INFO:teuthology.orchestra.run.smithi026.stdout:(97/176): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-05T07:22:46.433 INFO:teuthology.orchestra.run.smithi026.stdout:(98/176): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-09-05T07:22:46.484 INFO:teuthology.orchestra.run.smithi026.stdout:(99/176): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-09-05T07:22:46.551 INFO:teuthology.orchestra.run.smithi026.stdout:(100/176): python3-jsonpointer-2.0-4.el9.noarch 288 kB/s | 19 kB 00:00 2024-09-05T07:22:46.609 INFO:teuthology.orchestra.run.smithi026.stdout:(101/176): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-05T07:22:46.718 INFO:teuthology.orchestra.run.smithi026.stdout:(102/176): python3-babel-2.9.1-2.el9.noarch.rpm 5.7 MB/s | 6.0 MB 00:01 2024-09-05T07:22:46.743 INFO:teuthology.orchestra.run.smithi026.stdout:(103/176): python3-markupsafe-1.1.1-12.el9.x86_ 260 kB/s | 35 kB 00:00 2024-09-05T07:22:46.827 INFO:teuthology.orchestra.run.smithi026.stdout:(104/176): python3-numpy-f2py-1.20.1-5.el9.x86_ 2.9 MB/s | 250 kB 00:00 2024-09-05T07:22:46.910 INFO:teuthology.orchestra.run.smithi026.stdout:(105/176): python3-oauthlib-3.1.1-5.el9.noarch. 2.6 MB/s | 222 kB 00:00 2024-09-05T07:22:46.961 INFO:teuthology.orchestra.run.smithi026.stdout:(106/176): python3-packaging-20.9-5.el9.noarch. 1.5 MB/s | 77 kB 00:00 2024-09-05T07:22:47.011 INFO:teuthology.orchestra.run.smithi026.stdout:(107/176): python3-prettytable-0.7.2-27.el9.noa 846 kB/s | 42 kB 00:00 2024-09-05T07:22:47.094 INFO:teuthology.orchestra.run.smithi026.stdout:(108/176): python3-protobuf-3.14.0-13.el9.noarc 3.2 MB/s | 269 kB 00:00 2024-09-05T07:22:47.153 INFO:teuthology.orchestra.run.smithi026.stdout:(109/176): python3-pyasn1-0.4.8-6.el9.noarch.rp 2.7 MB/s | 159 kB 00:00 2024-09-05T07:22:47.237 INFO:teuthology.orchestra.run.smithi026.stdout:(110/176): python3-pyasn1-modules-0.4.8-6.el9.n 3.3 MB/s | 279 kB 00:00 2024-09-05T07:22:47.287 INFO:teuthology.orchestra.run.smithi026.stdout:(111/176): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-05T07:22:47.337 INFO:teuthology.orchestra.run.smithi026.stdout:(112/176): python3-requests-oauthlib-1.3.0-12.e 1.0 MB/s | 54 kB 00:00 2024-09-05T07:22:47.463 INFO:teuthology.orchestra.run.smithi026.stdout:(113/176): python3-numpy-1.20.1-5.el9.x86_64.rp 6.8 MB/s | 5.1 MB 00:00 2024-09-05T07:22:47.513 INFO:teuthology.orchestra.run.smithi026.stdout:(114/176): python3-toml-0.10.2-6.el9.noarch.rpm 834 kB/s | 42 kB 00:00 2024-09-05T07:22:47.563 INFO:teuthology.orchestra.run.smithi026.stdout:(115/176): python3-wcwidth-0.2.5-8.el9.noarch.r 888 kB/s | 44 kB 00:00 2024-09-05T07:22:47.622 INFO:teuthology.orchestra.run.smithi026.stdout:(116/176): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-05T07:22:47.672 INFO:teuthology.orchestra.run.smithi026.stdout:(117/176): qatlib-service-24.02.0-1.el9.x86_64. 720 kB/s | 36 kB 00:00 2024-09-05T07:22:47.722 INFO:teuthology.orchestra.run.smithi026.stdout:(118/176): qatzip-libs-1.2.0-1.el9.x86_64.rpm 953 kB/s | 47 kB 00:00 2024-09-05T07:22:47.806 INFO:teuthology.orchestra.run.smithi026.stdout:(119/176): socat-1.7.4.1-6.el9.x86_64.rpm 3.6 MB/s | 304 kB 00:00 2024-09-05T07:22:47.856 INFO:teuthology.orchestra.run.smithi026.stdout:(120/176): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-05T07:22:47.906 INFO:teuthology.orchestra.run.smithi026.stdout:(121/176): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-05T07:22:47.957 INFO:teuthology.orchestra.run.smithi026.stdout:(122/176): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-05T07:22:48.007 INFO:teuthology.orchestra.run.smithi026.stdout:(123/176): zlib-devel-1.2.11-41.el9.x86_64.rpm 897 kB/s | 45 kB 00:00 2024-09-05T07:22:48.074 INFO:teuthology.orchestra.run.smithi026.stdout:(124/176): lua-devel-5.4.4-4.el9.x86_64.rpm 335 kB/s | 22 kB 00:00 2024-09-05T07:22:48.199 INFO:teuthology.orchestra.run.smithi026.stdout:(125/176): protobuf-compiler-3.14.0-13.el9.x86_ 6.8 MB/s | 863 kB 00:00 2024-09-05T07:22:48.258 INFO:teuthology.orchestra.run.smithi026.stdout:(126/176): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-05T07:22:48.291 INFO:teuthology.orchestra.run.smithi026.stdout:(127/176): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-05T07:22:48.317 INFO:teuthology.orchestra.run.smithi026.stdout:(128/176): grpc-data-1.46.7-10.el9.noarch.rpm 769 kB/s | 19 kB 00:00 2024-09-05T07:22:48.417 INFO:teuthology.orchestra.run.smithi026.stdout:(129/176): libarrow-9.0.0-11.el9.x86_64.rpm 44 MB/s | 4.4 MB 00:00 2024-09-05T07:22:48.443 INFO:teuthology.orchestra.run.smithi026.stdout:(130/176): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-05T07:22:48.468 INFO:teuthology.orchestra.run.smithi026.stdout:(131/176): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-05T07:22:48.493 INFO:teuthology.orchestra.run.smithi026.stdout:(132/176): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-05T07:22:48.519 INFO:teuthology.orchestra.run.smithi026.stdout:(133/176): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-05T07:22:48.560 INFO:teuthology.orchestra.run.smithi026.stdout:(134/176): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-05T07:22:48.594 INFO:teuthology.orchestra.run.smithi026.stdout:(135/176): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-05T07:22:48.619 INFO:teuthology.orchestra.run.smithi026.stdout:(136/176): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-05T07:22:48.645 INFO:teuthology.orchestra.run.smithi026.stdout:(137/176): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-05T07:22:48.662 INFO:teuthology.orchestra.run.smithi026.stdout:(138/176): python3-certifi-2023.05.07-4.el9.noa 843 kB/s | 14 kB 00:00 2024-09-05T07:22:48.687 INFO:teuthology.orchestra.run.smithi026.stdout:(139/176): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-05T07:22:48.721 INFO:teuthology.orchestra.run.smithi026.stdout:(140/176): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2024-09-05T07:22:48.754 INFO:teuthology.orchestra.run.smithi026.stdout:(141/176): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-09-05T07:22:48.780 INFO:teuthology.orchestra.run.smithi026.stdout:(142/176): python3-google-auth-2.34.0-1.el9.noa 8.6 MB/s | 220 kB 00:00 2024-09-05T07:22:48.847 INFO:teuthology.orchestra.run.smithi026.stdout:(143/176): python3-grpcio-1.46.7-10.el9.x86_64. 31 MB/s | 2.0 MB 00:00 2024-09-05T07:22:48.872 INFO:teuthology.orchestra.run.smithi026.stdout:(144/176): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-05T07:22:48.897 INFO:teuthology.orchestra.run.smithi026.stdout:(145/176): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-05T07:22:48.922 INFO:teuthology.orchestra.run.smithi026.stdout:(146/176): python3-jaraco-classes-3.2.1-5.el9.n 705 kB/s | 18 kB 00:00 2024-09-05T07:22:48.948 INFO:teuthology.orchestra.run.smithi026.stdout:(147/176): python3-jaraco-collections-3.0.0-8.e 922 kB/s | 23 kB 00:00 2024-09-05T07:22:48.973 INFO:teuthology.orchestra.run.smithi026.stdout:(148/176): python3-jaraco-functools-3.5.0-2.el9 782 kB/s | 19 kB 00:00 2024-09-05T07:22:48.998 INFO:teuthology.orchestra.run.smithi026.stdout:(149/176): python3-jaraco-text-3.2.0-6.el9.noar 786 kB/s | 20 kB 00:00 2024-09-05T07:22:49.040 INFO:teuthology.orchestra.run.smithi026.stdout:(150/176): python3-kubernetes-26.1.0-2.el9.noar 24 MB/s | 1.0 MB 00:00 2024-09-05T07:22:49.066 INFO:teuthology.orchestra.run.smithi026.stdout:(151/176): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-05T07:22:49.091 INFO:teuthology.orchestra.run.smithi026.stdout:(152/176): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-05T07:22:49.116 INFO:teuthology.orchestra.run.smithi026.stdout:(153/176): python3-natsort-7.1.1-5.el9.noarch.r 2.2 MB/s | 58 kB 00:00 2024-09-05T07:22:49.150 INFO:teuthology.orchestra.run.smithi026.stdout:(154/176): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-05T07:22:49.175 INFO:teuthology.orchestra.run.smithi026.stdout:(155/176): python3-portend-3.1.0-2.el9.noarch.r 661 kB/s | 16 kB 00:00 2024-09-05T07:22:49.209 INFO:teuthology.orchestra.run.smithi026.stdout:(156/176): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.6 MB/s | 90 kB 00:00 2024-09-05T07:22:49.234 INFO:teuthology.orchestra.run.smithi026.stdout:(157/176): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-05T07:22:49.259 INFO:teuthology.orchestra.run.smithi026.stdout:(158/176): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-05T07:22:49.285 INFO:teuthology.orchestra.run.smithi026.stdout:(159/176): python3-routes-2.5.1-5.el9.noarch.rp 7.4 MB/s | 188 kB 00:00 2024-09-05T07:22:49.310 INFO:teuthology.orchestra.run.smithi026.stdout:(160/176): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-05T07:22:49.335 INFO:teuthology.orchestra.run.smithi026.stdout:(161/176): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-05T07:22:49.361 INFO:teuthology.orchestra.run.smithi026.stdout:(162/176): python3-typing-extensions-4.12.2-2.e 2.9 MB/s | 74 kB 00:00 2024-09-05T07:22:49.386 INFO:teuthology.orchestra.run.smithi026.stdout:(163/176): python3-webob-1.8.8-2.el9.noarch.rpm 9.1 MB/s | 230 kB 00:00 2024-09-05T07:22:49.411 INFO:teuthology.orchestra.run.smithi026.stdout:(164/176): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-05T07:22:49.445 INFO:teuthology.orchestra.run.smithi026.stdout:(165/176): python3-werkzeug-2.0.3-3.el9.1.noarc 13 MB/s | 427 kB 00:00 2024-09-05T07:22:49.470 INFO:teuthology.orchestra.run.smithi026.stdout:(166/176): python3-zc-lockfile-2.0-10.el9.noarc 796 kB/s | 20 kB 00:00 2024-09-05T07:22:49.495 INFO:teuthology.orchestra.run.smithi026.stdout:(167/176): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-05T07:22:49.554 INFO:teuthology.orchestra.run.smithi026.stdout:(168/176): thrift-0.15.0-2.el9.x86_64.rpm 27 MB/s | 1.6 MB 00:00 2024-09-05T07:22:49.804 INFO:teuthology.orchestra.run.smithi026.stdout:(169/176): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.6 MB/s | 16 MB 00:02 2024-09-05T07:22:50.046 INFO:teuthology.orchestra.run.smithi026.stdout:(170/176): librados2-19.1.1-259.g91c8a7e5.el9.x 7.0 MB/s | 3.4 MB 00:00 2024-09-05T07:22:50.355 INFO:teuthology.orchestra.run.smithi026.stdout:(171/176): librbd1-19.1.1-259.g91c8a7e5.el9.x86 5.7 MB/s | 3.2 MB 00:00 2024-09-05T07:22:50.514 INFO:teuthology.orchestra.run.smithi026.stdout:(172/176): NetworkManager-1.48.10-1.el9.x86_64. 5.0 MB/s | 2.3 MB 00:00 2024-09-05T07:22:50.564 INFO:teuthology.orchestra.run.smithi026.stdout:(173/176): NetworkManager-team-1.48.10-1.el9.x8 814 kB/s | 40 kB 00:00 2024-09-05T07:22:50.639 INFO:teuthology.orchestra.run.smithi026.stdout:(174/176): NetworkManager-tui-1.48.10-1.el9.x86 3.2 MB/s | 248 kB 00:00 2024-09-05T07:22:50.839 INFO:teuthology.orchestra.run.smithi026.stdout:(175/176): NetworkManager-libnm-1.48.10-1.el9.x 3.7 MB/s | 1.8 MB 00:00 2024-09-05T07:22:55.052 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-05T07:22:55.053 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-05T07:22:57.647 INFO:teuthology.orchestra.run.smithi026.stdout:(176/176): ceph-test-debuginfo-19.1.1-259.g91c8 22 MB/s | 697 MB 00:31 2024-09-05T07:22:57.653 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-09-05T07:22:57.653 INFO:teuthology.orchestra.run.smithi026.stdout:Total 24 MB/s | 2.2 GB 01:36 2024-09-05T07:22:58.795 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-09-05T07:22:58.949 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-09-05T07:22:58.949 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-09-05T07:23:13.454 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-09-05T07:23:13.454 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-09-05T07:23:17.170 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-05T07:23:17.243 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 1/182 2024-09-05T07:23:17.285 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/182 2024-09-05T07:23:17.310 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 3/182 2024-09-05T07:23:17.362 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 4/182 2024-09-05T07:23:17.709 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 5/182 2024-09-05T07:23:17.802 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librados2-2:19.1.1-259.g91c8a7e5.el9.x86_64 6/182 2024-09-05T07:23:17.928 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-2:19.1.1-259.g91c8a7e5.el9.x86_64 6/182 2024-09-05T07:23:17.962 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs2-2:19.1.1-259.g91c8a7e5.el9.x86_64 7/182 2024-09-05T07:23:18.079 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephfs2-2:19.1.1-259.g91c8a7e5.el9.x86_64 7/182 2024-09-05T07:23:18.121 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rados-2:19.1.1-259.g91c8a7e5.el9.x86_64 8/182 2024-09-05T07:23:18.150 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/182 2024-09-05T07:23:18.175 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 10/182 2024-09-05T07:23:18.337 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/182 2024-09-05T07:23:18.398 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/182 2024-09-05T07:23:18.425 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephsqlite-2:19.1.1-259.g91c8a7e5.el9.x86_64 13/182 2024-09-05T07:23:18.531 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephsqlite-2:19.1.1-259.g91c8a7e5.el9.x86_64 13/182 2024-09-05T07:23:18.560 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libradosstriper1-2:19.1.1-259.g91c8a7e5.el9.x86_ 14/182 2024-09-05T07:23:18.622 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libradosstriper1-2:19.1.1-259.g91c8a7e5.el9.x86_ 14/182 2024-09-05T07:23:18.644 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/182 2024-09-05T07:23:18.669 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/182 2024-09-05T07:23:18.855 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/182 2024-09-05T07:23:19.015 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/182 2024-09-05T07:23:19.125 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : NetworkManager-libnm-1:1.48.10-1.el9.x86_64 17/182 2024-09-05T07:23:19.185 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.10-1.el9.x86_64 17/182 2024-09-05T07:23:19.290 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-1:1.48.10-1.el9.x86_64 18/182 2024-09-05T07:23:19.353 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : NetworkManager-1:1.48.10-1.el9.x86_64 18/182 2024-09-05T07:23:19.577 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-1:1.48.10-1.el9.x86_64 18/182 2024-09-05T07:23:19.686 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/182 2024-09-05T07:23:19.784 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/182 2024-09-05T07:23:19.825 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/182 2024-09-05T07:23:19.861 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/182 2024-09-05T07:23:19.936 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/182 2024-09-05T07:23:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/182 2024-09-05T07:23:20.027 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/182 2024-09-05T07:23:20.073 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/182 2024-09-05T07:23:20.106 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/182 2024-09-05T07:23:20.134 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/182 2024-09-05T07:23:20.206 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/182 2024-09-05T07:23:20.266 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/182 2024-09-05T07:23:20.295 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/182 2024-09-05T07:23:20.330 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/182 2024-09-05T07:23:20.410 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/182 2024-09-05T07:23:20.441 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-common-2:19.1.1-259.g91c8a7e5.el9.x 34/182 2024-09-05T07:23:20.485 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-argparse-2:19.1.1-259.g91c8a7e5.el9 35/182 2024-09-05T07:23:20.513 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cephfs-2:19.1.1-259.g91c8a7e5.el9.x86_64 36/182 2024-09-05T07:23:20.588 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/182 2024-09-05T07:23:20.637 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/182 2024-09-05T07:23:20.715 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/182 2024-09-05T07:23:20.862 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/182 2024-09-05T07:23:20.916 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/182 2024-09-05T07:23:21.483 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/182 2024-09-05T07:23:21.571 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/182 2024-09-05T07:23:21.605 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/182 2024-09-05T07:23:21.649 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/182 2024-09-05T07:23:21.687 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librados-devel-2:19.1.1-259.g91c8a7e5.el9.x86_64 46/182 2024-09-05T07:23:21.720 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/182 2024-09-05T07:23:21.776 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/182 2024-09-05T07:23:21.859 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 49/182 2024-09-05T07:23:21.896 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 50/182 2024-09-05T07:23:21.932 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 51/182 2024-09-05T07:23:21.980 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 52/182 2024-09-05T07:23:22.017 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 53/182 2024-09-05T07:23:22.061 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 54/182 2024-09-05T07:23:22.103 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 55/182 2024-09-05T07:23:22.259 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 56/182 2024-09-05T07:23:22.304 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 57/182 2024-09-05T07:23:22.346 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 58/182 2024-09-05T07:23:22.456 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/182 2024-09-05T07:23:22.714 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 60/182 2024-09-05T07:23:22.972 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/182 2024-09-05T07:23:23.237 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/182 2024-09-05T07:23:23.261 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/182 2024-09-05T07:23:23.352 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/182 2024-09-05T07:23:23.490 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/182 2024-09-05T07:23:23.526 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/182 2024-09-05T07:23:23.555 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/182 2024-09-05T07:23:23.589 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/182 2024-09-05T07:23:23.634 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/182 2024-09-05T07:23:23.672 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 70/182 2024-09-05T07:23:23.711 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 71/182 2024-09-05T07:23:23.740 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 72/182 2024-09-05T07:23:23.775 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 73/182 2024-09-05T07:23:23.810 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 74/182 2024-09-05T07:23:23.861 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 75/182 2024-09-05T07:23:23.896 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 76/182 2024-09-05T07:23:23.997 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 77/182 2024-09-05T07:23:24.059 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 78/182 2024-09-05T07:23:24.090 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 79/182 2024-09-05T07:23:24.199 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 80/182 2024-09-05T07:23:24.259 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/182 2024-09-05T07:23:25.044 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/182 2024-09-05T07:23:25.088 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/182 2024-09-05T07:23:25.122 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/182 2024-09-05T07:23:25.228 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/182 2024-09-05T07:23:25.277 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 86/182 2024-09-05T07:23:25.323 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 87/182 2024-09-05T07:23:25.416 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 88/182 2024-09-05T07:23:25.449 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 89/182 2024-09-05T07:23:25.639 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-0.3.26-2.el9.x86_64 90/182 2024-09-05T07:23:25.671 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 91/182 2024-09-05T07:23:25.751 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 92/182 2024-09-05T07:23:26.452 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 93/182 2024-09-05T07:23:26.584 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 94/182 2024-09-05T07:23:27.916 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 95/182 2024-09-05T07:23:27.993 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 96/182 2024-09-05T07:23:28.012 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 97/182 2024-09-05T07:23:28.037 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 98/182 2024-09-05T07:23:28.363 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 99/182 2024-09-05T07:23:28.408 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librbd1-2:19.1.1-259.g91c8a7e5.el9.x86_64 100/182 2024-09-05T07:23:28.500 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-2:19.1.1-259.g91c8a7e5.el9.x86_64 100/182 2024-09-05T07:23:28.529 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 101/182 2024-09-05T07:23:28.566 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 102/182 2024-09-05T07:23:29.073 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 103/182 2024-09-05T07:23:29.102 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librgw2-2:19.1.1-259.g91c8a7e5.el9.x86_64 104/182 2024-09-05T07:23:29.174 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librgw2-2:19.1.1-259.g91c8a7e5.el9.x86_64 104/182 2024-09-05T07:23:29.204 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 105/182 2024-09-05T07:23:31.572 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 106/182 2024-09-05T07:23:31.617 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 106/182 2024-09-05T07:23:32.191 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 106/182 2024-09-05T07:23:32.229 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-base-2:19.1.1-259.g91c8a7e5.el9.x86_64 107/182 2024-09-05T07:23:32.320 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-base-2:19.1.1-259.g91c8a7e5.el9.x86_64 107/182 2024-09-05T07:23:32.321 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-05T07:23:32.321 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-05T07:23:32.321 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:23:32.355 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-selinux-2:19.1.1-259.g91c8a7e5.el9.x86_64 108/182 2024-09-05T07:23:35.429 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-09-05T07:23:35.513 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 1/182 2024-09-05T07:23:35.563 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/182 2024-09-05T07:23:35.588 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 3/182 2024-09-05T07:23:35.640 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 4/182 2024-09-05T07:23:36.038 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 5/182 2024-09-05T07:23:36.214 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : librados2-2:19.1.1-259.g91c8a7e5.el9.x86_64 6/182 2024-09-05T07:23:36.339 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librados2-2:19.1.1-259.g91c8a7e5.el9.x86_64 6/182 2024-09-05T07:23:36.364 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephfs2-2:19.1.1-259.g91c8a7e5.el9.x86_64 7/182 2024-09-05T07:23:36.440 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libcephfs2-2:19.1.1-259.g91c8a7e5.el9.x86_64 7/182 2024-09-05T07:23:36.482 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rados-2:19.1.1-259.g91c8a7e5.el9.x86_64 8/182 2024-09-05T07:23:36.510 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/182 2024-09-05T07:23:36.536 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 10/182 2024-09-05T07:23:36.698 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/182 2024-09-05T07:23:36.867 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/182 2024-09-05T07:23:36.895 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephsqlite-2:19.1.1-259.g91c8a7e5.el9.x86_64 13/182 2024-09-05T07:23:37.000 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libcephsqlite-2:19.1.1-259.g91c8a7e5.el9.x86_64 13/182 2024-09-05T07:23:37.029 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libradosstriper1-2:19.1.1-259.g91c8a7e5.el9.x86_ 14/182 2024-09-05T07:23:37.108 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libradosstriper1-2:19.1.1-259.g91c8a7e5.el9.x86_ 14/182 2024-09-05T07:23:37.130 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/182 2024-09-05T07:23:37.151 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/182 2024-09-05T07:23:37.314 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/182 2024-09-05T07:23:37.459 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/182 2024-09-05T07:23:37.577 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : NetworkManager-libnm-1:1.48.10-1.el9.x86_64 17/182 2024-09-05T07:23:37.638 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.10-1.el9.x86_64 17/182 2024-09-05T07:23:37.740 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: NetworkManager-1:1.48.10-1.el9.x86_64 18/182 2024-09-05T07:23:37.813 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : NetworkManager-1:1.48.10-1.el9.x86_64 18/182 2024-09-05T07:23:38.034 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: NetworkManager-1:1.48.10-1.el9.x86_64 18/182 2024-09-05T07:23:38.171 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/182 2024-09-05T07:23:38.269 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/182 2024-09-05T07:23:38.310 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/182 2024-09-05T07:23:38.345 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/182 2024-09-05T07:23:38.422 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/182 2024-09-05T07:23:38.481 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/182 2024-09-05T07:23:38.520 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/182 2024-09-05T07:23:38.563 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/182 2024-09-05T07:23:38.596 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/182 2024-09-05T07:23:38.624 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/182 2024-09-05T07:23:38.688 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/182 2024-09-05T07:23:38.868 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/182 2024-09-05T07:23:38.896 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/182 2024-09-05T07:23:38.924 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/182 2024-09-05T07:23:39.003 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/182 2024-09-05T07:23:39.043 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-ceph-common-2:19.1.1-259.g91c8a7e5.el9.x 34/182 2024-09-05T07:23:39.087 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-ceph-argparse-2:19.1.1-259.g91c8a7e5.el9 35/182 2024-09-05T07:23:39.115 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cephfs-2:19.1.1-259.g91c8a7e5.el9.x86_64 36/182 2024-09-05T07:23:39.189 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/182 2024-09-05T07:23:39.238 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/182 2024-09-05T07:23:39.318 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/182 2024-09-05T07:23:39.589 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/182 2024-09-05T07:23:39.651 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/182 2024-09-05T07:23:40.218 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/182 2024-09-05T07:23:40.306 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/182 2024-09-05T07:23:40.348 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/182 2024-09-05T07:23:40.391 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/182 2024-09-05T07:23:40.438 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librados-devel-2:19.1.1-259.g91c8a7e5.el9.x86_64 46/182 2024-09-05T07:23:40.471 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/182 2024-09-05T07:23:40.527 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/182 2024-09-05T07:23:40.602 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 49/182 2024-09-05T07:23:40.639 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 50/182 2024-09-05T07:23:40.675 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 51/182 2024-09-05T07:23:40.723 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 52/182 2024-09-05T07:23:40.757 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 53/182 2024-09-05T07:23:40.801 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 54/182 2024-09-05T07:23:40.843 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 55/182 2024-09-05T07:23:40.988 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 56/182 2024-09-05T07:23:41.036 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 57/182 2024-09-05T07:23:41.087 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 58/182 2024-09-05T07:23:41.195 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/182 2024-09-05T07:23:41.228 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 60/182 2024-09-05T07:23:41.285 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/182 2024-09-05T07:23:41.301 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/182 2024-09-05T07:23:41.326 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/182 2024-09-05T07:23:41.405 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/182 2024-09-05T07:23:41.543 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/182 2024-09-05T07:23:41.575 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/182 2024-09-05T07:23:41.603 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/182 2024-09-05T07:23:41.637 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/182 2024-09-05T07:23:41.682 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/182 2024-09-05T07:23:41.719 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 70/182 2024-09-05T07:23:41.759 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 71/182 2024-09-05T07:23:41.788 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 72/182 2024-09-05T07:23:41.823 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 73/182 2024-09-05T07:23:41.857 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 74/182 2024-09-05T07:23:41.899 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 75/182 2024-09-05T07:23:41.933 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 76/182 2024-09-05T07:23:42.025 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 77/182 2024-09-05T07:23:42.072 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 78/182 2024-09-05T07:23:42.104 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 79/182 2024-09-05T07:23:42.212 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 80/182 2024-09-05T07:23:42.264 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/182 2024-09-05T07:23:43.043 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/182 2024-09-05T07:23:43.092 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/182 2024-09-05T07:23:43.117 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/182 2024-09-05T07:23:43.224 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/182 2024-09-05T07:23:43.274 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 86/182 2024-09-05T07:23:43.319 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 87/182 2024-09-05T07:23:43.412 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 88/182 2024-09-05T07:23:43.445 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 89/182 2024-09-05T07:23:43.627 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openblas-0.3.26-2.el9.x86_64 90/182 2024-09-05T07:23:43.651 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 91/182 2024-09-05T07:23:43.722 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 92/182 2024-09-05T07:23:44.422 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 93/182 2024-09-05T07:23:44.556 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 94/182 2024-09-05T07:23:44.818 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-selinux-2:19.1.1-259.g91c8a7e5.el9.x86_64 108/182 2024-09-05T07:23:44.818 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /sys 2024-09-05T07:23:44.818 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /proc 2024-09-05T07:23:44.818 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /mnt 2024-09-05T07:23:44.818 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /var/tmp 2024-09-05T07:23:44.818 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /home 2024-09-05T07:23:44.818 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /root 2024-09-05T07:23:44.818 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /tmp 2024-09-05T07:23:44.818 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:23:44.994 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-volume-2:19.1.1-259.g91c8a7e5.el9.noarch 109/182 2024-09-05T07:23:45.009 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-volume-2:19.1.1-259.g91c8a7e5.el9.noarch 109/182 2024-09-05T07:23:45.009 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:23:45.009 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-05T07:23:45.009 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:23:45.877 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 95/182 2024-09-05T07:23:45.954 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 96/182 2024-09-05T07:23:45.983 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 97/182 2024-09-05T07:23:46.016 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 98/182 2024-09-05T07:23:46.342 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 99/182 2024-09-05T07:23:46.386 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : librbd1-2:19.1.1-259.g91c8a7e5.el9.x86_64 100/182 2024-09-05T07:23:46.478 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librbd1-2:19.1.1-259.g91c8a7e5.el9.x86_64 100/182 2024-09-05T07:23:46.508 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 101/182 2024-09-05T07:23:46.544 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 102/182 2024-09-05T07:23:46.547 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-osd-2:19.1.1-259.g91c8a7e5.el9.x86_64 110/182 2024-09-05T07:23:46.573 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-osd-2:19.1.1-259.g91c8a7e5.el9.x86_64 110/182 2024-09-05T07:23:46.573 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:23:46.573 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-05T07:23:46.574 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-05T07:23:46.574 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-05T07:23:46.574 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:23:46.814 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mds-2:19.1.1-259.g91c8a7e5.el9.x86_64 111/182 2024-09-05T07:23:46.837 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mds-2:19.1.1-259.g91c8a7e5.el9.x86_64 111/182 2024-09-05T07:23:46.837 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:23:46.837 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-05T07:23:46.837 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-05T07:23:46.837 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-05T07:23:46.837 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:23:47.052 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 103/182 2024-09-05T07:23:47.081 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librgw2-2:19.1.1-259.g91c8a7e5.el9.x86_64 104/182 2024-09-05T07:23:47.144 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librgw2-2:19.1.1-259.g91c8a7e5.el9.x86_64 104/182 2024-09-05T07:23:47.174 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 105/182 2024-09-05T07:23:47.298 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mon-2:19.1.1-259.g91c8a7e5.el9.x86_64 112/182 2024-09-05T07:23:47.321 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mon-2:19.1.1-259.g91c8a7e5.el9.x86_64 112/182 2024-09-05T07:23:47.321 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:23:47.321 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-05T07:23:47.321 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-05T07:23:47.321 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-05T07:23:47.321 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:23:47.421 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : automake-1.16.2-8.el9.noarch 113/182 2024-09-05T07:23:47.479 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ply-3.11-14.el9.noarch 114/182 2024-09-05T07:23:47.542 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 115/182 2024-09-05T07:23:47.745 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 116/182 2024-09-05T07:23:47.800 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 117/182 2024-09-05T07:23:47.890 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 118/182 2024-09-05T07:23:47.988 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 119/182 2024-09-05T07:23:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 120/182 2024-09-05T07:23:48.166 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 121/182 2024-09-05T07:23:48.199 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 122/182 2024-09-05T07:23:48.243 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : fuse-2.9.9-16.el9.x86_64 123/182 2024-09-05T07:23:48.747 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 124/182 2024-09-05T07:23:48.775 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 124/182 2024-09-05T07:23:48.806 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-259.g91c8a7e5.el 125/182 2024-09-05T07:23:48.871 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-259.g91c8a7e5.e 126/182 2024-09-05T07:23:48.897 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-259.g91c8a7e5.el9.noar 127/182 2024-09-05T07:23:49.584 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 106/182 2024-09-05T07:23:49.620 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 106/182 2024-09-05T07:23:49.999 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-259.g91c8a7e5.el9.noar 127/182 2024-09-05T07:23:50.041 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-259.g91c8a7e5.el9.no 128/182 2024-09-05T07:23:50.194 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 106/182 2024-09-05T07:23:50.234 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-base-2:19.1.1-259.g91c8a7e5.el9.x86_64 107/182 2024-09-05T07:23:50.325 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-base-2:19.1.1-259.g91c8a7e5.el9.x86_64 107/182 2024-09-05T07:23:50.325 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-05T07:23:50.325 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-05T07:23:50.325 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:23:50.352 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-selinux-2:19.1.1-259.g91c8a7e5.el9.x86_64 108/182 2024-09-05T07:23:51.054 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-259.g91c8a7e5.el9.no 128/182 2024-09-05T07:23:51.091 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-259.g91c8 129/182 2024-09-05T07:23:51.201 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-259.g91c8 129/182 2024-09-05T07:23:51.369 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-259.g91c8a7e5.el9 130/182 2024-09-05T07:23:51.393 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-2:19.1.1-259.g91c8a7e5.el9.x86_64 131/182 2024-09-05T07:23:51.417 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-2:19.1.1-259.g91c8a7e5.el9.x86_64 131/182 2024-09-05T07:23:51.417 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:23:51.417 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-05T07:23:51.417 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-05T07:23:51.417 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-05T07:23:51.417 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:23:51.469 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-rook-2:19.1.1-259.g91c8a7e5.el9.noarch 132/182 2024-09-05T07:23:51.480 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-259.g91c8a7e5.el9.noarch 132/182 2024-09-05T07:23:51.583 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-2:19.1.1-259.g91c8a7e5.el9.x86_64 133/182 2024-09-05T07:23:51.635 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 134/182 2024-09-05T07:23:52.611 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libtool-2.4.6-46.el9.x86_64 135/182 2024-09-05T07:23:52.638 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-radosgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 136/182 2024-09-05T07:23:52.662 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 136/182 2024-09-05T07:23:52.662 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:23:52.662 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-05T07:23:52.662 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-05T07:23:52.662 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-05T07:23:52.662 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:23:52.706 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-259.g91c8a7 137/182 2024-09-05T07:23:52.728 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-259.g91c8a7 137/182 2024-09-05T07:23:52.728 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:23:52.728 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-05T07:23:52.728 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:23:52.773 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephfs-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 138/182 2024-09-05T07:23:52.796 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 138/182 2024-09-05T07:23:52.796 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:23:52.796 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-05T07:23:52.796 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-05T07:23:52.796 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-05T07:23:52.796 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:23:53.116 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 139/182 2024-09-05T07:23:53.138 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: rbd-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 139/182 2024-09-05T07:23:53.139 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:23:53.139 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-05T07:23:53.139 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-05T07:23:53.139 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-05T07:23:53.139 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:23:57.953 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-test-2:19.1.1-259.g91c8a7e5.el9.x86_64 140/182 2024-09-05T07:23:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 141/182 2024-09-05T07:23:58.036 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-nbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 142/182 2024-09-05T07:23:58.067 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 143/182 2024-09-05T07:23:58.095 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 144/182 2024-09-05T07:23:58.289 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephfs-shell-2:19.1.1-259.g91c8a7e5.el9.x86_64 145/182 2024-09-05T07:23:58.333 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 146/182 2024-09-05T07:23:58.363 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs-devel-2:19.1.1-259.g91c8a7e5.el9.x86_6 147/182 2024-09-05T07:23:58.393 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : NetworkManager-team-1:1.48.10-1.el9.x86_64 148/182 2024-09-05T07:23:58.431 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : NetworkManager-tui-1:1.48.10-1.el9.x86_64 149/182 2024-09-05T07:23:59.084 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 150/182 2024-09-05T07:23:59.129 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 150/182 2024-09-05T07:23:59.149 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 150/182 2024-09-05T07:24:03.298 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-selinux-2:19.1.1-259.g91c8a7e5.el9.x86_64 108/182 2024-09-05T07:24:03.298 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /sys 2024-09-05T07:24:03.298 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /proc 2024-09-05T07:24:03.298 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /mnt 2024-09-05T07:24:03.298 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /var/tmp 2024-09-05T07:24:03.298 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /home 2024-09-05T07:24:03.299 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /root 2024-09-05T07:24:03.299 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /tmp 2024-09-05T07:24:03.299 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:24:03.479 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-volume-2:19.1.1-259.g91c8a7e5.el9.noarch 109/182 2024-09-05T07:24:03.495 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-volume-2:19.1.1-259.g91c8a7e5.el9.noarch 109/182 2024-09-05T07:24:03.495 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:24:03.495 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-05T07:24:03.495 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:24:05.150 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-osd-2:19.1.1-259.g91c8a7e5.el9.x86_64 110/182 2024-09-05T07:24:05.176 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-osd-2:19.1.1-259.g91c8a7e5.el9.x86_64 110/182 2024-09-05T07:24:05.176 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:24:05.176 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-05T07:24:05.176 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-05T07:24:05.176 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-05T07:24:05.176 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:24:05.408 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mds-2:19.1.1-259.g91c8a7e5.el9.x86_64 111/182 2024-09-05T07:24:05.431 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mds-2:19.1.1-259.g91c8a7e5.el9.x86_64 111/182 2024-09-05T07:24:05.431 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:24:05.431 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-05T07:24:05.431 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-05T07:24:05.431 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-05T07:24:05.431 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:24:05.892 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mon-2:19.1.1-259.g91c8a7e5.el9.x86_64 112/182 2024-09-05T07:24:05.915 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mon-2:19.1.1-259.g91c8a7e5.el9.x86_64 112/182 2024-09-05T07:24:05.915 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:24:05.915 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-05T07:24:05.915 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-05T07:24:05.915 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-05T07:24:05.915 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:24:06.064 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : automake-1.16.2-8.el9.noarch 113/182 2024-09-05T07:24:06.122 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-ply-3.11-14.el9.noarch 114/182 2024-09-05T07:24:06.186 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 115/182 2024-09-05T07:24:06.378 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 116/182 2024-09-05T07:24:06.426 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 117/182 2024-09-05T07:24:06.507 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 118/182 2024-09-05T07:24:06.597 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 119/182 2024-09-05T07:24:06.736 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephfs-top-2:19.1.1-259.g91c8a7e5.el9.noarch 151/182 2024-09-05T07:24:06.738 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 120/182 2024-09-05T07:24:06.793 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 121/182 2024-09-05T07:24:06.825 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 122/182 2024-09-05T07:24:06.861 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : fuse-2.9.9-16.el9.x86_64 123/182 2024-09-05T07:24:07.307 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 124/182 2024-09-05T07:24:07.334 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 124/182 2024-09-05T07:24:07.366 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-259.g91c8a7e5.el 125/182 2024-09-05T07:24:07.430 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-259.g91c8a7e5.e 126/182 2024-09-05T07:24:07.457 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-259.g91c8a7e5.el9.noar 127/182 2024-09-05T07:24:08.558 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-259.g91c8a7e5.el9.noar 127/182 2024-09-05T07:24:08.601 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-259.g91c8a7e5.el9.no 128/182 2024-09-05T07:24:09.613 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-259.g91c8a7e5.el9.no 128/182 2024-09-05T07:24:09.643 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-259.g91c8 129/182 2024-09-05T07:24:09.752 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-259.g91c8 129/182 2024-09-05T07:24:09.920 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-259.g91c8a7e5.el9 130/182 2024-09-05T07:24:09.945 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-2:19.1.1-259.g91c8a7e5.el9.x86_64 131/182 2024-09-05T07:24:09.968 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-2:19.1.1-259.g91c8a7e5.el9.x86_64 131/182 2024-09-05T07:24:09.968 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:24:09.968 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-05T07:24:09.969 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-05T07:24:09.969 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-05T07:24:09.969 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:24:10.020 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-rook-2:19.1.1-259.g91c8a7e5.el9.noarch 132/182 2024-09-05T07:24:10.032 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-259.g91c8a7e5.el9.noarch 132/182 2024-09-05T07:24:10.133 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-2:19.1.1-259.g91c8a7e5.el9.x86_64 133/182 2024-09-05T07:24:10.205 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 134/182 2024-09-05T07:24:11.185 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libtool-2.4.6-46.el9.x86_64 135/182 2024-09-05T07:24:11.231 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-radosgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 136/182 2024-09-05T07:24:11.254 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 136/182 2024-09-05T07:24:11.254 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:24:11.254 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-05T07:24:11.255 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-05T07:24:11.255 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-05T07:24:11.255 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:24:11.298 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-259.g91c8a7 137/182 2024-09-05T07:24:11.321 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-259.g91c8a7 137/182 2024-09-05T07:24:11.321 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:24:11.321 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-05T07:24:11.321 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:24:11.366 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cephfs-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 138/182 2024-09-05T07:24:11.389 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 138/182 2024-09-05T07:24:11.389 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:24:11.389 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-05T07:24:11.389 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-05T07:24:11.389 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-05T07:24:11.389 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:24:11.708 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 139/182 2024-09-05T07:24:11.731 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: rbd-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 139/182 2024-09-05T07:24:11.731 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T07:24:11.731 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-05T07:24:11.731 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-05T07:24:11.731 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-05T07:24:11.731 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:24:16.529 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-test-2:19.1.1-259.g91c8a7e5.el9.x86_64 140/182 2024-09-05T07:24:16.571 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 141/182 2024-09-05T07:24:16.611 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-nbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 142/182 2024-09-05T07:24:16.643 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 143/182 2024-09-05T07:24:16.670 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 144/182 2024-09-05T07:24:16.866 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cephfs-shell-2:19.1.1-259.g91c8a7e5.el9.x86_64 145/182 2024-09-05T07:24:16.909 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 146/182 2024-09-05T07:24:16.938 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephfs-devel-2:19.1.1-259.g91c8a7e5.el9.x86_6 147/182 2024-09-05T07:24:16.968 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : NetworkManager-team-1:1.48.10-1.el9.x86_64 148/182 2024-09-05T07:24:17.014 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : NetworkManager-tui-1:1.48.10-1.el9.x86_64 149/182 2024-09-05T07:24:17.648 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 150/182 2024-09-05T07:24:17.687 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 150/182 2024-09-05T07:24:17.706 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 150/182 2024-09-05T07:24:25.291 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cephfs-top-2:19.1.1-259.g91c8a7e5.el9.noarch 151/182 2024-09-05T07:24:52.703 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-base-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x 152/182 2024-09-05T07:24:53.380 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-common-debuginfo-2:19.1.1-259.g91c8a7e5.el9 153/182 2024-09-05T07:24:53.558 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-fuse-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x 154/182 2024-09-05T07:24:58.818 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.1.1-2 155/182 2024-09-05T07:25:01.050 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mds-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x8 156/182 2024-09-05T07:25:11.092 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-base-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x 152/182 2024-09-05T07:25:11.337 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x8 157/182 2024-09-05T07:25:11.761 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-common-debuginfo-2:19.1.1-259.g91c8a7e5.el9 153/182 2024-09-05T07:25:11.947 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-fuse-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x 154/182 2024-09-05T07:25:17.186 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.1.1-2 155/182 2024-09-05T07:25:19.417 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mds-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x8 156/182 2024-09-05T07:25:29.681 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x8 157/182 2024-09-05T07:25:40.996 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mon-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x8 158/182 2024-09-05T07:25:59.241 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mon-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x8 158/182 2024-09-05T07:26:00.305 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-osd-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x8 159/182 2024-09-05T07:26:18.496 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-osd-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x8 159/182 2024-09-05T07:27:13.737 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-radosgw-debuginfo-2:19.1.1-259.g91c8a7e5.el 160/182 2024-09-05T07:27:14.868 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-test-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x 161/182 2024-09-05T07:27:14.901 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs2-debuginfo-2:19.1.1-259.g91c8a7e5.el9. 162/182 2024-09-05T07:27:20.007 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librados-devel-debuginfo-2:19.1.1-259.g91c8a7e5. 163/182 2024-09-05T07:27:26.337 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librados2-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x 164/182 2024-09-05T07:27:26.426 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librbd1-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86 165/182 2024-09-05T07:27:26.524 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cephfs-debuginfo-2:19.1.1-259.g91c8a7e5. 166/182 2024-09-05T07:27:26.663 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rados-debuginfo-2:19.1.1-259.g91c8a7e5.e 167/182 2024-09-05T07:27:26.723 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rbd-debuginfo-2:19.1.1-259.g91c8a7e5.el9 168/182 2024-09-05T07:27:26.806 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rgw-debuginfo-2:19.1.1-259.g91c8a7e5.el9 169/182 2024-09-05T07:27:31.774 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-radosgw-debuginfo-2:19.1.1-259.g91c8a7e5.el 160/182 2024-09-05T07:27:32.668 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-test-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x 161/182 2024-09-05T07:27:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-fuse-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x8 170/182 2024-09-05T07:27:32.709 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephfs2-debuginfo-2:19.1.1-259.g91c8a7e5.el9. 162/182 2024-09-05T07:27:32.861 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-mirror-debuginfo-2:19.1.1-259.g91c8a7e5.el9. 171/182 2024-09-05T07:27:33.751 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-nbd-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86 172/182 2024-09-05T07:27:33.840 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openssl-devel-1:3.2.2-4.el9.x86_64 173/182 2024-09-05T07:27:33.890 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 174/182 2024-09-05T07:27:33.981 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flex-2.6.4-9.el9.x86_64 175/182 2024-09-05T07:27:34.026 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : bison-3.7.4-5.el9.x86_64 176/182 2024-09-05T07:27:34.060 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 177/182 2024-09-05T07:27:34.061 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/182 2024-09-05T07:27:34.136 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/182 2024-09-05T07:27:34.161 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 179/182 2024-09-05T07:27:34.166 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 180/182 2024-09-05T07:27:34.166 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 180/182 2024-09-05T07:27:34.346 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 180/182 2024-09-05T07:27:34.347 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 181/182 2024-09-05T07:27:34.430 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 181/182 2024-09-05T07:27:34.430 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 182/182 2024-09-05T07:27:37.808 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librados-devel-debuginfo-2:19.1.1-259.g91c8a7e5. 163/182 2024-09-05T07:27:43.877 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 182/182 2024-09-05T07:27:43.878 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-2:19.1.1-259.g91c8a7e5.el9.x86_64 1/182 2024-09-05T07:27:43.878 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-base-2:19.1.1-259.g91c8a7e5.el9.x86_64 2/182 2024-09-05T07:27:43.878 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-base-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x 3/182 2024-09-05T07:27:43.878 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 4/182 2024-09-05T07:27:43.878 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-common-debuginfo-2:19.1.1-259.g91c8a7e5.el9 5/182 2024-09-05T07:27:43.878 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 6/182 2024-09-05T07:27:43.878 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 7/182 2024-09-05T07:27:43.878 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-fuse-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x 8/182 2024-09-05T07:27:43.878 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-259.g91c8a7 9/182 2024-09-05T07:27:43.879 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.1.1-2 10/182 2024-09-05T07:27:43.879 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mds-2:19.1.1-259.g91c8a7e5.el9.x86_64 11/182 2024-09-05T07:27:43.879 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mds-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x8 12/182 2024-09-05T07:27:43.879 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-2:19.1.1-259.g91c8a7e5.el9.x86_64 13/182 2024-09-05T07:27:43.879 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x8 14/182 2024-09-05T07:27:43.879 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mon-2:19.1.1-259.g91c8a7e5.el9.x86_64 15/182 2024-09-05T07:27:43.879 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mon-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x8 16/182 2024-09-05T07:27:43.879 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-osd-2:19.1.1-259.g91c8a7e5.el9.x86_64 17/182 2024-09-05T07:27:43.879 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-osd-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x8 18/182 2024-09-05T07:27:43.879 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-radosgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 19/182 2024-09-05T07:27:43.879 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-radosgw-debuginfo-2:19.1.1-259.g91c8a7e5.el 20/182 2024-09-05T07:27:43.879 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-selinux-2:19.1.1-259.g91c8a7e5.el9.x86_64 21/182 2024-09-05T07:27:43.879 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-test-2:19.1.1-259.g91c8a7e5.el9.x86_64 22/182 2024-09-05T07:27:43.880 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-test-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x 23/182 2024-09-05T07:27:43.880 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephfs-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 24/182 2024-09-05T07:27:43.880 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephfs-shell-2:19.1.1-259.g91c8a7e5.el9.x86_64 25/182 2024-09-05T07:27:43.880 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs-devel-2:19.1.1-259.g91c8a7e5.el9.x86_6 26/182 2024-09-05T07:27:43.880 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs2-2:19.1.1-259.g91c8a7e5.el9.x86_64 27/182 2024-09-05T07:27:43.880 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs2-debuginfo-2:19.1.1-259.g91c8a7e5.el9. 28/182 2024-09-05T07:27:43.880 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephsqlite-2:19.1.1-259.g91c8a7e5.el9.x86_64 29/182 2024-09-05T07:27:43.880 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados-devel-2:19.1.1-259.g91c8a7e5.el9.x86_64 30/182 2024-09-05T07:27:43.894 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados-devel-debuginfo-2:19.1.1-259.g91c8a7e5. 31/182 2024-09-05T07:27:43.894 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x 32/182 2024-09-05T07:27:43.894 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libradosstriper1-2:19.1.1-259.g91c8a7e5.el9.x86_ 33/182 2024-09-05T07:27:43.894 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86 34/182 2024-09-05T07:27:43.894 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librgw2-2:19.1.1-259.g91c8a7e5.el9.x86_64 35/182 2024-09-05T07:27:43.894 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-argparse-2:19.1.1-259.g91c8a7e5.el9 36/182 2024-09-05T07:27:43.894 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-common-2:19.1.1-259.g91c8a7e5.el9.x 37/182 2024-09-05T07:27:43.894 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cephfs-2:19.1.1-259.g91c8a7e5.el9.x86_64 38/182 2024-09-05T07:27:43.894 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cephfs-debuginfo-2:19.1.1-259.g91c8a7e5. 39/182 2024-09-05T07:27:43.895 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rados-2:19.1.1-259.g91c8a7e5.el9.x86_64 40/182 2024-09-05T07:27:43.895 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rados-debuginfo-2:19.1.1-259.g91c8a7e5.e 41/182 2024-09-05T07:27:43.895 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 42/182 2024-09-05T07:27:43.895 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rbd-debuginfo-2:19.1.1-259.g91c8a7e5.el9 43/182 2024-09-05T07:27:43.895 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 44/182 2024-09-05T07:27:43.895 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rgw-debuginfo-2:19.1.1-259.g91c8a7e5.el9 45/182 2024-09-05T07:27:43.895 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 46/182 2024-09-05T07:27:43.895 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-fuse-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x8 47/182 2024-09-05T07:27:43.895 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 48/182 2024-09-05T07:27:43.895 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-mirror-debuginfo-2:19.1.1-259.g91c8a7e5.el9. 49/182 2024-09-05T07:27:43.895 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-nbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 50/182 2024-09-05T07:27:43.895 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-nbd-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86 51/182 2024-09-05T07:27:43.896 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-259.g91c8a7e5.e 52/182 2024-09-05T07:27:43.896 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-259.g91c8a7e5.el9.noar 53/182 2024-09-05T07:27:43.896 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-259.g91c8a7e5.el9.no 54/182 2024-09-05T07:27:43.896 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-259.g91c8 55/182 2024-09-05T07:27:43.896 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-259.g91c8a7e5.el9 56/182 2024-09-05T07:27:43.896 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-rook-2:19.1.1-259.g91c8a7e5.el9.noarch 57/182 2024-09-05T07:27:43.896 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-259.g91c8a7e5.el 58/182 2024-09-05T07:27:43.896 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-volume-2:19.1.1-259.g91c8a7e5.el9.noarch 59/182 2024-09-05T07:27:43.896 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 60/182 2024-09-05T07:27:43.896 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephfs-top-2:19.1.1-259.g91c8a7e5.el9.noarch 61/182 2024-09-05T07:27:43.897 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 62/182 2024-09-05T07:27:43.897 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 63/182 2024-09-05T07:27:43.897 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 64/182 2024-09-05T07:27:43.897 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 65/182 2024-09-05T07:27:43.897 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 66/182 2024-09-05T07:27:43.897 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ply-3.11-14.el9.noarch 67/182 2024-09-05T07:27:43.897 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 68/182 2024-09-05T07:27:43.897 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 69/182 2024-09-05T07:27:43.898 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 70/182 2024-09-05T07:27:43.898 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : automake-1.16.2-8.el9.noarch 71/182 2024-09-05T07:27:43.898 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : bison-3.7.4-5.el9.x86_64 72/182 2024-09-05T07:27:43.898 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 73/182 2024-09-05T07:27:43.898 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 74/182 2024-09-05T07:27:43.898 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flex-2.6.4-9.el9.x86_64 75/182 2024-09-05T07:27:43.898 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 76/182 2024-09-05T07:27:43.898 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 77/182 2024-09-05T07:27:43.898 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 78/182 2024-09-05T07:27:43.898 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 79/182 2024-09-05T07:27:43.898 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 80/182 2024-09-05T07:27:43.899 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 81/182 2024-09-05T07:27:43.899 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 82/182 2024-09-05T07:27:43.899 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 83/182 2024-09-05T07:27:43.899 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 84/182 2024-09-05T07:27:43.899 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 85/182 2024-09-05T07:27:43.899 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 86/182 2024-09-05T07:27:43.899 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lua-5.4.4-4.el9.x86_64 87/182 2024-09-05T07:27:43.900 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 88/182 2024-09-05T07:27:43.900 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 89/182 2024-09-05T07:27:43.900 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-devel-1:3.2.2-4.el9.x86_64 90/182 2024-09-05T07:27:43.900 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-13.16-1.el9.x86_64 91/182 2024-09-05T07:27:43.900 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 92/182 2024-09-05T07:27:43.901 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 93/182 2024-09-05T07:27:43.901 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 94/182 2024-09-05T07:27:43.901 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 95/182 2024-09-05T07:27:43.901 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 96/182 2024-09-05T07:27:43.901 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 97/182 2024-09-05T07:27:43.902 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 98/182 2024-09-05T07:27:43.902 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 99/182 2024-09-05T07:27:43.902 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 100/182 2024-09-05T07:27:43.902 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 101/182 2024-09-05T07:27:43.902 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 102/182 2024-09-05T07:27:43.902 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 103/182 2024-09-05T07:27:43.903 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 104/182 2024-09-05T07:27:43.903 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 105/182 2024-09-05T07:27:43.903 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 106/182 2024-09-05T07:27:43.903 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 107/182 2024-09-05T07:27:43.903 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 108/182 2024-09-05T07:27:43.904 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 109/182 2024-09-05T07:27:43.904 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 110/182 2024-09-05T07:27:43.904 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 111/182 2024-09-05T07:27:43.904 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 112/182 2024-09-05T07:27:43.904 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 113/182 2024-09-05T07:27:43.904 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 114/182 2024-09-05T07:27:43.904 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 115/182 2024-09-05T07:27:43.904 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 116/182 2024-09-05T07:27:43.904 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 117/182 2024-09-05T07:27:43.904 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 118/182 2024-09-05T07:27:43.904 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 119/182 2024-09-05T07:27:43.905 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 120/182 2024-09-05T07:27:43.905 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 121/182 2024-09-05T07:27:43.905 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 122/182 2024-09-05T07:27:43.905 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 123/182 2024-09-05T07:27:43.905 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 124/182 2024-09-05T07:27:43.905 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 125/182 2024-09-05T07:27:43.905 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 126/182 2024-09-05T07:27:43.905 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 127/182 2024-09-05T07:27:43.905 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 128/182 2024-09-05T07:27:43.905 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 129/182 2024-09-05T07:27:43.905 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 130/182 2024-09-05T07:27:43.905 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 131/182 2024-09-05T07:27:43.905 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 132/182 2024-09-05T07:27:43.906 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 133/182 2024-09-05T07:27:43.906 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 134/182 2024-09-05T07:27:43.906 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 135/182 2024-09-05T07:27:43.906 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 136/182 2024-09-05T07:27:43.906 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 137/182 2024-09-05T07:27:43.906 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 138/182 2024-09-05T07:27:43.906 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 139/182 2024-09-05T07:27:43.906 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 140/182 2024-09-05T07:27:43.906 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 141/182 2024-09-05T07:27:43.906 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 142/182 2024-09-05T07:27:43.906 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 143/182 2024-09-05T07:27:43.906 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 144/182 2024-09-05T07:27:43.906 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 145/182 2024-09-05T07:27:43.907 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 146/182 2024-09-05T07:27:43.907 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 147/182 2024-09-05T07:27:43.907 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 148/182 2024-09-05T07:27:43.907 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 149/182 2024-09-05T07:27:43.907 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 150/182 2024-09-05T07:27:43.907 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 151/182 2024-09-05T07:27:43.907 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 152/182 2024-09-05T07:27:43.907 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 153/182 2024-09-05T07:27:43.907 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 154/182 2024-09-05T07:27:43.907 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 155/182 2024-09-05T07:27:43.908 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 156/182 2024-09-05T07:27:43.908 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 157/182 2024-09-05T07:27:43.908 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 158/182 2024-09-05T07:27:43.908 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 159/182 2024-09-05T07:27:43.908 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 160/182 2024-09-05T07:27:43.908 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 161/182 2024-09-05T07:27:43.908 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 162/182 2024-09-05T07:27:43.908 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 163/182 2024-09-05T07:27:43.908 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 164/182 2024-09-05T07:27:43.908 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 165/182 2024-09-05T07:27:43.908 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 166/182 2024-09-05T07:27:43.908 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 167/182 2024-09-05T07:27:43.908 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 168/182 2024-09-05T07:27:43.909 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : re2-1:20211101-20.el9.x86_64 169/182 2024-09-05T07:27:43.909 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 170/182 2024-09-05T07:27:43.909 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-2:19.1.1-259.g91c8a7e5.el9.x86_64 171/182 2024-09-05T07:27:43.909 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 172/182 2024-09-05T07:27:43.909 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-2:19.1.1-259.g91c8a7e5.el9.x86_64 173/182 2024-09-05T07:27:43.909 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 174/182 2024-09-05T07:27:43.909 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-1:1.48.10-1.el9.x86_64 175/182 2024-09-05T07:27:43.909 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 176/182 2024-09-05T07:27:43.909 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-libnm-1:1.48.10-1.el9.x86_64 177/182 2024-09-05T07:27:43.909 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 178/182 2024-09-05T07:27:43.909 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-team-1:1.48.10-1.el9.x86_64 179/182 2024-09-05T07:27:43.909 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 180/182 2024-09-05T07:27:43.909 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-tui-1:1.48.10-1.el9.x86_64 181/182 2024-09-05T07:27:44.042 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librados2-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x 164/182 2024-09-05T07:27:44.133 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librbd1-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86 165/182 2024-09-05T07:27:44.240 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cephfs-debuginfo-2:19.1.1-259.g91c8a7e5. 166/182 2024-09-05T07:27:44.379 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rados-debuginfo-2:19.1.1-259.g91c8a7e5.e 167/182 2024-09-05T07:27:44.440 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rbd-debuginfo-2:19.1.1-259.g91c8a7e5.el9 168/182 2024-09-05T07:27:44.522 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rgw-debuginfo-2:19.1.1-259.g91c8a7e5.el9 169/182 2024-09-05T07:27:46.729 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 182/182 2024-09-05T07:27:46.730 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:27:46.730 INFO:teuthology.orchestra.run.smithi017.stdout:Upgraded: 2024-09-05T07:27:46.730 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-1:1.48.10-1.el9.x86_64 2024-09-05T07:27:46.730 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-libnm-1:1.48.10-1.el9.x86_64 2024-09-05T07:27:46.730 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-team-1:1.48.10-1.el9.x86_64 2024-09-05T07:27:46.730 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-tui-1:1.48.10-1.el9.x86_64 2024-09-05T07:27:46.730 INFO:teuthology.orchestra.run.smithi017.stdout: librados2-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.730 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.730 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-05T07:27:46.730 INFO:teuthology.orchestra.run.smithi017.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-05T07:27:46.730 INFO:teuthology.orchestra.run.smithi017.stdout: automake-1.16.2-8.el9.noarch 2024-09-05T07:27:46.730 INFO:teuthology.orchestra.run.smithi017.stdout: bison-3.7.4-5.el9.x86_64 2024-09-05T07:27:46.731 INFO:teuthology.orchestra.run.smithi017.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-05T07:27:46.731 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.731 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.731 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.731 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.731 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.731 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.731 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.731 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.731 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:27:46.731 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.731 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.731 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.731 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.732 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.732 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:27:46.732 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:27:46.732 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.732 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:27:46.732 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:27:46.732 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:27:46.732 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.732 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.732 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.732 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.732 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:27:46.732 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.733 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.733 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.733 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.733 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.733 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-volume-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:27:46.733 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:27:46.733 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.733 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-shell-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.733 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-top-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:27:46.733 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-05T07:27:46.733 INFO:teuthology.orchestra.run.smithi017.stdout: flex-2.6.4-9.el9.x86_64 2024-09-05T07:27:46.733 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-05T07:27:46.734 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-05T07:27:46.734 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-05T07:27:46.734 INFO:teuthology.orchestra.run.smithi017.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-05T07:27:46.734 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-05T07:27:46.734 INFO:teuthology.orchestra.run.smithi017.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-05T07:27:46.734 INFO:teuthology.orchestra.run.smithi017.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-05T07:27:46.734 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-05T07:27:46.734 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-05T07:27:46.734 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.734 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.734 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.734 INFO:teuthology.orchestra.run.smithi017.stdout: libcephsqlite-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.734 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-05T07:27:46.735 INFO:teuthology.orchestra.run.smithi017.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-05T07:27:46.735 INFO:teuthology.orchestra.run.smithi017.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-05T07:27:46.735 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-05T07:27:46.735 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-05T07:27:46.735 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.735 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.735 INFO:teuthology.orchestra.run.smithi017.stdout: librados2-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.735 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.735 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.735 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-05T07:27:46.735 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.735 INFO:teuthology.orchestra.run.smithi017.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-05T07:27:46.736 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-05T07:27:46.736 INFO:teuthology.orchestra.run.smithi017.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-05T07:27:46.736 INFO:teuthology.orchestra.run.smithi017.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-05T07:27:46.736 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-05T07:27:46.736 INFO:teuthology.orchestra.run.smithi017.stdout: lua-5.4.4-4.el9.x86_64 2024-09-05T07:27:46.736 INFO:teuthology.orchestra.run.smithi017.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-05T07:27:46.736 INFO:teuthology.orchestra.run.smithi017.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-05T07:27:46.736 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-05T07:27:46.736 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-05T07:27:46.736 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-devel-1:3.2.2-4.el9.x86_64 2024-09-05T07:27:46.736 INFO:teuthology.orchestra.run.smithi017.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-05T07:27:46.736 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-13.16-1.el9.x86_64 2024-09-05T07:27:46.736 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-05T07:27:46.737 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-05T07:27:46.737 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-05T07:27:46.737 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-05T07:27:46.737 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-05T07:27:46.737 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-05T07:27:46.737 INFO:teuthology.orchestra.run.smithi017.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-05T07:27:46.737 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-05T07:27:46.737 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-05T07:27:46.737 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-05T07:27:46.737 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.737 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.737 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.738 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.738 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-05T07:27:46.738 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-05T07:27:46.738 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-05T07:27:46.738 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-05T07:27:46.738 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-05T07:27:46.738 INFO:teuthology.orchestra.run.smithi017.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-05T07:27:46.738 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-05T07:27:46.738 INFO:teuthology.orchestra.run.smithi017.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-05T07:27:46.738 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-05T07:27:46.738 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-05T07:27:46.738 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-05T07:27:46.739 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-05T07:27:46.739 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-05T07:27:46.739 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-05T07:27:46.739 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-05T07:27:46.739 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-05T07:27:46.739 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-05T07:27:46.739 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-05T07:27:46.739 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-05T07:27:46.739 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-05T07:27:46.739 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-05T07:27:46.739 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-05T07:27:46.739 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-05T07:27:46.739 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-05T07:27:46.740 INFO:teuthology.orchestra.run.smithi017.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-05T07:27:46.740 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-05T07:27:46.740 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-05T07:27:46.740 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-05T07:27:46.740 INFO:teuthology.orchestra.run.smithi017.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-05T07:27:46.740 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-05T07:27:46.740 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ply-3.11-14.el9.noarch 2024-09-05T07:27:46.740 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-05T07:27:46.740 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-05T07:27:46.740 INFO:teuthology.orchestra.run.smithi017.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-05T07:27:46.740 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-05T07:27:46.740 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-05T07:27:46.741 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-05T07:27:46.741 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-05T07:27:46.741 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-05T07:27:46.741 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-05T07:27:46.741 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.741 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.741 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.741 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.741 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-05T07:27:46.741 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-05T07:27:46.741 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-05T07:27:46.742 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.742 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.742 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-05T07:27:46.742 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-05T07:27:46.742 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-05T07:27:46.742 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-05T07:27:46.742 INFO:teuthology.orchestra.run.smithi017.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-05T07:27:46.742 INFO:teuthology.orchestra.run.smithi017.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-05T07:27:46.742 INFO:teuthology.orchestra.run.smithi017.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-05T07:27:46.742 INFO:teuthology.orchestra.run.smithi017.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-05T07:27:46.742 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-05T07:27:46.743 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-05T07:27:46.743 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-05T07:27:46.743 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-05T07:27:46.743 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-05T07:27:46.743 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-05T07:27:46.743 INFO:teuthology.orchestra.run.smithi017.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-05T07:27:46.743 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.743 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.743 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.743 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.743 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.743 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:27:46.743 INFO:teuthology.orchestra.run.smithi017.stdout: re2-1:20211101-20.el9.x86_64 2024-09-05T07:27:46.744 INFO:teuthology.orchestra.run.smithi017.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-05T07:27:46.744 INFO:teuthology.orchestra.run.smithi017.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-05T07:27:46.744 INFO:teuthology.orchestra.run.smithi017.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-05T07:27:46.744 INFO:teuthology.orchestra.run.smithi017.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-05T07:27:46.744 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-05T07:27:46.744 INFO:teuthology.orchestra.run.smithi017.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-05T07:27:46.744 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:27:46.745 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-05T07:27:47.318 DEBUG:teuthology.parallel:result is None 2024-09-05T07:27:50.404 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-fuse-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x8 170/182 2024-09-05T07:27:50.568 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-mirror-debuginfo-2:19.1.1-259.g91c8a7e5.el9. 171/182 2024-09-05T07:27:51.443 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-nbd-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86 172/182 2024-09-05T07:27:51.530 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openssl-devel-1:3.2.2-4.el9.x86_64 173/182 2024-09-05T07:27:51.572 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 174/182 2024-09-05T07:27:51.656 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : flex-2.6.4-9.el9.x86_64 175/182 2024-09-05T07:27:51.684 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : bison-3.7.4-5.el9.x86_64 176/182 2024-09-05T07:27:51.709 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 177/182 2024-09-05T07:27:51.709 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/182 2024-09-05T07:27:51.793 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/182 2024-09-05T07:27:51.818 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 179/182 2024-09-05T07:27:51.823 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 180/182 2024-09-05T07:27:51.823 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 180/182 2024-09-05T07:27:52.004 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 180/182 2024-09-05T07:27:52.004 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 181/182 2024-09-05T07:27:52.096 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 181/182 2024-09-05T07:27:52.096 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 182/182 2024-09-05T07:28:02.056 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 182/182 2024-09-05T07:28:02.056 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-2:19.1.1-259.g91c8a7e5.el9.x86_64 1/182 2024-09-05T07:28:02.056 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-base-2:19.1.1-259.g91c8a7e5.el9.x86_64 2/182 2024-09-05T07:28:02.056 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-base-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x 3/182 2024-09-05T07:28:02.056 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 4/182 2024-09-05T07:28:02.056 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-common-debuginfo-2:19.1.1-259.g91c8a7e5.el9 5/182 2024-09-05T07:28:02.056 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 6/182 2024-09-05T07:28:02.057 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 7/182 2024-09-05T07:28:02.057 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-fuse-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x 8/182 2024-09-05T07:28:02.057 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-259.g91c8a7 9/182 2024-09-05T07:28:02.057 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.1.1-2 10/182 2024-09-05T07:28:02.057 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mds-2:19.1.1-259.g91c8a7e5.el9.x86_64 11/182 2024-09-05T07:28:02.057 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mds-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x8 12/182 2024-09-05T07:28:02.057 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-2:19.1.1-259.g91c8a7e5.el9.x86_64 13/182 2024-09-05T07:28:02.057 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x8 14/182 2024-09-05T07:28:02.057 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mon-2:19.1.1-259.g91c8a7e5.el9.x86_64 15/182 2024-09-05T07:28:02.057 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mon-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x8 16/182 2024-09-05T07:28:02.057 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-osd-2:19.1.1-259.g91c8a7e5.el9.x86_64 17/182 2024-09-05T07:28:02.057 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-osd-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x8 18/182 2024-09-05T07:28:02.057 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-radosgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 19/182 2024-09-05T07:28:02.058 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-radosgw-debuginfo-2:19.1.1-259.g91c8a7e5.el 20/182 2024-09-05T07:28:02.058 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-selinux-2:19.1.1-259.g91c8a7e5.el9.x86_64 21/182 2024-09-05T07:28:02.058 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-test-2:19.1.1-259.g91c8a7e5.el9.x86_64 22/182 2024-09-05T07:28:02.058 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-test-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x 23/182 2024-09-05T07:28:02.058 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cephfs-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 24/182 2024-09-05T07:28:02.058 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cephfs-shell-2:19.1.1-259.g91c8a7e5.el9.x86_64 25/182 2024-09-05T07:28:02.058 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephfs-devel-2:19.1.1-259.g91c8a7e5.el9.x86_6 26/182 2024-09-05T07:28:02.058 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephfs2-2:19.1.1-259.g91c8a7e5.el9.x86_64 27/182 2024-09-05T07:28:02.058 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephfs2-debuginfo-2:19.1.1-259.g91c8a7e5.el9. 28/182 2024-09-05T07:28:02.058 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephsqlite-2:19.1.1-259.g91c8a7e5.el9.x86_64 29/182 2024-09-05T07:28:02.058 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados-devel-2:19.1.1-259.g91c8a7e5.el9.x86_64 30/182 2024-09-05T07:28:02.071 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados-devel-debuginfo-2:19.1.1-259.g91c8a7e5. 31/182 2024-09-05T07:28:02.071 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados2-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x 32/182 2024-09-05T07:28:02.071 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libradosstriper1-2:19.1.1-259.g91c8a7e5.el9.x86_ 33/182 2024-09-05T07:28:02.072 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librbd1-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86 34/182 2024-09-05T07:28:02.072 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librgw2-2:19.1.1-259.g91c8a7e5.el9.x86_64 35/182 2024-09-05T07:28:02.072 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-argparse-2:19.1.1-259.g91c8a7e5.el9 36/182 2024-09-05T07:28:02.072 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-common-2:19.1.1-259.g91c8a7e5.el9.x 37/182 2024-09-05T07:28:02.072 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cephfs-2:19.1.1-259.g91c8a7e5.el9.x86_64 38/182 2024-09-05T07:28:02.072 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cephfs-debuginfo-2:19.1.1-259.g91c8a7e5. 39/182 2024-09-05T07:28:02.072 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rados-2:19.1.1-259.g91c8a7e5.el9.x86_64 40/182 2024-09-05T07:28:02.072 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rados-debuginfo-2:19.1.1-259.g91c8a7e5.e 41/182 2024-09-05T07:28:02.072 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 42/182 2024-09-05T07:28:02.072 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rbd-debuginfo-2:19.1.1-259.g91c8a7e5.el9 43/182 2024-09-05T07:28:02.072 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 44/182 2024-09-05T07:28:02.072 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rgw-debuginfo-2:19.1.1-259.g91c8a7e5.el9 45/182 2024-09-05T07:28:02.072 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 46/182 2024-09-05T07:28:02.073 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-fuse-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x8 47/182 2024-09-05T07:28:02.073 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 48/182 2024-09-05T07:28:02.073 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-mirror-debuginfo-2:19.1.1-259.g91c8a7e5.el9. 49/182 2024-09-05T07:28:02.073 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-nbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 50/182 2024-09-05T07:28:02.073 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-nbd-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86 51/182 2024-09-05T07:28:02.073 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-259.g91c8a7e5.e 52/182 2024-09-05T07:28:02.073 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-259.g91c8a7e5.el9.noar 53/182 2024-09-05T07:28:02.073 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-259.g91c8a7e5.el9.no 54/182 2024-09-05T07:28:02.073 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-259.g91c8 55/182 2024-09-05T07:28:02.073 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-259.g91c8a7e5.el9 56/182 2024-09-05T07:28:02.073 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-rook-2:19.1.1-259.g91c8a7e5.el9.noarch 57/182 2024-09-05T07:28:02.073 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-259.g91c8a7e5.el 58/182 2024-09-05T07:28:02.073 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-volume-2:19.1.1-259.g91c8a7e5.el9.noarch 59/182 2024-09-05T07:28:02.074 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 60/182 2024-09-05T07:28:02.074 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cephfs-top-2:19.1.1-259.g91c8a7e5.el9.noarch 61/182 2024-09-05T07:28:02.074 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 62/182 2024-09-05T07:28:02.074 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 63/182 2024-09-05T07:28:02.074 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 64/182 2024-09-05T07:28:02.074 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 65/182 2024-09-05T07:28:02.074 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 66/182 2024-09-05T07:28:02.074 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ply-3.11-14.el9.noarch 67/182 2024-09-05T07:28:02.074 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 68/182 2024-09-05T07:28:02.074 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 69/182 2024-09-05T07:28:02.074 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 70/182 2024-09-05T07:28:02.074 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : automake-1.16.2-8.el9.noarch 71/182 2024-09-05T07:28:02.074 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : bison-3.7.4-5.el9.x86_64 72/182 2024-09-05T07:28:02.075 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 73/182 2024-09-05T07:28:02.075 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 74/182 2024-09-05T07:28:02.075 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : flex-2.6.4-9.el9.x86_64 75/182 2024-09-05T07:28:02.075 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 76/182 2024-09-05T07:28:02.075 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 77/182 2024-09-05T07:28:02.075 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 78/182 2024-09-05T07:28:02.075 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 79/182 2024-09-05T07:28:02.075 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 80/182 2024-09-05T07:28:02.075 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 81/182 2024-09-05T07:28:02.075 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 82/182 2024-09-05T07:28:02.075 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 83/182 2024-09-05T07:28:02.075 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 84/182 2024-09-05T07:28:02.076 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 85/182 2024-09-05T07:28:02.076 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 86/182 2024-09-05T07:28:02.076 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : lua-5.4.4-4.el9.x86_64 87/182 2024-09-05T07:28:02.076 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 88/182 2024-09-05T07:28:02.076 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 89/182 2024-09-05T07:28:02.076 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openssl-devel-1:3.2.2-4.el9.x86_64 90/182 2024-09-05T07:28:02.076 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : postgresql-13.16-1.el9.x86_64 91/182 2024-09-05T07:28:02.076 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 92/182 2024-09-05T07:28:02.076 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 93/182 2024-09-05T07:28:02.076 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 94/182 2024-09-05T07:28:02.076 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 95/182 2024-09-05T07:28:02.076 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 96/182 2024-09-05T07:28:02.077 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 97/182 2024-09-05T07:28:02.077 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 98/182 2024-09-05T07:28:02.077 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 99/182 2024-09-05T07:28:02.077 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 100/182 2024-09-05T07:28:02.077 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 101/182 2024-09-05T07:28:02.077 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 102/182 2024-09-05T07:28:02.077 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 103/182 2024-09-05T07:28:02.077 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 104/182 2024-09-05T07:28:02.077 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 105/182 2024-09-05T07:28:02.077 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 106/182 2024-09-05T07:28:02.077 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 107/182 2024-09-05T07:28:02.077 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 108/182 2024-09-05T07:28:02.077 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 109/182 2024-09-05T07:28:02.077 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 110/182 2024-09-05T07:28:02.078 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 111/182 2024-09-05T07:28:02.078 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 112/182 2024-09-05T07:28:02.078 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 113/182 2024-09-05T07:28:02.078 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 114/182 2024-09-05T07:28:02.078 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 115/182 2024-09-05T07:28:02.078 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 116/182 2024-09-05T07:28:02.078 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 117/182 2024-09-05T07:28:02.078 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 118/182 2024-09-05T07:28:02.078 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 119/182 2024-09-05T07:28:02.078 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 120/182 2024-09-05T07:28:02.078 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 121/182 2024-09-05T07:28:02.078 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 122/182 2024-09-05T07:28:02.078 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 123/182 2024-09-05T07:28:02.079 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 124/182 2024-09-05T07:28:02.079 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 125/182 2024-09-05T07:28:02.079 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 126/182 2024-09-05T07:28:02.079 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 127/182 2024-09-05T07:28:02.079 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 128/182 2024-09-05T07:28:02.079 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 129/182 2024-09-05T07:28:02.079 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 130/182 2024-09-05T07:28:02.079 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 131/182 2024-09-05T07:28:02.079 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 132/182 2024-09-05T07:28:02.079 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 133/182 2024-09-05T07:28:02.079 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 134/182 2024-09-05T07:28:02.079 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 135/182 2024-09-05T07:28:02.079 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 136/182 2024-09-05T07:28:02.080 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 137/182 2024-09-05T07:28:02.080 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 138/182 2024-09-05T07:28:02.080 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 139/182 2024-09-05T07:28:02.080 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 140/182 2024-09-05T07:28:02.080 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 141/182 2024-09-05T07:28:02.080 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 142/182 2024-09-05T07:28:02.080 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 143/182 2024-09-05T07:28:02.080 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 144/182 2024-09-05T07:28:02.080 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 145/182 2024-09-05T07:28:02.080 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 146/182 2024-09-05T07:28:02.080 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 147/182 2024-09-05T07:28:02.080 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 148/182 2024-09-05T07:28:02.080 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 149/182 2024-09-05T07:28:02.081 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 150/182 2024-09-05T07:28:02.081 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 151/182 2024-09-05T07:28:02.081 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 152/182 2024-09-05T07:28:02.081 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 153/182 2024-09-05T07:28:02.081 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 154/182 2024-09-05T07:28:02.081 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 155/182 2024-09-05T07:28:02.081 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 156/182 2024-09-05T07:28:02.081 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 157/182 2024-09-05T07:28:02.081 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 158/182 2024-09-05T07:28:02.081 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 159/182 2024-09-05T07:28:02.081 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 160/182 2024-09-05T07:28:02.081 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 161/182 2024-09-05T07:28:02.081 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 162/182 2024-09-05T07:28:02.082 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 163/182 2024-09-05T07:28:02.082 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 164/182 2024-09-05T07:28:02.082 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 165/182 2024-09-05T07:28:02.082 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 166/182 2024-09-05T07:28:02.082 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 167/182 2024-09-05T07:28:02.082 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 168/182 2024-09-05T07:28:02.082 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : re2-1:20211101-20.el9.x86_64 169/182 2024-09-05T07:28:02.082 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 170/182 2024-09-05T07:28:02.082 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados2-2:19.1.1-259.g91c8a7e5.el9.x86_64 171/182 2024-09-05T07:28:02.082 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 172/182 2024-09-05T07:28:02.082 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librbd1-2:19.1.1-259.g91c8a7e5.el9.x86_64 173/182 2024-09-05T07:28:02.082 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 174/182 2024-09-05T07:28:02.082 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : NetworkManager-1:1.48.10-1.el9.x86_64 175/182 2024-09-05T07:28:02.082 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 176/182 2024-09-05T07:28:02.083 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : NetworkManager-libnm-1:1.48.10-1.el9.x86_64 177/182 2024-09-05T07:28:02.083 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 178/182 2024-09-05T07:28:02.083 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : NetworkManager-team-1:1.48.10-1.el9.x86_64 179/182 2024-09-05T07:28:02.083 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 180/182 2024-09-05T07:28:02.083 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : NetworkManager-tui-1:1.48.10-1.el9.x86_64 181/182 2024-09-05T07:28:04.823 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 182/182 2024-09-05T07:28:04.823 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:28:04.823 INFO:teuthology.orchestra.run.smithi026.stdout:Upgraded: 2024-09-05T07:28:04.824 INFO:teuthology.orchestra.run.smithi026.stdout: NetworkManager-1:1.48.10-1.el9.x86_64 2024-09-05T07:28:04.824 INFO:teuthology.orchestra.run.smithi026.stdout: NetworkManager-libnm-1:1.48.10-1.el9.x86_64 2024-09-05T07:28:04.824 INFO:teuthology.orchestra.run.smithi026.stdout: NetworkManager-team-1:1.48.10-1.el9.x86_64 2024-09-05T07:28:04.824 INFO:teuthology.orchestra.run.smithi026.stdout: NetworkManager-tui-1:1.48.10-1.el9.x86_64 2024-09-05T07:28:04.824 INFO:teuthology.orchestra.run.smithi026.stdout: librados2-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.824 INFO:teuthology.orchestra.run.smithi026.stdout: librbd1-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.824 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-09-05T07:28:04.824 INFO:teuthology.orchestra.run.smithi026.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-05T07:28:04.824 INFO:teuthology.orchestra.run.smithi026.stdout: automake-1.16.2-8.el9.noarch 2024-09-05T07:28:04.824 INFO:teuthology.orchestra.run.smithi026.stdout: bison-3.7.4-5.el9.x86_64 2024-09-05T07:28:04.824 INFO:teuthology.orchestra.run.smithi026.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-05T07:28:04.824 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.825 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-base-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.825 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-base-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.825 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.825 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-common-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.825 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.825 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.825 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-fuse-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.825 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-grafana-dashboards-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:28:04.825 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-immutable-object-cache-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.825 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-immutable-object-cache-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.825 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mds-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.825 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mds-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.826 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.826 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:28:04.826 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-dashboard-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:28:04.826 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.826 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-diskprediction-local-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:28:04.826 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-modules-core-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:28:04.826 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-rook-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:28:04.826 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mon-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.826 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mon-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.826 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-osd-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.826 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-osd-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.826 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-prometheus-alerts-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:28:04.826 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-radosgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.827 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-radosgw-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.827 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-selinux-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.827 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-test-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.827 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-test-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.827 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-volume-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:28:04.827 INFO:teuthology.orchestra.run.smithi026.stdout: cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:28:04.827 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.827 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-shell-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.827 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-top-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T07:28:04.827 INFO:teuthology.orchestra.run.smithi026.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-05T07:28:04.827 INFO:teuthology.orchestra.run.smithi026.stdout: flex-2.6.4-9.el9.x86_64 2024-09-05T07:28:04.827 INFO:teuthology.orchestra.run.smithi026.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-05T07:28:04.828 INFO:teuthology.orchestra.run.smithi026.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-05T07:28:04.828 INFO:teuthology.orchestra.run.smithi026.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-05T07:28:04.828 INFO:teuthology.orchestra.run.smithi026.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-05T07:28:04.828 INFO:teuthology.orchestra.run.smithi026.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-05T07:28:04.828 INFO:teuthology.orchestra.run.smithi026.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-05T07:28:04.828 INFO:teuthology.orchestra.run.smithi026.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-05T07:28:04.828 INFO:teuthology.orchestra.run.smithi026.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-05T07:28:04.828 INFO:teuthology.orchestra.run.smithi026.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-05T07:28:04.828 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs-devel-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.828 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs2-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.828 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs2-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.828 INFO:teuthology.orchestra.run.smithi026.stdout: libcephsqlite-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.829 INFO:teuthology.orchestra.run.smithi026.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-05T07:28:04.829 INFO:teuthology.orchestra.run.smithi026.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-05T07:28:04.829 INFO:teuthology.orchestra.run.smithi026.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-05T07:28:04.829 INFO:teuthology.orchestra.run.smithi026.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-05T07:28:04.829 INFO:teuthology.orchestra.run.smithi026.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-05T07:28:04.829 INFO:teuthology.orchestra.run.smithi026.stdout: librados-devel-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.829 INFO:teuthology.orchestra.run.smithi026.stdout: librados-devel-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.829 INFO:teuthology.orchestra.run.smithi026.stdout: librados2-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.829 INFO:teuthology.orchestra.run.smithi026.stdout: libradosstriper1-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.829 INFO:teuthology.orchestra.run.smithi026.stdout: librbd1-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.829 INFO:teuthology.orchestra.run.smithi026.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-05T07:28:04.829 INFO:teuthology.orchestra.run.smithi026.stdout: librgw2-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.830 INFO:teuthology.orchestra.run.smithi026.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-05T07:28:04.830 INFO:teuthology.orchestra.run.smithi026.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-05T07:28:04.830 INFO:teuthology.orchestra.run.smithi026.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-05T07:28:04.830 INFO:teuthology.orchestra.run.smithi026.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-05T07:28:04.830 INFO:teuthology.orchestra.run.smithi026.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-05T07:28:04.830 INFO:teuthology.orchestra.run.smithi026.stdout: lua-5.4.4-4.el9.x86_64 2024-09-05T07:28:04.830 INFO:teuthology.orchestra.run.smithi026.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-05T07:28:04.830 INFO:teuthology.orchestra.run.smithi026.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-05T07:28:04.830 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-05T07:28:04.830 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-05T07:28:04.830 INFO:teuthology.orchestra.run.smithi026.stdout: openssl-devel-1:3.2.2-4.el9.x86_64 2024-09-05T07:28:04.830 INFO:teuthology.orchestra.run.smithi026.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-05T07:28:04.831 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-13.16-1.el9.x86_64 2024-09-05T07:28:04.831 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-05T07:28:04.831 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-05T07:28:04.831 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-05T07:28:04.831 INFO:teuthology.orchestra.run.smithi026.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-05T07:28:04.831 INFO:teuthology.orchestra.run.smithi026.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-05T07:28:04.831 INFO:teuthology.orchestra.run.smithi026.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-05T07:28:04.831 INFO:teuthology.orchestra.run.smithi026.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-05T07:28:04.831 INFO:teuthology.orchestra.run.smithi026.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-05T07:28:04.831 INFO:teuthology.orchestra.run.smithi026.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-05T07:28:04.831 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-05T07:28:04.831 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-argparse-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.831 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.831 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cephfs-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.832 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cephfs-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.832 INFO:teuthology.orchestra.run.smithi026.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-05T07:28:04.832 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-05T07:28:04.832 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-05T07:28:04.832 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-05T07:28:04.832 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-05T07:28:04.832 INFO:teuthology.orchestra.run.smithi026.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-05T07:28:04.832 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-05T07:28:04.832 INFO:teuthology.orchestra.run.smithi026.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-05T07:28:04.832 INFO:teuthology.orchestra.run.smithi026.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-05T07:28:04.832 INFO:teuthology.orchestra.run.smithi026.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-05T07:28:04.832 INFO:teuthology.orchestra.run.smithi026.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-05T07:28:04.833 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-05T07:28:04.833 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-05T07:28:04.833 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-05T07:28:04.833 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-05T07:28:04.833 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-05T07:28:04.833 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-05T07:28:04.833 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-05T07:28:04.833 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-05T07:28:04.833 INFO:teuthology.orchestra.run.smithi026.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-05T07:28:04.833 INFO:teuthology.orchestra.run.smithi026.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-05T07:28:04.833 INFO:teuthology.orchestra.run.smithi026.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-05T07:28:04.833 INFO:teuthology.orchestra.run.smithi026.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-05T07:28:04.834 INFO:teuthology.orchestra.run.smithi026.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-05T07:28:04.834 INFO:teuthology.orchestra.run.smithi026.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-05T07:28:04.834 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-05T07:28:04.834 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-05T07:28:04.834 INFO:teuthology.orchestra.run.smithi026.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-05T07:28:04.834 INFO:teuthology.orchestra.run.smithi026.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-05T07:28:04.834 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-05T07:28:04.834 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ply-3.11-14.el9.noarch 2024-09-05T07:28:04.834 INFO:teuthology.orchestra.run.smithi026.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-05T07:28:04.834 INFO:teuthology.orchestra.run.smithi026.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-05T07:28:04.834 INFO:teuthology.orchestra.run.smithi026.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-05T07:28:04.834 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-05T07:28:04.834 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-05T07:28:04.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-05T07:28:04.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-05T07:28:04.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-05T07:28:04.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-05T07:28:04.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rbd-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-05T07:28:04.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-05T07:28:04.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-05T07:28:04.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rgw-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-05T07:28:04.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-05T07:28:04.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-05T07:28:04.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-05T07:28:04.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-05T07:28:04.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-05T07:28:04.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-05T07:28:04.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-05T07:28:04.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-05T07:28:04.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-05T07:28:04.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-05T07:28:04.837 INFO:teuthology.orchestra.run.smithi026.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-05T07:28:04.837 INFO:teuthology.orchestra.run.smithi026.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-05T07:28:04.837 INFO:teuthology.orchestra.run.smithi026.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-05T07:28:04.837 INFO:teuthology.orchestra.run.smithi026.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-05T07:28:04.837 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.837 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-fuse-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.837 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.837 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-mirror-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.837 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-nbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.837 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-nbd-debuginfo-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T07:28:04.837 INFO:teuthology.orchestra.run.smithi026.stdout: re2-1:20211101-20.el9.x86_64 2024-09-05T07:28:04.837 INFO:teuthology.orchestra.run.smithi026.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-05T07:28:04.838 INFO:teuthology.orchestra.run.smithi026.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-05T07:28:04.838 INFO:teuthology.orchestra.run.smithi026.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-05T07:28:04.838 INFO:teuthology.orchestra.run.smithi026.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-05T07:28:04.838 INFO:teuthology.orchestra.run.smithi026.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-05T07:28:04.838 INFO:teuthology.orchestra.run.smithi026.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-05T07:28:04.838 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:28:04.838 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-09-05T07:28:05.379 DEBUG:teuthology.parallel:result is None 2024-09-05T07:28:05.380 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 2024-09-05T07:28:05.527 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-05T07:28:05.554 INFO:teuthology.orchestra.run.smithi017.stdout:19.1.1-259.g91c8a7e5.el9 2024-09-05T07:28:05.554 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-259.g91c8a7e5.el9 2024-09-05T07:28:05.555 INFO:teuthology.task.install:The correct ceph version 19.1.1-259.g91c8a7e5 is installed. 2024-09-05T07:28:05.556 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 2024-09-05T07:28:05.697 DEBUG:teuthology.orchestra.run.smithi026:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-05T07:28:05.719 INFO:teuthology.orchestra.run.smithi026.stdout:19.1.1-259.g91c8a7e5.el9 2024-09-05T07:28:05.719 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-259.g91c8a7e5.el9 2024-09-05T07:28:05.720 INFO:teuthology.task.install:The correct ceph version 19.1.1-259.g91c8a7e5 is installed. 2024-09-05T07:28:05.721 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-05T07:28:05.722 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-05T07:28:05.722 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-05T07:28:05.754 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-05T07:28:05.754 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-05T07:28:05.786 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-05T07:28:05.786 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-05T07:28:05.786 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/daemon-helper 2024-09-05T07:28:05.824 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-05T07:28:05.893 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-05T07:28:05.893 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/daemon-helper 2024-09-05T07:28:05.917 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-05T07:28:05.981 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-05T07:28:05.982 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-05T07:28:05.982 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-05T07:28:06.012 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-05T07:28:06.079 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-05T07:28:06.079 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-05T07:28:06.103 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-05T07:28:06.169 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-05T07:28:06.169 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-05T07:28:06.169 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/stdin-killer 2024-09-05T07:28:06.193 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-05T07:28:06.261 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-05T07:28:06.261 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/stdin-killer 2024-09-05T07:28:06.290 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-05T07:28:06.377 INFO:teuthology.run_tasks:Running task ceph... 2024-09-05T07:28:06.549 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-05T07:28:06.549 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 777 /var/log/ceph 2024-09-05T07:28:06.555 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 777 /var/log/ceph 2024-09-05T07:28:06.583 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-05T07:28:06.584 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-05T07:28:06.627 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-05T07:28:06.655 INFO:tasks.ceph:Creating extra log directories... 2024-09-05T07:28:06.655 DEBUG:teuthology.orchestra.run.smithi017:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-05T07:28:06.694 DEBUG:teuthology.orchestra.run.smithi026:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-05T07:28:06.876 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-05T07:28:06.876 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-05T07:28:06.876 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-05T07:28:06.876 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-05T07:28:06.877 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-05T07:28:06.892 DEBUG:teuthology.orchestra.run.smithi017:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-05T07:28:07.003 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-05T07:28:07.027 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-05T07:28:07.027 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-05T07:28:07.042 DEBUG:teuthology.orchestra.run.smithi026:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-05T07:28:07.153 DEBUG:teuthology.orchestra.run.smithi026:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-05T07:28:07.182 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-05T07:28:07.182 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-05T07:28:07.182 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7890022', 'branch': 'squid', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/5 tasks/dbench validater/valgrind}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7890022', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'client.0': {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 1743, 'sha1': '91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4', 'sleep_before_teardown': 0, 'subset': '459/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi017.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGlakx+H/0gkL7nThlXmfGN121a9AGCu9bedNSO0U1C+8aSAJMNfUTvdMqffQ/S23vqMkDKG4BGhaj67MdhpYDg=', 'smithi026.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPHKIliJBVVrBFnFtQGvIjgFfZLCGofljG8z7SemgEl1LlCS8IHxisxlMmXRsnB/8wlDv0y/rdTUWcEBk4PROUk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}, 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-04_21:24:16', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-05T07:28:07.183 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-05T07:28:07.185 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-05T07:28:07.232 DEBUG:teuthology.orchestra.run.smithi017:> sudo install -d -m0777 -- /var/run/ceph 2024-09-05T07:28:07.240 DEBUG:teuthology.orchestra.run.smithi026:> sudo install -d -m0777 -- /var/run/ceph 2024-09-05T07:28:07.296 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-05T07:28:07.297 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/scratch_devs of=/dev/stdout 2024-09-05T07:28:07.319 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-05T07:28:07.319 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_1 2024-09-05T07:28:07.374 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-05T07:28:07.374 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T07:28:07.374 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-05T07:28:07.374 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T07:28:07.374 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T07:28:07.375 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-05 07:27:34.950393225 +0000 2024-09-05T07:28:07.375 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-05 07:20:36.681653741 +0000 2024-09-05T07:28:07.375 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-05 07:20:36.681653741 +0000 2024-09-05T07:28:07.375 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-05 07:20:36.681653741 +0000 2024-09-05T07:28:07.375 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-05T07:28:07.437 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-05T07:28:07.437 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-05T07:28:07.438 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 9.9194e-05 s, 5.2 MB/s 2024-09-05T07:28:07.439 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-05T07:28:07.495 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_2 2024-09-05T07:28:07.550 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-05T07:28:07.550 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T07:28:07.550 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-05T07:28:07.551 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T07:28:07.551 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T07:28:07.551 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-05 07:27:34.951393214 +0000 2024-09-05T07:28:07.551 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-05 07:20:37.008650820 +0000 2024-09-05T07:28:07.551 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-05 07:20:37.008650820 +0000 2024-09-05T07:28:07.551 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-05 07:20:37.008650820 +0000 2024-09-05T07:28:07.551 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-05T07:28:07.613 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-05T07:28:07.613 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-05T07:28:07.613 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 7.837e-05 s, 6.5 MB/s 2024-09-05T07:28:07.614 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-05T07:28:07.670 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_3 2024-09-05T07:28:07.725 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-05T07:28:07.725 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T07:28:07.726 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-09-05T07:28:07.726 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T07:28:07.726 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T07:28:07.726 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-05 07:27:34.951393214 +0000 2024-09-05T07:28:07.726 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-05 07:20:37.325647988 +0000 2024-09-05T07:28:07.726 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-05 07:20:37.325647988 +0000 2024-09-05T07:28:07.726 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-05 07:20:37.325647988 +0000 2024-09-05T07:28:07.726 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-05T07:28:07.788 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-05T07:28:07.788 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-05T07:28:07.788 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 8.472e-05 s, 6.0 MB/s 2024-09-05T07:28:07.789 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-05T07:28:07.845 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_4 2024-09-05T07:28:07.900 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-05T07:28:07.900 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T07:28:07.901 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-05T07:28:07.901 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T07:28:07.901 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T07:28:07.901 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-05 07:27:34.951393214 +0000 2024-09-05T07:28:07.901 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-05 07:20:37.645645130 +0000 2024-09-05T07:28:07.901 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-05 07:20:37.645645130 +0000 2024-09-05T07:28:07.901 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-05 07:20:37.645645130 +0000 2024-09-05T07:28:07.901 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-05T07:28:07.963 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-05T07:28:07.963 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-05T07:28:07.963 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 9.8687e-05 s, 5.2 MB/s 2024-09-05T07:28:07.964 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-05T07:28:08.020 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-05T07:28:08.020 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-05T07:28:08.020 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/scratch_devs of=/dev/stdout 2024-09-05T07:28:08.037 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-05T07:28:08.038 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_1 2024-09-05T07:28:08.094 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-05T07:28:08.095 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T07:28:08.095 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-05T07:28:08.095 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T07:28:08.095 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T07:28:08.095 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2024-09-05 07:27:52.584220136 +0000 2024-09-05T07:28:08.095 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2024-09-05 07:20:36.696851926 +0000 2024-09-05T07:28:08.095 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2024-09-05 07:20:36.696851926 +0000 2024-09-05T07:28:08.095 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: 2024-09-05 07:20:36.696851926 +0000 2024-09-05T07:28:08.095 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-05T07:28:08.160 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2024-09-05T07:28:08.160 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2024-09-05T07:28:08.160 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000128032 s, 4.0 MB/s 2024-09-05T07:28:08.161 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-05T07:28:08.219 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_2 2024-09-05T07:28:08.274 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-05T07:28:08.275 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T07:28:08.275 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-05T07:28:08.275 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T07:28:08.275 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T07:28:08.275 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2024-09-05 07:27:52.584220136 +0000 2024-09-05T07:28:08.275 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2024-09-05 07:20:37.031846901 +0000 2024-09-05T07:28:08.275 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2024-09-05 07:20:37.031846901 +0000 2024-09-05T07:28:08.275 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: 2024-09-05 07:20:37.031846901 +0000 2024-09-05T07:28:08.275 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-05T07:28:08.339 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2024-09-05T07:28:08.339 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2024-09-05T07:28:08.339 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000104407 s, 4.9 MB/s 2024-09-05T07:28:08.340 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-05T07:28:08.397 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_3 2024-09-05T07:28:08.454 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-05T07:28:08.454 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T07:28:08.454 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-09-05T07:28:08.454 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T07:28:08.454 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T07:28:08.454 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2024-09-05 07:27:52.585220121 +0000 2024-09-05T07:28:08.454 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2024-09-05 07:20:37.373841772 +0000 2024-09-05T07:28:08.454 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2024-09-05 07:20:37.373841772 +0000 2024-09-05T07:28:08.454 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: 2024-09-05 07:20:37.373841772 +0000 2024-09-05T07:28:08.455 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-05T07:28:08.518 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2024-09-05T07:28:08.519 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2024-09-05T07:28:08.519 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 9.5954e-05 s, 5.3 MB/s 2024-09-05T07:28:08.520 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-05T07:28:08.577 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_4 2024-09-05T07:28:08.633 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-05T07:28:08.633 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T07:28:08.633 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-05T07:28:08.633 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T07:28:08.633 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T07:28:08.633 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2024-09-05 07:27:52.585220121 +0000 2024-09-05T07:28:08.633 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2024-09-05 07:20:37.691837002 +0000 2024-09-05T07:28:08.633 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2024-09-05 07:20:37.691837002 +0000 2024-09-05T07:28:08.633 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: 2024-09-05 07:20:37.691837002 +0000 2024-09-05T07:28:08.634 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-05T07:28:08.697 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2024-09-05T07:28:08.697 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2024-09-05T07:28:08.697 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000101103 s, 5.1 MB/s 2024-09-05T07:28:08.698 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-05T07:28:08.754 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-05T07:28:08.754 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi017.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi026.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-05T07:28:08.755 INFO:tasks.ceph:Generating config... 2024-09-05T07:28:08.756 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-05T07:28:08.756 INFO:tasks.ceph:[client] debug client = 20 2024-09-05T07:28:08.756 INFO:tasks.ceph:[client] debug ms = 1 2024-09-05T07:28:08.756 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-05T07:28:08.756 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-05T07:28:08.756 INFO:tasks.ceph:[global] mds beacon grace = 60 2024-09-05T07:28:08.756 INFO:tasks.ceph:[global] mds heartbeat grace = 60 2024-09-05T07:28:08.756 INFO:tasks.ceph:[global] osd heartbeat grace = 60 2024-09-05T07:28:08.756 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-05T07:28:08.756 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-05T07:28:08.756 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-05T07:28:08.757 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-05T07:28:08.757 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-05T07:28:08.757 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-05T07:28:08.757 INFO:tasks.ceph:[mds] mds valgrind exit = True 2024-09-05T07:28:08.757 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-05T07:28:08.757 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-05T07:28:08.757 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-05T07:28:08.757 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-05T07:28:08.757 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-05T07:28:08.757 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-05T07:28:08.757 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-05T07:28:08.757 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-05T07:28:08.757 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-05T07:28:08.757 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-05T07:28:08.757 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-05T07:28:08.758 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-05T07:28:08.758 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-09-05T07:28:08.758 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-05T07:28:08.758 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-05T07:28:08.758 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-05T07:28:08.758 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-05T07:28:08.758 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-05T07:28:08.758 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-05T07:28:08.758 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-05T07:28:08.758 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-05T07:28:08.758 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-05T07:28:08.758 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-05T07:28:08.758 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-05T07:28:08.758 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-05T07:28:08.759 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-05T07:28:08.759 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-05T07:28:08.759 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-05T07:28:08.759 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-09-05T07:28:08.759 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-05T07:28:08.759 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-05T07:28:08.759 INFO:tasks.ceph:Setting up mon.a... 2024-09-05T07:28:08.759 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-05T07:28:08.813 INFO:teuthology.orchestra.run.smithi017.stdout:creating /etc/ceph/ceph.keyring 2024-09-05T07:28:08.816 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-05T07:28:08.863 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-05T07:28:08.889 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.17'), ('mon.b', '172.21.15.26'), ('mon.c', '[v2:172.21.15.26:3301,v1:172.21.15.26:6790]')] 2024-09-05T07:28:08.889 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.17,172.21.15.26,[v2:172.21.15.26:3301,v1:172.21.15.26:6790]', 'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-05T07:28:08.890 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-05T07:28:08.890 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-05T07:28:08.945 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.17 --add b 172.21.15.26 --addv c '[v2:172.21.15.26:3301,v1:172.21.15.26:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-05T07:28:09.034 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-05T07:28:09.034 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: generated fsid 848dac54-74f8-48f3-8686-c6495dcb972b 2024-09-05T07:28:09.034 INFO:teuthology.orchestra.run.smithi017.stdout:setting min_mon_release = quincy 2024-09-05T07:28:09.034 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 0 2024-09-05T07:28:09.034 INFO:teuthology.orchestra.run.smithi017.stdout:fsid 848dac54-74f8-48f3-8686-c6495dcb972b 2024-09-05T07:28:09.034 INFO:teuthology.orchestra.run.smithi017.stdout:last_changed 2024-09-05T07:28:09.034810+0000 2024-09-05T07:28:09.034 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-05T07:28:09.034810+0000 2024-09-05T07:28:09.035 INFO:teuthology.orchestra.run.smithi017.stdout:min_mon_release 17 (quincy) 2024-09-05T07:28:09.035 INFO:teuthology.orchestra.run.smithi017.stdout:election_strategy: 1 2024-09-05T07:28:09.035 INFO:teuthology.orchestra.run.smithi017.stdout:0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-09-05T07:28:09.035 INFO:teuthology.orchestra.run.smithi017.stdout:1: [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] mon.b 2024-09-05T07:28:09.035 INFO:teuthology.orchestra.run.smithi017.stdout:2: [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] mon.c 2024-09-05T07:28:09.035 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-05T07:28:09.036 DEBUG:teuthology.orchestra.run.smithi017:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-05T07:28:09.052 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 848dac54-74f8-48f3-8686-c6495dcb972b... 2024-09-05T07:28:09.053 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-05T07:28:09.095 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-05T07:28:09.135 INFO:teuthology.orchestra.run.smithi017.stdout:[global] 2024-09-05T07:28:09.135 INFO:teuthology.orchestra.run.smithi017.stdout: chdir = "" 2024-09-05T07:28:09.136 INFO:teuthology.orchestra.run.smithi017.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-05T07:28:09.136 INFO:teuthology.orchestra.run.smithi017.stdout: auth supported = cephx 2024-09-05T07:28:09.136 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:28:09.136 INFO:teuthology.orchestra.run.smithi017.stdout: filestore xattr use omap = true 2024-09-05T07:28:09.136 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:28:09.136 INFO:teuthology.orchestra.run.smithi017.stdout: mon clock drift allowed = 1.000 2024-09-05T07:28:09.136 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:28:09.137 INFO:teuthology.orchestra.run.smithi017.stdout: osd crush chooseleaf type = 0 2024-09-05T07:28:09.137 INFO:teuthology.orchestra.run.smithi017.stdout: auth debug = true 2024-09-05T07:28:09.137 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:28:09.137 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on old message = true 2024-09-05T07:28:09.137 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on bug = true 2024-09-05T07:28:09.137 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:28:09.137 INFO:teuthology.orchestra.run.smithi017.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-05T07:28:09.137 INFO:teuthology.orchestra.run.smithi017.stdout: mon pg warn max object skew = 0 2024-09-05T07:28:09.137 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:28:09.137 INFO:teuthology.orchestra.run.smithi017.stdout: # disable pg_autoscaler by default for new pools 2024-09-05T07:28:09.137 INFO:teuthology.orchestra.run.smithi017.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-05T07:28:09.137 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:28:09.137 INFO:teuthology.orchestra.run.smithi017.stdout: osd pool default size = 2 2024-09-05T07:28:09.138 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:28:09.138 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd allow primary affinity = true 2024-09-05T07:28:09.138 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd allow pg remap = true 2024-09-05T07:28:09.138 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on legacy crush tunables = false 2024-09-05T07:28:09.138 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on crush straw calc version zero = false 2024-09-05T07:28:09.138 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on no sortbitwise = false 2024-09-05T07:28:09.138 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on osd down out interval zero = false 2024-09-05T07:28:09.139 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on too few osds = false 2024-09-05T07:28:09.139 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-05T07:28:09.139 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-05T07:28:09.139 INFO:teuthology.orchestra.run.smithi017.stdout: mon_allow_pool_size_one = true 2024-09-05T07:28:09.139 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:28:09.139 INFO:teuthology.orchestra.run.smithi017.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-05T07:28:09.139 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:28:09.139 INFO:teuthology.orchestra.run.smithi017.stdout: osd default data pool replay window = 5 2024-09-05T07:28:09.139 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:28:09.139 INFO:teuthology.orchestra.run.smithi017.stdout: mon allow pool delete = true 2024-09-05T07:28:09.139 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:28:09.139 INFO:teuthology.orchestra.run.smithi017.stdout: mon cluster log file level = debug 2024-09-05T07:28:09.140 INFO:teuthology.orchestra.run.smithi017.stdout: debug asserts on shutdown = true 2024-09-05T07:28:09.140 INFO:teuthology.orchestra.run.smithi017.stdout: mon health detail to clog = false 2024-09-05T07:28:09.140 INFO:teuthology.orchestra.run.smithi017.stdout: mon host = "172.21.15.17,172.21.15.26,[v2:172.21.15.26:3301,v1:172.21.15.26:6790]" 2024-09-05T07:28:09.140 INFO:teuthology.orchestra.run.smithi017.stdout: mds beacon grace = 60 2024-09-05T07:28:09.140 INFO:teuthology.orchestra.run.smithi017.stdout: mds heartbeat grace = 60 2024-09-05T07:28:09.140 INFO:teuthology.orchestra.run.smithi017.stdout: osd heartbeat grace = 60 2024-09-05T07:28:09.140 INFO:teuthology.orchestra.run.smithi017.stdout: fsid = 848dac54-74f8-48f3-8686-c6495dcb972b 2024-09-05T07:28:09.140 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:28:09.141 INFO:teuthology.orchestra.run.smithi017.stdout:[osd] 2024-09-05T07:28:09.141 INFO:teuthology.orchestra.run.smithi017.stdout: osd journal size = 100 2024-09-05T07:28:09.141 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:28:09.141 INFO:teuthology.orchestra.run.smithi017.stdout: osd scrub load threshold = 5.0 2024-09-05T07:28:09.141 INFO:teuthology.orchestra.run.smithi017.stdout: osd scrub max interval = 600 2024-09-05T07:28:09.141 INFO:teuthology.orchestra.run.smithi017.stdout: osd mclock profile = high_recovery_ops 2024-09-05T07:28:09.141 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:28:09.141 INFO:teuthology.orchestra.run.smithi017.stdout: osd recover clone overlap = true 2024-09-05T07:28:09.141 INFO:teuthology.orchestra.run.smithi017.stdout: osd recovery max chunk = 1048576 2024-09-05T07:28:09.141 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:28:09.141 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug shutdown = true 2024-09-05T07:28:09.141 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug op order = true 2024-09-05T07:28:09.142 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug verify stray on activate = true 2024-09-05T07:28:09.142 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug trim objects = true 2024-09-05T07:28:09.142 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:28:09.142 INFO:teuthology.orchestra.run.smithi017.stdout: osd open classes on start = true 2024-09-05T07:28:09.142 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug pg log writeout = true 2024-09-05T07:28:09.142 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:28:09.142 INFO:teuthology.orchestra.run.smithi017.stdout: osd deep scrub update digest min age = 30 2024-09-05T07:28:09.142 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:28:09.142 INFO:teuthology.orchestra.run.smithi017.stdout: osd map max advance = 10 2024-09-05T07:28:09.143 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:28:09.143 INFO:teuthology.orchestra.run.smithi017.stdout: journal zero on create = true 2024-09-05T07:28:09.143 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:28:09.143 INFO:teuthology.orchestra.run.smithi017.stdout: filestore ondisk finisher threads = 3 2024-09-05T07:28:09.143 INFO:teuthology.orchestra.run.smithi017.stdout: filestore apply finisher threads = 3 2024-09-05T07:28:09.143 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:28:09.143 INFO:teuthology.orchestra.run.smithi017.stdout: bdev debug aio = true 2024-09-05T07:28:09.143 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug misdirected ops = true 2024-09-05T07:28:09.143 INFO:teuthology.orchestra.run.smithi017.stdout: bdev async discard = True 2024-09-05T07:28:09.143 INFO:teuthology.orchestra.run.smithi017.stdout: bdev enable discard = True 2024-09-05T07:28:09.143 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore allocator = bitmap 2024-09-05T07:28:09.143 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore block size = 96636764160 2024-09-05T07:28:09.144 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore fsck on mount = True 2024-09-05T07:28:09.144 INFO:teuthology.orchestra.run.smithi017.stdout: debug bluefs = 1/20 2024-09-05T07:28:09.144 INFO:teuthology.orchestra.run.smithi017.stdout: debug bluestore = 1/20 2024-09-05T07:28:09.144 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-09-05T07:28:09.144 INFO:teuthology.orchestra.run.smithi017.stdout: debug osd = 20 2024-09-05T07:28:09.144 INFO:teuthology.orchestra.run.smithi017.stdout: debug rocksdb = 4/10 2024-09-05T07:28:09.144 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd backfillfull_ratio = 0.85 2024-09-05T07:28:09.144 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd full ratio = 0.9 2024-09-05T07:28:09.144 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd nearfull ratio = 0.8 2024-09-05T07:28:09.144 INFO:teuthology.orchestra.run.smithi017.stdout: osd failsafe full ratio = 0.95 2024-09-05T07:28:09.145 INFO:teuthology.orchestra.run.smithi017.stdout: osd fast shutdown = False 2024-09-05T07:28:09.145 INFO:teuthology.orchestra.run.smithi017.stdout: osd objectstore = bluestore 2024-09-05T07:28:09.145 INFO:teuthology.orchestra.run.smithi017.stdout: osd op complaint time = 180 2024-09-05T07:28:09.145 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:28:09.145 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr] 2024-09-05T07:28:09.145 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-09-05T07:28:09.145 INFO:teuthology.orchestra.run.smithi017.stdout: debug mgr = 20 2024-09-05T07:28:09.145 INFO:teuthology.orchestra.run.smithi017.stdout: debug mon = 20 2024-09-05T07:28:09.145 INFO:teuthology.orchestra.run.smithi017.stdout: debug auth = 20 2024-09-05T07:28:09.145 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min pgs per osd = 4 2024-09-05T07:28:09.146 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min bytes per osd = 10 2024-09-05T07:28:09.146 INFO:teuthology.orchestra.run.smithi017.stdout: mgr/telemetry/nag = false 2024-09-05T07:28:09.146 INFO:teuthology.orchestra.run.smithi017.stdout: debug client = 20 2024-09-05T07:28:09.146 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:28:09.146 INFO:teuthology.orchestra.run.smithi017.stdout:[mon] 2024-09-05T07:28:09.146 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-09-05T07:28:09.146 INFO:teuthology.orchestra.run.smithi017.stdout: debug mon = 20 2024-09-05T07:28:09.146 INFO:teuthology.orchestra.run.smithi017.stdout: debug paxos = 20 2024-09-05T07:28:09.146 INFO:teuthology.orchestra.run.smithi017.stdout: debug auth = 20 2024-09-05T07:28:09.147 INFO:teuthology.orchestra.run.smithi017.stdout: mon data avail warn = 5 2024-09-05T07:28:09.147 INFO:teuthology.orchestra.run.smithi017.stdout: mon mgr mkfs grace = 240 2024-09-05T07:28:09.147 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min pgs per osd = 4 2024-09-05T07:28:09.147 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd reporter subtree level = osd 2024-09-05T07:28:09.147 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd prime pg temp = true 2024-09-05T07:28:09.147 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min bytes per osd = 10 2024-09-05T07:28:09.147 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:28:09.147 INFO:teuthology.orchestra.run.smithi017.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-05T07:28:09.147 INFO:teuthology.orchestra.run.smithi017.stdout: auth mon ticket ttl = 660 # 11m 2024-09-05T07:28:09.147 INFO:teuthology.orchestra.run.smithi017.stdout: auth service ticket ttl = 240 # 4m 2024-09-05T07:28:09.147 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:28:09.147 INFO:teuthology.orchestra.run.smithi017.stdout: # don't complain about insecure global_id in the test suite 2024-09-05T07:28:09.147 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-05T07:28:09.148 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-05T07:28:09.148 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:28:09.148 INFO:teuthology.orchestra.run.smithi017.stdout: # 1m isn't quite enough 2024-09-05T07:28:09.148 INFO:teuthology.orchestra.run.smithi017.stdout: mon_down_mkfs_grace = 2m 2024-09-05T07:28:09.148 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:28:09.148 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_filestore_osds = false 2024-09-05T07:28:09.148 INFO:teuthology.orchestra.run.smithi017.stdout: mon down mkfs grace = 300 2024-09-05T07:28:09.148 INFO:teuthology.orchestra.run.smithi017.stdout: mon op complaint time = 120 2024-09-05T07:28:09.148 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd crush smoke test = False 2024-09-05T07:28:09.148 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on pool no app = False 2024-09-05T07:28:09.149 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:28:09.149 INFO:teuthology.orchestra.run.smithi017.stdout:[client] 2024-09-05T07:28:09.149 INFO:teuthology.orchestra.run.smithi017.stdout: rgw cache enabled = true 2024-09-05T07:28:09.149 INFO:teuthology.orchestra.run.smithi017.stdout: rgw enable ops log = true 2024-09-05T07:28:09.149 INFO:teuthology.orchestra.run.smithi017.stdout: rgw enable usage log = true 2024-09-05T07:28:09.149 INFO:teuthology.orchestra.run.smithi017.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-05T07:28:09.149 INFO:teuthology.orchestra.run.smithi017.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-05T07:28:09.149 INFO:teuthology.orchestra.run.smithi017.stdout: client mount timeout = 600 2024-09-05T07:28:09.149 INFO:teuthology.orchestra.run.smithi017.stdout: debug client = 20 2024-09-05T07:28:09.149 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-09-05T07:28:09.149 INFO:teuthology.orchestra.run.smithi017.stdout: rados mon op timeout = 900 2024-09-05T07:28:09.149 INFO:teuthology.orchestra.run.smithi017.stdout: rados osd op timeout = 900 2024-09-05T07:28:09.149 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.a] 2024-09-05T07:28:09.149 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.b] 2024-09-05T07:28:09.149 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.c] 2024-09-05T07:28:09.150 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.a] 2024-09-05T07:28:09.150 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.c] 2024-09-05T07:28:09.150 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.e] 2024-09-05T07:28:09.150 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.b] 2024-09-05T07:28:09.150 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.d] 2024-09-05T07:28:09.150 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.f] 2024-09-05T07:28:09.150 INFO:teuthology.orchestra.run.smithi017.stdout:[mds] 2024-09-05T07:28:09.150 INFO:teuthology.orchestra.run.smithi017.stdout: debug mds = 20 2024-09-05T07:28:09.150 INFO:teuthology.orchestra.run.smithi017.stdout: debug mds balancer = 20 2024-09-05T07:28:09.150 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-09-05T07:28:09.150 INFO:teuthology.orchestra.run.smithi017.stdout: mds debug frag = True 2024-09-05T07:28:09.150 INFO:teuthology.orchestra.run.smithi017.stdout: mds debug scatterstat = True 2024-09-05T07:28:09.150 INFO:teuthology.orchestra.run.smithi017.stdout: mds op complaint time = 180 2024-09-05T07:28:09.151 INFO:teuthology.orchestra.run.smithi017.stdout: mds valgrind exit = True 2024-09-05T07:28:09.151 INFO:teuthology.orchestra.run.smithi017.stdout: mds verify scatter = True 2024-09-05T07:28:09.151 INFO:teuthology.orchestra.run.smithi017.stdout: osd op complaint time = 180 2024-09-05T07:28:09.151 INFO:teuthology.orchestra.run.smithi017.stdout: rados mon op timeout = 900 2024-09-05T07:28:09.151 INFO:teuthology.orchestra.run.smithi017.stdout: rados osd op timeout = 900 2024-09-05T07:28:09.153 INFO:teuthology.orchestra.run.smithi026.stdout:[global] 2024-09-05T07:28:09.153 INFO:teuthology.orchestra.run.smithi026.stdout: chdir = "" 2024-09-05T07:28:09.154 INFO:teuthology.orchestra.run.smithi026.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-05T07:28:09.154 INFO:teuthology.orchestra.run.smithi026.stdout: auth supported = cephx 2024-09-05T07:28:09.154 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:28:09.154 INFO:teuthology.orchestra.run.smithi026.stdout: filestore xattr use omap = true 2024-09-05T07:28:09.154 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:28:09.154 INFO:teuthology.orchestra.run.smithi026.stdout: mon clock drift allowed = 1.000 2024-09-05T07:28:09.154 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:28:09.154 INFO:teuthology.orchestra.run.smithi026.stdout: osd crush chooseleaf type = 0 2024-09-05T07:28:09.154 INFO:teuthology.orchestra.run.smithi026.stdout: auth debug = true 2024-09-05T07:28:09.154 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:28:09.154 INFO:teuthology.orchestra.run.smithi026.stdout: ms die on old message = true 2024-09-05T07:28:09.154 INFO:teuthology.orchestra.run.smithi026.stdout: ms die on bug = true 2024-09-05T07:28:09.154 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:28:09.155 INFO:teuthology.orchestra.run.smithi026.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-05T07:28:09.155 INFO:teuthology.orchestra.run.smithi026.stdout: mon pg warn max object skew = 0 2024-09-05T07:28:09.155 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:28:09.155 INFO:teuthology.orchestra.run.smithi026.stdout: # disable pg_autoscaler by default for new pools 2024-09-05T07:28:09.155 INFO:teuthology.orchestra.run.smithi026.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-05T07:28:09.155 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:28:09.155 INFO:teuthology.orchestra.run.smithi026.stdout: osd pool default size = 2 2024-09-05T07:28:09.155 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:28:09.155 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd allow primary affinity = true 2024-09-05T07:28:09.155 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd allow pg remap = true 2024-09-05T07:28:09.155 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on legacy crush tunables = false 2024-09-05T07:28:09.155 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on crush straw calc version zero = false 2024-09-05T07:28:09.155 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on no sortbitwise = false 2024-09-05T07:28:09.156 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on osd down out interval zero = false 2024-09-05T07:28:09.156 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on too few osds = false 2024-09-05T07:28:09.156 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-05T07:28:09.156 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-05T07:28:09.156 INFO:teuthology.orchestra.run.smithi026.stdout: mon_allow_pool_size_one = true 2024-09-05T07:28:09.156 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:28:09.156 INFO:teuthology.orchestra.run.smithi026.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-05T07:28:09.156 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:28:09.156 INFO:teuthology.orchestra.run.smithi026.stdout: osd default data pool replay window = 5 2024-09-05T07:28:09.156 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:28:09.156 INFO:teuthology.orchestra.run.smithi026.stdout: mon allow pool delete = true 2024-09-05T07:28:09.156 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:28:09.156 INFO:teuthology.orchestra.run.smithi026.stdout: mon cluster log file level = debug 2024-09-05T07:28:09.157 INFO:teuthology.orchestra.run.smithi026.stdout: debug asserts on shutdown = true 2024-09-05T07:28:09.157 INFO:teuthology.orchestra.run.smithi026.stdout: mon health detail to clog = false 2024-09-05T07:28:09.157 INFO:teuthology.orchestra.run.smithi026.stdout: mon host = "172.21.15.17,172.21.15.26,[v2:172.21.15.26:3301,v1:172.21.15.26:6790]" 2024-09-05T07:28:09.157 INFO:teuthology.orchestra.run.smithi026.stdout: mds beacon grace = 60 2024-09-05T07:28:09.157 INFO:teuthology.orchestra.run.smithi026.stdout: mds heartbeat grace = 60 2024-09-05T07:28:09.157 INFO:teuthology.orchestra.run.smithi026.stdout: osd heartbeat grace = 60 2024-09-05T07:28:09.157 INFO:teuthology.orchestra.run.smithi026.stdout: fsid = 848dac54-74f8-48f3-8686-c6495dcb972b 2024-09-05T07:28:09.157 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:28:09.157 INFO:teuthology.orchestra.run.smithi026.stdout:[osd] 2024-09-05T07:28:09.157 INFO:teuthology.orchestra.run.smithi026.stdout: osd journal size = 100 2024-09-05T07:28:09.157 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:28:09.157 INFO:teuthology.orchestra.run.smithi026.stdout: osd scrub load threshold = 5.0 2024-09-05T07:28:09.157 INFO:teuthology.orchestra.run.smithi026.stdout: osd scrub max interval = 600 2024-09-05T07:28:09.157 INFO:teuthology.orchestra.run.smithi026.stdout: osd mclock profile = high_recovery_ops 2024-09-05T07:28:09.158 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:28:09.158 INFO:teuthology.orchestra.run.smithi026.stdout: osd recover clone overlap = true 2024-09-05T07:28:09.158 INFO:teuthology.orchestra.run.smithi026.stdout: osd recovery max chunk = 1048576 2024-09-05T07:28:09.158 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:28:09.158 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug shutdown = true 2024-09-05T07:28:09.158 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug op order = true 2024-09-05T07:28:09.158 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug verify stray on activate = true 2024-09-05T07:28:09.158 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug trim objects = true 2024-09-05T07:28:09.158 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:28:09.158 INFO:teuthology.orchestra.run.smithi026.stdout: osd open classes on start = true 2024-09-05T07:28:09.158 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug pg log writeout = true 2024-09-05T07:28:09.158 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:28:09.158 INFO:teuthology.orchestra.run.smithi026.stdout: osd deep scrub update digest min age = 30 2024-09-05T07:28:09.158 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:28:09.159 INFO:teuthology.orchestra.run.smithi026.stdout: osd map max advance = 10 2024-09-05T07:28:09.159 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:28:09.159 INFO:teuthology.orchestra.run.smithi026.stdout: journal zero on create = true 2024-09-05T07:28:09.159 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:28:09.159 INFO:teuthology.orchestra.run.smithi026.stdout: filestore ondisk finisher threads = 3 2024-09-05T07:28:09.159 INFO:teuthology.orchestra.run.smithi026.stdout: filestore apply finisher threads = 3 2024-09-05T07:28:09.159 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:28:09.159 INFO:teuthology.orchestra.run.smithi026.stdout: bdev debug aio = true 2024-09-05T07:28:09.159 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug misdirected ops = true 2024-09-05T07:28:09.159 INFO:teuthology.orchestra.run.smithi026.stdout: bdev async discard = True 2024-09-05T07:28:09.159 INFO:teuthology.orchestra.run.smithi026.stdout: bdev enable discard = True 2024-09-05T07:28:09.159 INFO:teuthology.orchestra.run.smithi026.stdout: bluestore allocator = bitmap 2024-09-05T07:28:09.159 INFO:teuthology.orchestra.run.smithi026.stdout: bluestore block size = 96636764160 2024-09-05T07:28:09.159 INFO:teuthology.orchestra.run.smithi026.stdout: bluestore fsck on mount = True 2024-09-05T07:28:09.160 INFO:teuthology.orchestra.run.smithi026.stdout: debug bluefs = 1/20 2024-09-05T07:28:09.160 INFO:teuthology.orchestra.run.smithi026.stdout: debug bluestore = 1/20 2024-09-05T07:28:09.160 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2024-09-05T07:28:09.160 INFO:teuthology.orchestra.run.smithi026.stdout: debug osd = 20 2024-09-05T07:28:09.160 INFO:teuthology.orchestra.run.smithi026.stdout: debug rocksdb = 4/10 2024-09-05T07:28:09.160 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd backfillfull_ratio = 0.85 2024-09-05T07:28:09.160 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd full ratio = 0.9 2024-09-05T07:28:09.160 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd nearfull ratio = 0.8 2024-09-05T07:28:09.160 INFO:teuthology.orchestra.run.smithi026.stdout: osd failsafe full ratio = 0.95 2024-09-05T07:28:09.160 INFO:teuthology.orchestra.run.smithi026.stdout: osd fast shutdown = False 2024-09-05T07:28:09.160 INFO:teuthology.orchestra.run.smithi026.stdout: osd objectstore = bluestore 2024-09-05T07:28:09.160 INFO:teuthology.orchestra.run.smithi026.stdout: osd op complaint time = 180 2024-09-05T07:28:09.160 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:28:09.160 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr] 2024-09-05T07:28:09.161 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2024-09-05T07:28:09.161 INFO:teuthology.orchestra.run.smithi026.stdout: debug mgr = 20 2024-09-05T07:28:09.161 INFO:teuthology.orchestra.run.smithi026.stdout: debug mon = 20 2024-09-05T07:28:09.161 INFO:teuthology.orchestra.run.smithi026.stdout: debug auth = 20 2024-09-05T07:28:09.161 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min pgs per osd = 4 2024-09-05T07:28:09.161 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min bytes per osd = 10 2024-09-05T07:28:09.161 INFO:teuthology.orchestra.run.smithi026.stdout: mgr/telemetry/nag = false 2024-09-05T07:28:09.161 INFO:teuthology.orchestra.run.smithi026.stdout: debug client = 20 2024-09-05T07:28:09.161 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:28:09.161 INFO:teuthology.orchestra.run.smithi026.stdout:[mon] 2024-09-05T07:28:09.161 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2024-09-05T07:28:09.161 INFO:teuthology.orchestra.run.smithi026.stdout: debug mon = 20 2024-09-05T07:28:09.161 INFO:teuthology.orchestra.run.smithi026.stdout: debug paxos = 20 2024-09-05T07:28:09.162 INFO:teuthology.orchestra.run.smithi026.stdout: debug auth = 20 2024-09-05T07:28:09.162 INFO:teuthology.orchestra.run.smithi026.stdout: mon data avail warn = 5 2024-09-05T07:28:09.162 INFO:teuthology.orchestra.run.smithi026.stdout: mon mgr mkfs grace = 240 2024-09-05T07:28:09.162 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min pgs per osd = 4 2024-09-05T07:28:09.162 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd reporter subtree level = osd 2024-09-05T07:28:09.162 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd prime pg temp = true 2024-09-05T07:28:09.162 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min bytes per osd = 10 2024-09-05T07:28:09.162 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:28:09.162 INFO:teuthology.orchestra.run.smithi026.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-05T07:28:09.162 INFO:teuthology.orchestra.run.smithi026.stdout: auth mon ticket ttl = 660 # 11m 2024-09-05T07:28:09.162 INFO:teuthology.orchestra.run.smithi026.stdout: auth service ticket ttl = 240 # 4m 2024-09-05T07:28:09.162 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:28:09.162 INFO:teuthology.orchestra.run.smithi026.stdout: # don't complain about insecure global_id in the test suite 2024-09-05T07:28:09.162 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-05T07:28:09.163 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-05T07:28:09.163 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:28:09.163 INFO:teuthology.orchestra.run.smithi026.stdout: # 1m isn't quite enough 2024-09-05T07:28:09.163 INFO:teuthology.orchestra.run.smithi026.stdout: mon_down_mkfs_grace = 2m 2024-09-05T07:28:09.163 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:28:09.163 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_filestore_osds = false 2024-09-05T07:28:09.163 INFO:teuthology.orchestra.run.smithi026.stdout: mon down mkfs grace = 300 2024-09-05T07:28:09.163 INFO:teuthology.orchestra.run.smithi026.stdout: mon op complaint time = 120 2024-09-05T07:28:09.163 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd crush smoke test = False 2024-09-05T07:28:09.163 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on pool no app = False 2024-09-05T07:28:09.163 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-05T07:28:09.163 INFO:teuthology.orchestra.run.smithi026.stdout:[client] 2024-09-05T07:28:09.163 INFO:teuthology.orchestra.run.smithi026.stdout: rgw cache enabled = true 2024-09-05T07:28:09.163 INFO:teuthology.orchestra.run.smithi026.stdout: rgw enable ops log = true 2024-09-05T07:28:09.163 INFO:teuthology.orchestra.run.smithi026.stdout: rgw enable usage log = true 2024-09-05T07:28:09.164 INFO:teuthology.orchestra.run.smithi026.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-05T07:28:09.164 INFO:teuthology.orchestra.run.smithi026.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-05T07:28:09.164 INFO:teuthology.orchestra.run.smithi026.stdout: client mount timeout = 600 2024-09-05T07:28:09.164 INFO:teuthology.orchestra.run.smithi026.stdout: debug client = 20 2024-09-05T07:28:09.164 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2024-09-05T07:28:09.164 INFO:teuthology.orchestra.run.smithi026.stdout: rados mon op timeout = 900 2024-09-05T07:28:09.164 INFO:teuthology.orchestra.run.smithi026.stdout: rados osd op timeout = 900 2024-09-05T07:28:09.164 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.a] 2024-09-05T07:28:09.164 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.b] 2024-09-05T07:28:09.164 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.c] 2024-09-05T07:28:09.164 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.a] 2024-09-05T07:28:09.164 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.c] 2024-09-05T07:28:09.164 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.e] 2024-09-05T07:28:09.164 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.b] 2024-09-05T07:28:09.165 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.d] 2024-09-05T07:28:09.165 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.f] 2024-09-05T07:28:09.165 INFO:teuthology.orchestra.run.smithi026.stdout:[mds] 2024-09-05T07:28:09.165 INFO:teuthology.orchestra.run.smithi026.stdout: debug mds = 20 2024-09-05T07:28:09.165 INFO:teuthology.orchestra.run.smithi026.stdout: debug mds balancer = 20 2024-09-05T07:28:09.165 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2024-09-05T07:28:09.165 INFO:teuthology.orchestra.run.smithi026.stdout: mds debug frag = True 2024-09-05T07:28:09.165 INFO:teuthology.orchestra.run.smithi026.stdout: mds debug scatterstat = True 2024-09-05T07:28:09.165 INFO:teuthology.orchestra.run.smithi026.stdout: mds op complaint time = 180 2024-09-05T07:28:09.165 INFO:teuthology.orchestra.run.smithi026.stdout: mds valgrind exit = True 2024-09-05T07:28:09.165 INFO:teuthology.orchestra.run.smithi026.stdout: mds verify scatter = True 2024-09-05T07:28:09.165 INFO:teuthology.orchestra.run.smithi026.stdout: osd op complaint time = 180 2024-09-05T07:28:09.165 INFO:teuthology.orchestra.run.smithi026.stdout: rados mon op timeout = 900 2024-09-05T07:28:09.165 INFO:teuthology.orchestra.run.smithi026.stdout: rados osd op timeout = 900 2024-09-05T07:28:09.166 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-05T07:28:09.166 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-05T07:28:09.248 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-05T07:28:09.248 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-05T07:28:09.248 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-05T07:28:09.263 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-05T07:28:09.263 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-05T07:28:09.318 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi017.front.sepia.ceph.com 2024-09-05T07:28:09.318 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-05T07:28:09.318 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-05T07:28:09.318 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-05T07:28:09.392 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-05T07:28:09.392 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-05T07:28:09.447 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi026.front.sepia.ceph.com 2024-09-05T07:28:09.448 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-05T07:28:09.448 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-05T07:28:09.448 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-05T07:28:09.484 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-05T07:28:09.485 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-05T07:28:09.541 INFO:tasks.ceph:Setting up mon nodes... 2024-09-05T07:28:09.541 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-05T07:28:09.541 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-05T07:28:09.591 INFO:teuthology.orchestra.run.smithi017.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-05T07:28:09.594 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-05T07:28:09.654 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-05T07:28:09.657 INFO:tasks.ceph:Setting up mds nodes... 2024-09-05T07:28:09.657 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-05T07:28:09.708 INFO:teuthology.orchestra.run.smithi017.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-05T07:28:09.710 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-05T07:28:09.735 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-05T07:28:09.825 INFO:teuthology.orchestra.run.smithi017.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-05T07:28:09.828 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-05T07:28:09.852 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-09-05T07:28:09.943 INFO:teuthology.orchestra.run.smithi017.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-09-05T07:28:09.946 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-09-05T07:28:09.970 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-05T07:28:10.023 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-05T07:28:10.026 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-05T07:28:10.051 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-05T07:28:10.141 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-05T07:28:10.143 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-05T07:28:10.167 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-09-05T07:28:10.258 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-09-05T07:28:10.260 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-09-05T07:28:10.284 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-05T07:28:10.285 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-05T07:28:10.327 INFO:teuthology.orchestra.run.smithi017.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-05T07:28:10.340 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-05T07:28:10.340 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi017.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi026.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-05T07:28:10.340 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-05T07:28:10.405 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-05T07:28:10.405 INFO:tasks.ceph:role: osd.0 2024-09-05T07:28:10.405 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-05T07:28:10.405 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-05T07:28:10.469 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-05T07:28:10.470 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-05T07:28:10.470 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-05T07:28:10.470 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-05T07:28:10.470 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-05T07:28:10.470 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2024-09-05T07:28:10.470 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-05T07:28:10.470 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-05T07:28:10.470 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-05T07:28:10.470 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-05T07:28:10.502 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2024-09-05T07:28:10.504 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2024-09-05T07:28:10.504 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-05T07:28:10.574 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-05T07:28:10.643 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-05T07:28:10.708 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-05T07:28:10.708 INFO:tasks.ceph:role: osd.1 2024-09-05T07:28:10.708 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-05T07:28:10.709 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-05T07:28:10.772 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-05T07:28:10.772 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-05T07:28:10.773 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-05T07:28:10.773 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-05T07:28:10.773 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-05T07:28:10.773 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2024-09-05T07:28:10.773 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-05T07:28:10.773 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-05T07:28:10.773 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-05T07:28:10.773 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-05T07:28:10.804 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2024-09-05T07:28:10.806 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2024-09-05T07:28:10.806 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-05T07:28:10.879 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-05T07:28:10.947 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-05T07:28:11.012 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-05T07:28:11.012 INFO:tasks.ceph:role: osd.2 2024-09-05T07:28:11.012 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-05T07:28:11.012 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-05T07:28:11.077 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-05T07:28:11.077 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-05T07:28:11.077 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-05T07:28:11.077 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-05T07:28:11.077 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-05T07:28:11.077 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2024-09-05T07:28:11.077 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-05T07:28:11.077 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-05T07:28:11.077 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-05T07:28:11.077 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-05T07:28:11.109 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2024-09-05T07:28:11.111 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2024-09-05T07:28:11.111 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-05T07:28:11.180 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-05T07:28:11.248 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-05T07:28:11.312 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-05T07:28:11.313 INFO:tasks.ceph:role: osd.3 2024-09-05T07:28:11.313 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-05T07:28:11.313 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-05T07:28:11.382 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-05T07:28:11.382 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-05T07:28:11.382 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-05T07:28:11.382 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-05T07:28:11.382 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-05T07:28:11.383 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2024-09-05T07:28:11.383 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-05T07:28:11.383 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-05T07:28:11.383 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-05T07:28:11.383 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-05T07:28:11.415 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2024-09-05T07:28:11.416 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2024-09-05T07:28:11.417 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-05T07:28:11.486 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-05T07:28:11.555 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-05T07:28:11.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:11.647+0000 7fda2ea33640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-05T07:28:11.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:11.647+0000 7fda2ea33640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-05T07:28:11.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:11.647+0000 7fda2ea33640 -1 bdev(0x55a1bb179800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-05T07:28:11.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:11.647+0000 7fda2ea33640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-05T07:28:15.054 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-05T07:28:15.084 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-05T07:28:15.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:15.173+0000 7f8e46624640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-05T07:28:15.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:15.174+0000 7f8e46624640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-05T07:28:15.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:15.174+0000 7f8e46624640 -1 bdev(0x557e8a7b1800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-05T07:28:15.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:15.174+0000 7f8e46624640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-05T07:28:18.588 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-05T07:28:18.618 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-05T07:28:18.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:18.707+0000 7fe800730640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-05T07:28:18.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:18.708+0000 7fe800730640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-05T07:28:18.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:18.708+0000 7fe800730640 -1 bdev(0x556f9502b800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-05T07:28:18.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:18.708+0000 7fe800730640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-05T07:28:21.866 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-05T07:28:21.896 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-05T07:28:21.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:21.987+0000 7fb1e5f25640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-05T07:28:21.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:21.987+0000 7fb1e5f25640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-05T07:28:21.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:21.987+0000 7fb1e5f25640 -1 bdev(0x5619fb7c5800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-05T07:28:21.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:21.987+0000 7fb1e5f25640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-05T07:28:24.907 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-05T07:28:24.936 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-05T07:28:24.966 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-05T07:28:24.967 INFO:tasks.ceph:role: osd.4 2024-09-05T07:28:24.967 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi026.front.sepia.ceph.com 2024-09-05T07:28:24.967 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-05T07:28:25.035 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-05T07:28:25.035 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-05T07:28:25.035 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-05T07:28:25.035 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-05T07:28:25.035 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-05T07:28:25.036 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2024-09-05T07:28:25.036 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-05T07:28:25.036 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-05T07:28:25.036 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-05T07:28:25.036 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-05T07:28:25.069 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2024-09-05T07:28:25.071 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2024-09-05T07:28:25.071 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-05T07:28:25.143 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-05T07:28:25.213 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-05T07:28:25.281 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-05T07:28:25.281 INFO:tasks.ceph:role: osd.5 2024-09-05T07:28:25.281 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi026.front.sepia.ceph.com 2024-09-05T07:28:25.281 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-05T07:28:25.346 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-05T07:28:25.346 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-05T07:28:25.346 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-05T07:28:25.346 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-05T07:28:25.346 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-05T07:28:25.346 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2024-09-05T07:28:25.346 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-05T07:28:25.346 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-05T07:28:25.346 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-05T07:28:25.347 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-05T07:28:25.379 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2024-09-05T07:28:25.381 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2024-09-05T07:28:25.381 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-05T07:28:25.448 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-05T07:28:25.518 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-05T07:28:25.583 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-05T07:28:25.583 INFO:tasks.ceph:role: osd.6 2024-09-05T07:28:25.583 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi026.front.sepia.ceph.com 2024-09-05T07:28:25.583 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-05T07:28:25.647 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-05T07:28:25.648 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-05T07:28:25.648 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-05T07:28:25.648 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-05T07:28:25.648 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-05T07:28:25.648 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2024-09-05T07:28:25.648 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-05T07:28:25.648 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-05T07:28:25.648 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-05T07:28:25.648 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-05T07:28:25.680 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2024-09-05T07:28:25.683 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2024-09-05T07:28:25.683 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-05T07:28:25.751 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-05T07:28:25.821 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-05T07:28:25.885 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-05T07:28:25.885 INFO:tasks.ceph:role: osd.7 2024-09-05T07:28:25.885 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi026.front.sepia.ceph.com 2024-09-05T07:28:25.886 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-05T07:28:25.949 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-05T07:28:25.949 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-05T07:28:25.949 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-05T07:28:25.950 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-05T07:28:25.950 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-05T07:28:25.950 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2024-09-05T07:28:25.950 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-05T07:28:25.950 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-05T07:28:25.950 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-05T07:28:25.950 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-05T07:28:25.981 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2024-09-05T07:28:25.983 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2024-09-05T07:28:25.983 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-05T07:28:26.057 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-05T07:28:26.127 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-05T07:28:26.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:26.217+0000 7f40d3c11640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-05T07:28:26.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:26.218+0000 7f40d3c11640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-05T07:28:26.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:26.218+0000 7f40d3c11640 -1 bdev(0x55b75880b800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-05T07:28:26.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:26.218+0000 7f40d3c11640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-05T07:28:29.397 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-05T07:28:29.427 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-05T07:28:29.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:29.517+0000 7ff6df40b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-05T07:28:29.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:29.517+0000 7ff6df40b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-05T07:28:29.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:29.517+0000 7ff6df40b640 -1 bdev(0x556aed1af800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-05T07:28:29.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:29.518+0000 7ff6df40b640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-05T07:28:32.443 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-05T07:28:32.472 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-05T07:28:32.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:32.562+0000 7f46faa18640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-05T07:28:32.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:32.562+0000 7f46faa18640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-05T07:28:32.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:32.562+0000 7f46faa18640 -1 bdev(0x563a59d7d800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-05T07:28:32.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:32.563+0000 7f46faa18640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-05T07:28:35.733 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-05T07:28:35.762 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-05T07:28:35.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:35.852+0000 7fb9d102c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-05T07:28:35.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:35.852+0000 7fb9d102c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-05T07:28:35.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:35.852+0000 7fb9d102c640 -1 bdev(0x56467afa3800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-05T07:28:35.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:35.852+0000 7fb9d102c640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-05T07:28:37.184 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:28:37.186 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:28:39.512 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-05T07:28:39.541 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-05T07:28:39.542 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-05T07:28:39.542 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-05T07:28:39.571 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-05T07:28:39.571 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-05T07:28:39.639 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-05T07:28:39.640 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-05T07:28:39.707 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-05T07:28:39.707 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-09-05T07:28:39.774 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-05T07:28:39.775 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-05T07:28:39.840 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-05T07:28:39.840 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-05T07:28:39.906 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-05T07:28:39.906 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-05T07:28:39.971 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-05T07:28:39.971 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-05T07:28:40.037 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-05T07:28:40.037 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-05T07:28:40.066 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-05T07:28:40.066 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-05T07:28:40.135 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-05T07:28:40.135 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-05T07:28:40.203 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-05T07:28:40.204 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-09-05T07:28:40.271 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-05T07:28:40.272 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-05T07:28:40.340 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-05T07:28:40.340 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-05T07:28:40.408 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-05T07:28:40.408 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-05T07:28:40.476 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-05T07:28:40.476 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-05T07:28:40.543 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-05T07:28:40.543 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-05T07:28:40.562 INFO:tasks.ceph:Adding keys to all mons... 2024-09-05T07:28:40.562 DEBUG:teuthology.orchestra.run.smithi017:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-05T07:28:40.605 DEBUG:teuthology.orchestra.run.smithi026:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-05T07:28:40.630 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr.y] 2024-09-05T07:28:40.630 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQCJXdlmFOJRIxAAzd6QDkNGSPHoC5Gz3ti2Sw== 2024-09-05T07:28:40.630 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.a] 2024-09-05T07:28:40.630 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQCJXdlmEAU9KhAAYcEXtv1CzTJgn4VMILCQ7Q== 2024-09-05T07:28:40.630 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.c] 2024-09-05T07:28:40.630 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQCJXdlmhiRCMRAAQYCzPFL5GdX2akmGibZbiA== 2024-09-05T07:28:40.630 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.e] 2024-09-05T07:28:40.630 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQCJXdlmmLJJOBAA1/LTHaL1qzYR+gqXoS2Ntg== 2024-09-05T07:28:40.631 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.0] 2024-09-05T07:28:40.631 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQCLXdlmQlWvJhAAD5V8+ktb8go3d8n1DPef+w== 2024-09-05T07:28:40.631 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.1] 2024-09-05T07:28:40.631 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQCPXdlmVXhsChAAeQtEl9hrGVATDr99QVTNAg== 2024-09-05T07:28:40.631 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.2] 2024-09-05T07:28:40.631 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQCSXdlmQv4/KhAArjGW2rfQLoWoD3nQo6xxmA== 2024-09-05T07:28:40.631 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.3] 2024-09-05T07:28:40.631 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQCVXdlmKD3pOhAABaNAo1ua2G/5nfz3zY1uyg== 2024-09-05T07:28:40.631 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr.x] 2024-09-05T07:28:40.631 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQCJXdlm4eINJxAAROC8fV4u89e91P06bR3jjw== 2024-09-05T07:28:40.631 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.b] 2024-09-05T07:28:40.631 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQCKXdlm1XZ1ARAAmCtHItNiokpfAwJmgVx/Rg== 2024-09-05T07:28:40.632 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.d] 2024-09-05T07:28:40.632 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQCKXdlmLCByCBAA3OS9GkfyV1ekRNbytonfoQ== 2024-09-05T07:28:40.632 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.f] 2024-09-05T07:28:40.632 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQCKXdlmiztxDxAA0fMfLKCYUP7Nss1jbV78FA== 2024-09-05T07:28:40.632 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.4] 2024-09-05T07:28:40.632 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQCaXdlmh9URDRAAeoygXC1QHxTaQYHAcAN1xA== 2024-09-05T07:28:40.632 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.5] 2024-09-05T07:28:40.632 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQCdXdlmTkrvHhAAc6atq2xHRMpZq5sD3y6rrg== 2024-09-05T07:28:40.632 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.6] 2024-09-05T07:28:40.632 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQCgXdlmQCGeIRAAgMLc/2FK3vlWaqxQXguvrQ== 2024-09-05T07:28:40.633 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.7] 2024-09-05T07:28:40.633 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQCjXdlm8i/kMhAA9GWcyxvUOkA0Ghx0hYccOw== 2024-09-05T07:28:40.633 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2024-09-05T07:28:40.633 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQCKXdlm0kaTExAAU/qr8Li7j4rJbup1Ed/snw== 2024-09-05T07:28:40.634 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr.y] 2024-09-05T07:28:40.634 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCJXdlmFOJRIxAAzd6QDkNGSPHoC5Gz3ti2Sw== 2024-09-05T07:28:40.634 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.a] 2024-09-05T07:28:40.634 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCJXdlmEAU9KhAAYcEXtv1CzTJgn4VMILCQ7Q== 2024-09-05T07:28:40.634 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.c] 2024-09-05T07:28:40.635 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCJXdlmhiRCMRAAQYCzPFL5GdX2akmGibZbiA== 2024-09-05T07:28:40.635 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.e] 2024-09-05T07:28:40.635 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCJXdlmmLJJOBAA1/LTHaL1qzYR+gqXoS2Ntg== 2024-09-05T07:28:40.635 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.0] 2024-09-05T07:28:40.635 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCLXdlmQlWvJhAAD5V8+ktb8go3d8n1DPef+w== 2024-09-05T07:28:40.635 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.1] 2024-09-05T07:28:40.635 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCPXdlmVXhsChAAeQtEl9hrGVATDr99QVTNAg== 2024-09-05T07:28:40.635 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.2] 2024-09-05T07:28:40.635 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCSXdlmQv4/KhAArjGW2rfQLoWoD3nQo6xxmA== 2024-09-05T07:28:40.636 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.3] 2024-09-05T07:28:40.636 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCVXdlmKD3pOhAABaNAo1ua2G/5nfz3zY1uyg== 2024-09-05T07:28:40.636 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr.x] 2024-09-05T07:28:40.636 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCJXdlm4eINJxAAROC8fV4u89e91P06bR3jjw== 2024-09-05T07:28:40.636 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.b] 2024-09-05T07:28:40.636 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCKXdlm1XZ1ARAAmCtHItNiokpfAwJmgVx/Rg== 2024-09-05T07:28:40.636 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.d] 2024-09-05T07:28:40.636 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCKXdlmLCByCBAA3OS9GkfyV1ekRNbytonfoQ== 2024-09-05T07:28:40.636 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.f] 2024-09-05T07:28:40.636 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCKXdlmiztxDxAA0fMfLKCYUP7Nss1jbV78FA== 2024-09-05T07:28:40.636 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.4] 2024-09-05T07:28:40.636 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCaXdlmh9URDRAAeoygXC1QHxTaQYHAcAN1xA== 2024-09-05T07:28:40.636 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.5] 2024-09-05T07:28:40.636 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCdXdlmTkrvHhAAc6atq2xHRMpZq5sD3y6rrg== 2024-09-05T07:28:40.637 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.6] 2024-09-05T07:28:40.637 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCgXdlmQCGeIRAAgMLc/2FK3vlWaqxQXguvrQ== 2024-09-05T07:28:40.637 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.7] 2024-09-05T07:28:40.637 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCjXdlm8i/kMhAA9GWcyxvUOkA0Ghx0hYccOw== 2024-09-05T07:28:40.637 INFO:teuthology.orchestra.run.smithi026.stdout:[client.0] 2024-09-05T07:28:40.637 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCKXdlm0kaTExAAU/qr8Li7j4rJbup1Ed/snw== 2024-09-05T07:28:40.637 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-05T07:28:40.677 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-05T07:28:40.732 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-05T07:28:40.736 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-05T07:28:40.791 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-05T07:28:40.794 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-05T07:28:40.848 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-05T07:28:40.850 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-05T07:28:40.903 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T07:28:40.906 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T07:28:40.956 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T07:28:40.958 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T07:28:41.008 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T07:28:41.010 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T07:28:41.061 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T07:28:41.063 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T07:28:41.113 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-05T07:28:41.116 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-05T07:28:41.166 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-05T07:28:41.168 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-05T07:28:41.221 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-05T07:28:41.223 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-05T07:28:41.276 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-05T07:28:41.279 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-05T07:28:41.332 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T07:28:41.334 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T07:28:41.385 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T07:28:41.388 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T07:28:41.438 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T07:28:41.442 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T07:28:41.492 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T07:28:41.494 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T07:28:41.544 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-05T07:28:41.547 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-05T07:28:41.600 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-05T07:28:41.601 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-05T07:28:41.625 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-05T07:28:41.722 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-05T07:28:41.746 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-05T07:28:41.771 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-05T07:28:41.866 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-05T07:28:41.890 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-05T07:28:41.955 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-05T07:28:42.049 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-05T07:28:42.073 DEBUG:teuthology.orchestra.run.smithi017:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-05T07:28:42.075 DEBUG:teuthology.orchestra.run.smithi026:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-05T07:28:42.128 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-05T07:28:42.129 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-09-05T07:28:42.129 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-05T07:28:42.129 DEBUG:teuthology.orchestra.run.smithi017:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2024-09-05T07:28:42.131 INFO:tasks.ceph.mon.a:Started 2024-09-05T07:28:42.132 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-09-05T07:28:42.132 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-05T07:28:42.132 DEBUG:teuthology.orchestra.run.smithi026:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2024-09-05T07:28:42.171 INFO:tasks.ceph.mon.b:Started 2024-09-05T07:28:42.171 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-09-05T07:28:42.171 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-05T07:28:42.171 DEBUG:teuthology.orchestra.run.smithi026:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2024-09-05T07:28:42.173 INFO:tasks.ceph.mon.c:Started 2024-09-05T07:28:42.173 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-05T07:28:42.174 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-05T07:28:42.174 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2024-09-05T07:28:42.176 INFO:tasks.ceph.mgr.y:Started 2024-09-05T07:28:42.176 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-05T07:28:42.176 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2024-09-05T07:28:42.178 INFO:tasks.ceph.mgr.x:Started 2024-09-05T07:28:42.179 INFO:tasks.ceph:Setting crush tunables to default 2024-09-05T07:28:42.179 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph osd crush tunables default 2024-09-05T07:28:42.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:42.278+0000 7fe91ac82640 1 Processor -- start 2024-09-05T07:28:42.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:42.278+0000 7fe91ac82640 1 -- start start 2024-09-05T07:28:42.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:42.279+0000 7fe91ac82640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe9141516e0 0x7fe9140c3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:42.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:42.279+0000 7fe91ac82640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe9140705b0 0x7fe9140c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:42.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:42.279+0000 7fe91ac82640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe91415bd10 con 0x7fe914151ac0 2024-09-05T07:28:42.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:42.279+0000 7fe91ac82640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fe9140c5670 con 0x7fe9141516e0 2024-09-05T07:28:42.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:42.279+0000 7fe91ac82640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fe91415aeb0 con 0x7fe9140705b0 2024-09-05T07:28:42.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:42.279+0000 7fe918a1e640 1 -- >> v2:172.21.15.17:3300/0 conn(0x7fe9141516e0 msgr2=0x7fe9140c3d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.17:3300/0 2024-09-05T07:28:42.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:42.279+0000 7fe90bfff640 1 -- >> v1:172.21.15.17:6789/0 conn(0x7fe914151ac0 legacy=0x7fe9140c8340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.17:6789/0 2024-09-05T07:28:42.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:42.279+0000 7fe918a1e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe9141516e0 0x7fe9140c3d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-05T07:28:42.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:42.279+0000 7fe91921f640 1 -- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe9140705b0 msgr2=0x7fe9140c5c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3301/0 2024-09-05T07:28:42.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:42.279+0000 7fe91921f640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe9140705b0 0x7fe9140c5c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-05T07:28:42.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:42.480+0000 7fe918a1e640 1 -- >> v2:172.21.15.17:3300/0 conn(0x7fe9141516e0 msgr2=0x7fe9140c3d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.17:3300/0 2024-09-05T07:28:42.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:42.480+0000 7fe90bfff640 1 -- >> v1:172.21.15.17:6789/0 conn(0x7fe914151ac0 legacy=0x7fe9140c8340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.17:6789/0 2024-09-05T07:28:42.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:42.480+0000 7fe918a1e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe9141516e0 0x7fe9140c3d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-05T07:28:42.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:42.480+0000 7fe91921f640 1 -- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe9140705b0 msgr2=0x7fe9140c5c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3301/0 2024-09-05T07:28:42.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:42.480+0000 7fe91921f640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe9140705b0 0x7fe9140c5c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-05T07:28:42.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:42.881+0000 7fe918a1e640 1 -- >> v2:172.21.15.17:3300/0 conn(0x7fe9141516e0 msgr2=0x7fe9140c3d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.17:3300/0 2024-09-05T07:28:42.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:42.881+0000 7fe90bfff640 1 -- >> v1:172.21.15.17:6789/0 conn(0x7fe914151ac0 legacy=0x7fe9140c8340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.17:6789/0 2024-09-05T07:28:42.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:42.881+0000 7fe918a1e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe9141516e0 0x7fe9140c3d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-05T07:28:42.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:42.881+0000 7fe91921f640 1 -- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe9140705b0 msgr2=0x7fe9140c5c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3301/0 2024-09-05T07:28:42.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:42.881+0000 7fe91921f640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe9140705b0 0x7fe9140c5c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-05T07:28:43.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:43.682+0000 7fe918a1e640 1 -- >> v2:172.21.15.17:3300/0 conn(0x7fe9141516e0 msgr2=0x7fe9140c3d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.17:3300/0 2024-09-05T07:28:43.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:43.682+0000 7fe90bfff640 1 -- >> v1:172.21.15.17:6789/0 conn(0x7fe914151ac0 legacy=0x7fe9140c8340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.17:6789/0 2024-09-05T07:28:43.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:43.682+0000 7fe918a1e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe9141516e0 0x7fe9140c3d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-05T07:28:43.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:43.682+0000 7fe91921f640 1 -- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe9140705b0 msgr2=0x7fe9140c5c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3301/0 2024-09-05T07:28:43.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:43.682+0000 7fe91921f640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe9140705b0 0x7fe9140c5c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-05T07:28:45.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:45.279+0000 7fe90a7fc640 1 -- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe9140705b0 msgr2=0x7fe9140c5c30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T07:28:45.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:45.279+0000 7fe90a7fc640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe9140705b0 0x7fe9140c5c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:45.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:45.279+0000 7fe90a7fc640 1 -- >> v2:172.21.15.17:3300/0 conn(0x7fe9141516e0 msgr2=0x7fe9140c3d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T07:28:45.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:45.279+0000 7fe90a7fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe9141516e0 0x7fe9140c3d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:45.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:45.279+0000 7fe90a7fc640 1 -- >> v1:172.21.15.17:6789/0 conn(0x7fe914151ac0 legacy=0x7fe9140c8340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T07:28:45.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:45.279+0000 7fe90a7fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe900009610 0x7fe90000bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:45.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:45.279+0000 7fe90a7fc640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe91415b190 con 0x7fe9000058d0 2024-09-05T07:28:45.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:45.279+0000 7fe90a7fc640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fe9140c5670 con 0x7fe900009610 2024-09-05T07:28:45.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:45.279+0000 7fe918a1e640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7fe9000058d0 legacy=0x7fe900007d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-09-05T07:28:45.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:45.279+0000 7fe90bfff640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7fe900009610 msgr2=0x7fe90000bad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-09-05T07:28:45.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:45.279+0000 7fe90bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe900009610 0x7fe90000bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-05T07:28:45.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:45.480+0000 7fe918a1e640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7fe9000058d0 legacy=0x7fe900007d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-09-05T07:28:45.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:45.480+0000 7fe90bfff640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7fe900009610 msgr2=0x7fe90000bad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-09-05T07:28:45.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:45.480+0000 7fe90bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe900009610 0x7fe90000bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-05T07:28:45.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:45.881+0000 7fe918a1e640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7fe9000058d0 legacy=0x7fe900007d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-09-05T07:28:45.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:45.881+0000 7fe90bfff640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7fe900009610 msgr2=0x7fe90000bad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-09-05T07:28:45.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:45.881+0000 7fe90bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe900009610 0x7fe90000bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-05T07:28:46.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:46.682+0000 7fe918a1e640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7fe9000058d0 legacy=0x7fe900007d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-09-05T07:28:46.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:46.682+0000 7fe90bfff640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7fe900009610 msgr2=0x7fe90000bad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-09-05T07:28:46.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:46.682+0000 7fe90bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe900009610 0x7fe90000bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-05T07:28:48.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:48.279+0000 7fe90a7fc640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7fe900009610 msgr2=0x7fe90000bad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T07:28:48.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:48.279+0000 7fe90a7fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe900009610 0x7fe90000bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:48.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:48.279+0000 7fe90a7fc640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7fe9000058d0 legacy=0x7fe900007d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T07:28:48.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:48.279+0000 7fe91921f640 1 -- reap_dead start 2024-09-05T07:28:48.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:48.279+0000 7fe90a7fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe90000cc60 0x7fe90000bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:48.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:48.279+0000 7fe90a7fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe900007d20 0x7fe90000f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:48.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:48.279+0000 7fe90a7fc640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe91415bd10 con 0x7fe90000c170 2024-09-05T07:28:48.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:48.279+0000 7fe90a7fc640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fe9140c5670 con 0x7fe90000cc60 2024-09-05T07:28:48.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:48.279+0000 7fe90a7fc640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fe91415aeb0 con 0x7fe900007d20 2024-09-05T07:28:48.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:48.279+0000 7fe90bfff640 1 -- >> v2:172.21.15.17:3300/0 conn(0x7fe90000cc60 msgr2=0x7fe90000bad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.17:3300/0 2024-09-05T07:28:48.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:48.279+0000 7fe91921f640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7fe900007d20 msgr2=0x7fe90000f300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-09-05T07:28:48.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:48.279+0000 7fe90bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe90000cc60 0x7fe90000bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-05T07:28:48.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:48.279+0000 7fe918a1e640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7fe90000c170 legacy=0x7fe90000c550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-09-05T07:28:48.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:48.279+0000 7fe91921f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe900007d20 0x7fe90000f300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-05T07:28:48.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:48.480+0000 7fe90bfff640 1 -- >> v2:172.21.15.17:3300/0 conn(0x7fe90000cc60 msgr2=0x7fe90000bad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.17:3300/0 2024-09-05T07:28:48.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:48.480+0000 7fe918a1e640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7fe90000c170 legacy=0x7fe90000c550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-09-05T07:28:48.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:48.480+0000 7fe91921f640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7fe900007d20 msgr2=0x7fe90000f300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-09-05T07:28:48.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:48.480+0000 7fe90bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe90000cc60 0x7fe90000bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-05T07:28:48.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:48.480+0000 7fe91921f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe900007d20 0x7fe90000f300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-05T07:28:48.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:48.881+0000 7fe90bfff640 1 -- >> v2:172.21.15.17:3300/0 conn(0x7fe90000cc60 msgr2=0x7fe90000bad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.17:3300/0 2024-09-05T07:28:48.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:48.881+0000 7fe918a1e640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7fe90000c170 legacy=0x7fe90000c550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-09-05T07:28:48.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:48.881+0000 7fe90bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe90000cc60 0x7fe90000bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-05T07:28:48.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:48.881+0000 7fe91921f640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7fe900007d20 msgr2=0x7fe90000f300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-09-05T07:28:48.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:48.881+0000 7fe91921f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe900007d20 0x7fe90000f300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-05T07:28:49.638 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:00:07.378 36173== Warning: unimplemented fcntl command: 1036 2024-09-05T07:28:49.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:49.682+0000 7fe90bfff640 1 -- >> v2:172.21.15.17:3300/0 conn(0x7fe90000cc60 msgr2=0x7fe90000bad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.17:3300/0 2024-09-05T07:28:49.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:49.682+0000 7fe91921f640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7fe900007d20 msgr2=0x7fe90000f300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-09-05T07:28:49.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:49.682+0000 7fe918a1e640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7fe90000c170 legacy=0x7fe90000c550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-09-05T07:28:49.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:49.682+0000 7fe90bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe90000cc60 0x7fe90000bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-05T07:28:49.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:49.682+0000 7fe91921f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe900007d20 0x7fe90000f300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-05T07:28:49.711 INFO:tasks.ceph.mon.b.smithi026.stderr:==00:00:00:07.419 36185== Warning: unimplemented fcntl command: 1036 2024-09-05T07:28:49.719 INFO:tasks.ceph.mon.c.smithi026.stderr:==00:00:00:07.428 36186== Warning: unimplemented fcntl command: 1036 2024-09-05T07:28:49.970 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:00:07.710 36173== Warning: unimplemented fcntl command: 1036 2024-09-05T07:28:50.043 INFO:tasks.ceph.mon.b.smithi026.stderr:==00:00:00:07.751 36185== Warning: unimplemented fcntl command: 1036 2024-09-05T07:28:50.052 INFO:tasks.ceph.mon.c.smithi026.stderr:==00:00:00:07.761 36186== Warning: unimplemented fcntl command: 1036 2024-09-05T07:28:51.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:51.279+0000 7fe90a7fc640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7fe900007d20 msgr2=0x7fe90000f300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T07:28:51.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:51.279+0000 7fe90a7fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe900007d20 0x7fe90000f300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:51.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:51.279+0000 7fe90a7fc640 1 -- >> v2:172.21.15.17:3300/0 conn(0x7fe90000cc60 msgr2=0x7fe90000bad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T07:28:51.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:51.279+0000 7fe90a7fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe90000cc60 0x7fe90000bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:51.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:51.279+0000 7fe90a7fc640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7fe90000c170 legacy=0x7fe90000c550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T07:28:51.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:51.279+0000 7fe90a7fc640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe900010440 0x7fe900015900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:51.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:51.279+0000 7fe90a7fc640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe91415b190 con 0x7fe90000f880 2024-09-05T07:28:51.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:51.279+0000 7fe90a7fc640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fe9140c5670 con 0x7fe900010440 2024-09-05T07:28:51.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:51.279+0000 7fe90bfff640 1 -- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe900010440 msgr2=0x7fe900015900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3301/0 2024-09-05T07:28:51.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:51.279+0000 7fe90bfff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe900010440 0x7fe900015900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-05T07:28:51.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:51.489+0000 7fe918a1e640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fe90000f880 0x7fe90000fc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:38570/0 (socket says 172.21.15.17:38570) 2024-09-05T07:28:51.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:51.489+0000 7fe918a1e640 1 -- 172.21.15.17:0/942177311 learned_addr learned my addr 172.21.15.17:0/942177311 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:28:51.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:51.584+0000 7fe90bfff640 1 --2- 172.21.15.17:0/942177311 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe900010440 0x7fe900015900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:51.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:51.650+0000 7fe90bfff640 1 -- 172.21.15.17:0/942177311 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe900010440 msgr2=0x7fe900015900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-05T07:28:51.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:51.650+0000 7fe90bfff640 1 -- 172.21.15.17:0/942177311 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe900010440 msgr2=0x7fe900015900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-05T07:28:51.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:51.650+0000 7fe90bfff640 1 --2- 172.21.15.17:0/942177311 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe900010440 0x7fe900015900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-05T07:28:51.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:51.650+0000 7fe90bfff640 1 --2- 172.21.15.17:0/942177311 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe900010440 0x7fe900015900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-05T07:28:51.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:51.753+0000 7fe918a1e640 1 -- 172.21.15.17:0/942177311 >> v1:172.21.15.17:6789/0 conn(0x7fe90000f880 legacy=0x7fe90000fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-05T07:28:51.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:51.753+0000 7fe918a1e640 1 -- 172.21.15.17:0/942177311 >> v1:172.21.15.17:6789/0 conn(0x7fe90000f880 legacy=0x7fe90000fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-05T07:28:51.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:51.753+0000 7fe918a1e640 1 --1- 172.21.15.17:0/942177311 >> v1:172.21.15.17:6789/0 conn(0x7fe90000f880 0x7fe90000fc90 :-1 s=OPENED pgs=1 cs=1 l=1).handle_message read tag failed 2024-09-05T07:28:51.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:51.753+0000 7fe918a1e640 1 --1- 172.21.15.17:0/942177311 >> v1:172.21.15.17:6789/0 conn(0x7fe90000f880 0x7fe90000fc90 :-1 s=OPENED pgs=1 cs=1 l=1).fault on lossy channel, failing 2024-09-05T07:28:52.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:52.261+0000 7fe90bfff640 1 --2- 172.21.15.17:0/942177311 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe900010440 0x7fe900015900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:52.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:52.283+0000 7fe90bfff640 1 -- 172.21.15.17:0/942177311 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe900010440 msgr2=0x7fe900015900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-05T07:28:52.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:52.283+0000 7fe90bfff640 1 -- 172.21.15.17:0/942177311 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe900010440 msgr2=0x7fe900015900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-05T07:28:52.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:52.283+0000 7fe90bfff640 1 --2- 172.21.15.17:0/942177311 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe900010440 0x7fe900015900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-05T07:28:52.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:52.283+0000 7fe90bfff640 1 --2- 172.21.15.17:0/942177311 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe900010440 0x7fe900015900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-05T07:28:53.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:53.084+0000 7fe90bfff640 1 --2- 172.21.15.17:0/942177311 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe900010440 0x7fe900015900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:53.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:53.090+0000 7fe90bfff640 1 -- 172.21.15.17:0/942177311 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe900010440 msgr2=0x7fe900015900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-05T07:28:53.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:53.090+0000 7fe90bfff640 1 -- 172.21.15.17:0/942177311 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe900010440 msgr2=0x7fe900015900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-05T07:28:53.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:53.090+0000 7fe90bfff640 1 --2- 172.21.15.17:0/942177311 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe900010440 0x7fe900015900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-05T07:28:53.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:53.090+0000 7fe90bfff640 1 --2- 172.21.15.17:0/942177311 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe900010440 0x7fe900015900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-05T07:28:54.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:54.280+0000 7fe90a7fc640 1 -- 172.21.15.17:0/942177311 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe900010440 msgr2=0x7fe900015900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T07:28:54.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:54.280+0000 7fe90a7fc640 1 --2- 172.21.15.17:0/942177311 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe900010440 0x7fe900015900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:54.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:54.280+0000 7fe90a7fc640 1 -- 172.21.15.17:0/942177311 >> v1:172.21.15.17:6789/0 conn(0x7fe90000f880 legacy=0x7fe90000fc90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-05T07:28:54.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:54.280+0000 7fe91921f640 1 -- 172.21.15.17:0/942177311 reap_dead start 2024-09-05T07:28:54.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:54.280+0000 7fe90a7fc640 1 --2- 172.21.15.17:0/942177311 >> v2:172.21.15.26:3300/0 conn(0x7fe90000c1f0 0x7fe90000f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:54.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:54.280+0000 7fe90a7fc640 1 --2- 172.21.15.17:0/942177311 >> v2:172.21.15.17:3300/0 conn(0x7fe90000c7f0 0x7fe90000bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:54.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:54.280+0000 7fe90a7fc640 1 -- 172.21.15.17:0/942177311 --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe91415bd10 con 0x7fe900007d20 2024-09-05T07:28:54.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:54.280+0000 7fe90a7fc640 1 -- 172.21.15.17:0/942177311 --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fe9140c5670 con 0x7fe90000c7f0 2024-09-05T07:28:54.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:54.280+0000 7fe90a7fc640 1 -- 172.21.15.17:0/942177311 --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fe91415aeb0 con 0x7fe90000c1f0 2024-09-05T07:28:54.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:54.280+0000 7fe91921f640 1 --2- 172.21.15.17:0/942177311 >> v2:172.21.15.17:3300/0 conn(0x7fe90000c7f0 0x7fe90000bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:54.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:54.281+0000 7fe91921f640 1 -- 172.21.15.17:0/942177311 >> v2:172.21.15.17:3300/0 conn(0x7fe90000c7f0 msgr2=0x7fe90000bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-05T07:28:54.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:54.281+0000 7fe91921f640 1 -- 172.21.15.17:0/942177311 >> v2:172.21.15.17:3300/0 conn(0x7fe90000c7f0 msgr2=0x7fe90000bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-05T07:28:54.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:54.281+0000 7fe91921f640 1 --2- 172.21.15.17:0/942177311 >> v2:172.21.15.17:3300/0 conn(0x7fe90000c7f0 0x7fe90000bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-05T07:28:54.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:54.281+0000 7fe91921f640 1 --2- 172.21.15.17:0/942177311 >> v2:172.21.15.17:3300/0 conn(0x7fe90000c7f0 0x7fe90000bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-05T07:28:54.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:54.319+0000 7fe90bfff640 1 --2- 172.21.15.17:0/942177311 >> v2:172.21.15.26:3300/0 conn(0x7fe90000c1f0 0x7fe90000f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:54.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:54.322+0000 7fe90bfff640 1 -- 172.21.15.17:0/942177311 >> v2:172.21.15.26:3300/0 conn(0x7fe90000c1f0 msgr2=0x7fe90000f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-05T07:28:54.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:54.322+0000 7fe90bfff640 1 -- 172.21.15.17:0/942177311 >> v2:172.21.15.26:3300/0 conn(0x7fe90000c1f0 msgr2=0x7fe90000f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-05T07:28:54.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:54.322+0000 7fe90bfff640 1 --2- 172.21.15.17:0/942177311 >> v2:172.21.15.26:3300/0 conn(0x7fe90000c1f0 0x7fe90000f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-05T07:28:54.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:54.322+0000 7fe90bfff640 1 --2- 172.21.15.17:0/942177311 >> v2:172.21.15.26:3300/0 conn(0x7fe90000c1f0 0x7fe90000f300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-05T07:28:54.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:54.595+0000 7fe91921f640 1 --2- 172.21.15.17:0/942177311 >> v2:172.21.15.17:3300/0 conn(0x7fe90000c7f0 0x7fe90000bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:54.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:54.606+0000 7fe90bfff640 1 --2- 172.21.15.17:0/942177311 >> v2:172.21.15.26:3300/0 conn(0x7fe90000c1f0 0x7fe90000f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:54.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:54.675+0000 7fe91921f640 1 -- 172.21.15.17:0/942177311 >> v2:172.21.15.17:3300/0 conn(0x7fe90000c7f0 msgr2=0x7fe90000bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-05T07:28:54.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:54.676+0000 7fe91921f640 1 -- 172.21.15.17:0/942177311 >> v2:172.21.15.17:3300/0 conn(0x7fe90000c7f0 msgr2=0x7fe90000bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-05T07:28:54.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:54.676+0000 7fe91921f640 1 --2- 172.21.15.17:0/942177311 >> v2:172.21.15.17:3300/0 conn(0x7fe90000c7f0 0x7fe90000bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-05T07:28:54.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:54.676+0000 7fe91921f640 1 --2- 172.21.15.17:0/942177311 >> v2:172.21.15.17:3300/0 conn(0x7fe90000c7f0 0x7fe90000bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-05T07:28:54.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:54.762+0000 7fe90bfff640 1 -- 172.21.15.17:0/942177311 >> v2:172.21.15.26:3300/0 conn(0x7fe90000c1f0 msgr2=0x7fe90000f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-05T07:28:54.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:54.762+0000 7fe90bfff640 1 -- 172.21.15.17:0/942177311 >> v2:172.21.15.26:3300/0 conn(0x7fe90000c1f0 msgr2=0x7fe90000f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-05T07:28:54.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:54.762+0000 7fe90bfff640 1 --2- 172.21.15.17:0/942177311 >> v2:172.21.15.26:3300/0 conn(0x7fe90000c1f0 0x7fe90000f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-05T07:28:54.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:54.762+0000 7fe90bfff640 1 --2- 172.21.15.17:0/942177311 >> v2:172.21.15.26:3300/0 conn(0x7fe90000c1f0 0x7fe90000f300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-05T07:28:54.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:54.970+0000 7fe90b7fe640 1 -- 172.21.15.17:0/942177311 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 38447863 0 0) 0x7fe91415bd10 con 0x7fe900007d20 2024-09-05T07:28:54.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:54.970+0000 7fe90b7fe640 1 -- 172.21.15.17:0/942177311 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8fc003520 con 0x7fe900007d20 2024-09-05T07:28:55.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.029+0000 7fe90b7fe640 1 -- 172.21.15.17:0/942177311 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2225424475 0 0) 0x7fe8fc003520 con 0x7fe900007d20 2024-09-05T07:28:55.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.029+0000 7fe90b7fe640 1 -- 172.21.15.17:0/942177311 >> v2:172.21.15.26:3300/0 conn(0x7fe90000c1f0 msgr2=0x7fe90000f300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T07:28:55.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.029+0000 7fe90b7fe640 1 --2- 172.21.15.17:0/942177311 >> v2:172.21.15.26:3300/0 conn(0x7fe90000c1f0 0x7fe90000f300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:55.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.029+0000 7fe90b7fe640 1 -- 172.21.15.17:0/942177311 >> v2:172.21.15.17:3300/0 conn(0x7fe90000c7f0 msgr2=0x7fe90000bad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T07:28:55.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.029+0000 7fe90b7fe640 1 --2- 172.21.15.17:0/942177311 >> v2:172.21.15.17:3300/0 conn(0x7fe90000c7f0 0x7fe90000bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:55.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.029+0000 7fe90b7fe640 1 -- 172.21.15.17:0/942177311 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9000085a0 con 0x7fe900007d20 2024-09-05T07:28:55.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.029+0000 7fe90b7fe640 1 -- 172.21.15.17:0/942177311 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1460137602 0 0) 0x7fe910004250 con 0x7fe900007d20 2024-09-05T07:28:55.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.030+0000 7fe90b7fe640 1 -- 172.21.15.17:0/942177311 >> v1:172.21.15.17:6789/0 conn(0x7fe900007d20 legacy=0x7fe90000fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:55.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.030+0000 7fe90b7fe640 1 --2- 172.21.15.17:0/942177311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8fc0039b0 0x7fe8fc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:55.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.030+0000 7fe90b7fe640 1 --2- 172.21.15.17:0/942177311 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe8fc004800 0x7fe8fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:55.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.030+0000 7fe90b7fe640 1 --2- 172.21.15.17:0/942177311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8fc0051c0 0x7fe8fc00b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:55.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.030+0000 7fe90b7fe640 1 -- 172.21.15.17:0/942177311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe9140c5670 con 0x7fe8fc0051c0 2024-09-05T07:28:55.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.030+0000 7fe90b7fe640 1 -- 172.21.15.17:0/942177311 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe91415aeb0 con 0x7fe8fc0039b0 2024-09-05T07:28:55.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.030+0000 7fe90b7fe640 1 -- 172.21.15.17:0/942177311 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fe8fc00c080 con 0x7fe8fc004800 2024-09-05T07:28:55.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.030+0000 7fe918a1e640 1 --2- 172.21.15.17:0/942177311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8fc0039b0 0x7fe8fc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:55.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.030+0000 7fe90bfff640 1 --2- 172.21.15.17:0/942177311 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe8fc004800 0x7fe8fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:55.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.046+0000 7fe91921f640 1 --2- 172.21.15.17:0/942177311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8fc0051c0 0x7fe8fc00b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:55.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.062+0000 7fe91921f640 1 -- 172.21.15.17:0/942177311 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe8fc004800 msgr2=0x7fe8fc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:28:55.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.062+0000 7fe91921f640 1 --2- 172.21.15.17:0/942177311 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe8fc004800 0x7fe8fc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:55.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.062+0000 7fe91921f640 1 -- 172.21.15.17:0/942177311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8fc0039b0 msgr2=0x7fe8fc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:28:55.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.062+0000 7fe91921f640 1 --2- 172.21.15.17:0/942177311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8fc0039b0 0x7fe8fc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:55.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.062+0000 7fe91921f640 1 -- 172.21.15.17:0/942177311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8fc003520 con 0x7fe8fc0051c0 2024-09-05T07:28:55.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.062+0000 7fe91921f640 1 -- 172.21.15.17:0/942177311 reap_dead start 2024-09-05T07:28:55.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.114+0000 7fe91921f640 1 --2- 172.21.15.17:0/942177311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8fc0051c0 0x7fe8fc00b930 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe914075950 tx=0x7fe8fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3780fb958c06f5f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:28:55.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.121+0000 7fe90b7fe640 1 -- 172.21.15.17:0/942177311 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90c038070 con 0x7fe8fc0051c0 2024-09-05T07:28:55.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.121+0000 7fe90b7fe640 1 -- 172.21.15.17:0/942177311 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe90c02c6a0 con 0x7fe8fc0051c0 2024-09-05T07:28:55.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.121+0000 7fe90b7fe640 1 -- 172.21.15.17:0/942177311 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90c007a00 con 0x7fe8fc0051c0 2024-09-05T07:28:55.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.122+0000 7fe91ac82640 1 -- 172.21.15.17:0/942177311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8fc0051c0 msgr2=0x7fe8fc00b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:55.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.122+0000 7fe91ac82640 1 --2- 172.21.15.17:0/942177311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8fc0051c0 0x7fe8fc00b930 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe914075950 tx=0x7fe8fc005830 comp rx=0 tx=0).stop 2024-09-05T07:28:55.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.122+0000 7fe91ac82640 1 -- 172.21.15.17:0/942177311 shutdown_connections 2024-09-05T07:28:55.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.122+0000 7fe91ac82640 1 --2- 172.21.15.17:0/942177311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8fc0051c0 0x7fe8fc00b930 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:55.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.122+0000 7fe91ac82640 1 -- 172.21.15.17:0/942177311 >> 172.21.15.17:0/942177311 conn(0x7fe91406fac0 msgr2=0x7fe91406fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:28:55.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.122+0000 7fe91ac82640 1 -- 172.21.15.17:0/942177311 shutdown_connections 2024-09-05T07:28:55.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.122+0000 7fe91ac82640 1 -- 172.21.15.17:0/942177311 wait complete. 2024-09-05T07:28:55.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.123+0000 7fe91ac82640 1 Processor -- start 2024-09-05T07:28:55.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.124+0000 7fe91ac82640 1 -- start start 2024-09-05T07:28:55.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.125+0000 7fe91ac82640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8fc0051c0 0x7fe9141e30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:55.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.125+0000 7fe91ac82640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9140cb930 0x7fe9140ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:55.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.125+0000 7fe91ac82640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe9141e3e50 0x7fe9141e5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:55.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.125+0000 7fe91ac82640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe91415ba30 con 0x7fe8fc0051c0 2024-09-05T07:28:55.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.125+0000 7fe91ac82640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe91415b750 con 0x7fe9140cb930 2024-09-05T07:28:55.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.125+0000 7fe91ac82640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fe91406f5f0 con 0x7fe9141e3e50 2024-09-05T07:28:55.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.131+0000 7fe918a1e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8fc0051c0 0x7fe9141e30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:55.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.142+0000 7fe91921f640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe9141e3e50 0x7fe9141e5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:55.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.142+0000 7fe91921f640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe9141e3e50 0x7fe9141e5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:56684/0 (socket says 172.21.15.17:56684) 2024-09-05T07:28:55.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.142+0000 7fe91921f640 1 -- 172.21.15.17:0/1857527003 learned_addr learned my addr 172.21.15.17:0/1857527003 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:28:55.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.147+0000 7fe91921f640 1 -- 172.21.15.17:0/1857527003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9140cb930 msgr2=0x7fe9140ca8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:55.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.147+0000 7fe91921f640 1 --2- 172.21.15.17:0/1857527003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9140cb930 0x7fe9140ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:55.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.147+0000 7fe91921f640 1 -- 172.21.15.17:0/1857527003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8fc0051c0 msgr2=0x7fe9141e30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:55.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.147+0000 7fe91921f640 1 --2- 172.21.15.17:0/1857527003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8fc0051c0 0x7fe9141e30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:55.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.147+0000 7fe91921f640 1 -- 172.21.15.17:0/1857527003 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9141e35e0 con 0x7fe9141e3e50 2024-09-05T07:28:55.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.156+0000 7fe91921f640 1 --2- 172.21.15.17:0/1857527003 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe9141e3e50 0x7fe9141e5830 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe90c02b180 tx=0x7fe90c005f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:28:55.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.200+0000 7fe9097fa640 1 -- 172.21.15.17:0/1857527003 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90c038040 con 0x7fe9141e3e50 2024-09-05T07:28:55.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.200+0000 7fe9097fa640 1 -- 172.21.15.17:0/1857527003 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe90c02d7b0 con 0x7fe9141e3e50 2024-09-05T07:28:55.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.200+0000 7fe9097fa640 1 -- 172.21.15.17:0/1857527003 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90c007a00 con 0x7fe9141e3e50 2024-09-05T07:28:55.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.200+0000 7fe91ac82640 1 -- 172.21.15.17:0/1857527003 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe91415a880 con 0x7fe9141e3e50 2024-09-05T07:28:55.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.200+0000 7fe91ac82640 1 -- 172.21.15.17:0/1857527003 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9141f1070 con 0x7fe9141e3e50 2024-09-05T07:28:55.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.200+0000 7fe91ac82640 1 -- 172.21.15.17:0/1857527003 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9140c6f20 con 0x7fe9141e3e50 2024-09-05T07:28:55.336 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-05T07:28:55.335+0000 7fa1aa71f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-05T07:28:55.337 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-09-05T07:28:55.337+0000 7fd093520040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-05T07:28:55.378 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-05T07:28:55.378+0000 7fa1aa71f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-05T07:28:55.379 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-09-05T07:28:55.380+0000 7fd093520040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-05T07:28:55.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.430+0000 7fe9097fa640 1 -- 172.21.15.17:0/1857527003 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe90c02db80 con 0x7fe9141e3e50 2024-09-05T07:28:55.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.438+0000 7fe9097fa640 1 -- 172.21.15.17:0/1857527003 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe90c03ed80 con 0x7fe9141e3e50 2024-09-05T07:28:55.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.438+0000 7fe9097fa640 1 -- 172.21.15.17:0/1857527003 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fe90c04c070 con 0x7fe9141e3e50 2024-09-05T07:28:55.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.503+0000 7fe91ac82640 1 -- 172.21.15.17:0/1857527003 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fe91414ea90 con 0x7fe9141e3e50 2024-09-05T07:28:55.529 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-09-05T07:28:55.530+0000 7fd093520040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-05T07:28:55.582 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-09-05T07:28:55.582+0000 7fd093520040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-05T07:28:55.624 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-05T07:28:55.623+0000 7fa1aa71f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-05T07:28:55.677 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-05T07:28:55.677+0000 7fa1aa71f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-05T07:28:55.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.756+0000 7fe9097fa640 1 -- 172.21.15.17:0/1857527003 <== mon.2 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fe90c03e430 con 0x7fe9141e3e50 2024-09-05T07:28:55.756 INFO:teuthology.orchestra.run.smithi017.stderr:adjusted tunables profile to default 2024-09-05T07:28:55.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.757+0000 7fe91ac82640 1 -- 172.21.15.17:0/1857527003 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe9141e3e50 msgr2=0x7fe9141e5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:55.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.757+0000 7fe91ac82640 1 --2- 172.21.15.17:0/1857527003 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe9141e3e50 0x7fe9141e5830 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe90c02b180 tx=0x7fe90c005f50 comp rx=0 tx=0).stop 2024-09-05T07:28:55.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.757+0000 7fe91ac82640 1 -- 172.21.15.17:0/1857527003 shutdown_connections 2024-09-05T07:28:55.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.757+0000 7fe91ac82640 1 --2- 172.21.15.17:0/1857527003 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe9141e3e50 0x7fe9141e5830 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:55.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.757+0000 7fe91ac82640 1 --2- 172.21.15.17:0/1857527003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9140cb930 0x7fe9140ca8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:55.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.757+0000 7fe91ac82640 1 --2- 172.21.15.17:0/1857527003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8fc0051c0 0x7fe9141e30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:55.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.757+0000 7fe91ac82640 1 -- 172.21.15.17:0/1857527003 >> 172.21.15.17:0/1857527003 conn(0x7fe91406fac0 msgr2=0x7fe9140c87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:28:55.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.757+0000 7fe91ac82640 1 -- 172.21.15.17:0/1857527003 shutdown_connections 2024-09-05T07:28:55.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:28:55.757+0000 7fe91ac82640 1 -- 172.21.15.17:0/1857527003 wait complete. 2024-09-05T07:28:55.758 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-09-05T07:28:55.758+0000 7fd093520040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-05T07:28:55.768 INFO:tasks.ceph:check_enable_crimson: False 2024-09-05T07:28:55.769 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-05T07:28:55.769 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-05T07:28:55.769 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-05T07:28:55.794 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-05T07:28:55.794 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-05T07:28:55.839 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-05T07:28:55.839+0000 7fa1aa71f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-05T07:28:55.859 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-05T07:28:55.859 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-05T07:28:55.873 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-09-05T07:28:55.873+0000 7fd093520040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-05T07:28:55.924 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-05T07:28:55.924 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-05T07:28:55.963 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-05T07:28:55.963+0000 7fa1aa71f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-05T07:28:55.987 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-05T07:28:55.988 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-05T07:28:56.012 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-05T07:28:56.013 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-05T07:28:56.077 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-05T07:28:56.077 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-05T07:28:56.142 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-05T07:28:56.142 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-05T07:28:56.192 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-09-05T07:28:56.193+0000 7fd093520040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-05T07:28:56.206 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd new 2f01a8b4-dc10-4cdf-a65e-b7f96de4e2b3 0 2024-09-05T07:28:56.251 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-09-05T07:28:56.252+0000 7fd093520040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-05T07:28:56.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.345+0000 7ff54a58f640 1 Processor -- start 2024-09-05T07:28:56.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.345+0000 7ff54a58f640 1 -- start start 2024-09-05T07:28:56.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.346+0000 7ff54a58f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff54415ec40 0x7ff544075770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:56.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.346+0000 7ff54a58f640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff54415cd80 0x7ff54415d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:56.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.346+0000 7ff54a58f640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff54415c000 con 0x7ff544154f10 2024-09-05T07:28:56.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.346+0000 7ff54a58f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7ff5440ca1f0 con 0x7ff54415ec40 2024-09-05T07:28:56.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.346+0000 7ff54a58f640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7ff544075cb0 con 0x7ff54415cd80 2024-09-05T07:28:56.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.346+0000 7ff548b2c640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff54415cd80 0x7ff54415d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:56.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.347+0000 7ff548b2c640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff54415cd80 0x7ff54415d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:57426/0 (socket says 172.21.15.26:57426) 2024-09-05T07:28:56.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.347+0000 7ff548b2c640 1 -- 172.21.15.26:0/2526333442 learned_addr learned my addr 172.21.15.26:0/2526333442 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-09-05T07:28:56.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.349+0000 7ff548b2c640 1 -- 172.21.15.26:0/2526333442 >> v2:172.21.15.17:3300/0 conn(0x7ff54415ec40 msgr2=0x7ff544075770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:28:56.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.349+0000 7ff548b2c640 1 --2- 172.21.15.26:0/2526333442 >> v2:172.21.15.17:3300/0 conn(0x7ff54415ec40 0x7ff544075770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:56.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.349+0000 7ff548b2c640 1 -- 172.21.15.26:0/2526333442 >> v1:172.21.15.17:6789/0 conn(0x7ff544154f10 legacy=0x7ff54415e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:28:56.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.349+0000 7ff548b2c640 1 -- 172.21.15.26:0/2526333442 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff544073600 con 0x7ff54415cd80 2024-09-05T07:28:56.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.351+0000 7ff548b2c640 1 --2- 172.21.15.26:0/2526333442 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff54415cd80 0x7ff54415d190 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff544075700 tx=0x7ff53c02a750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56129d8f680358de server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:28:56.351 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-05T07:28:56.351+0000 7fa1aa71f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-05T07:28:56.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.355+0000 7ff542ffd640 1 -- 172.21.15.26:0/2526333442 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c036070 con 0x7ff54415cd80 2024-09-05T07:28:56.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.355+0000 7ff542ffd640 1 -- 172.21.15.26:0/2526333442 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff53c031600 con 0x7ff54415cd80 2024-09-05T07:28:56.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.355+0000 7ff542ffd640 1 -- 172.21.15.26:0/2526333442 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c0319d0 con 0x7ff54415cd80 2024-09-05T07:28:56.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.356+0000 7ff54a58f640 1 -- 172.21.15.26:0/2526333442 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff54415cd80 msgr2=0x7ff54415d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:56.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.356+0000 7ff54a58f640 1 --2- 172.21.15.26:0/2526333442 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff54415cd80 0x7ff54415d190 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff544075700 tx=0x7ff53c02a750 comp rx=0 tx=0).stop 2024-09-05T07:28:56.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.356+0000 7ff54a58f640 1 -- 172.21.15.26:0/2526333442 shutdown_connections 2024-09-05T07:28:56.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.356+0000 7ff54a58f640 1 --2- 172.21.15.26:0/2526333442 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff54415cd80 0x7ff54415d190 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:56.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.356+0000 7ff54a58f640 1 --2- 172.21.15.26:0/2526333442 >> v2:172.21.15.17:3300/0 conn(0x7ff54415ec40 0x7ff544075770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:56.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.356+0000 7ff54a58f640 1 -- 172.21.15.26:0/2526333442 >> 172.21.15.26:0/2526333442 conn(0x7ff54406fac0 msgr2=0x7ff54406fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:28:56.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.356+0000 7ff54a58f640 1 -- 172.21.15.26:0/2526333442 shutdown_connections 2024-09-05T07:28:56.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.356+0000 7ff54a58f640 1 -- 172.21.15.26:0/2526333442 wait complete. 2024-09-05T07:28:56.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.358+0000 7ff54a58f640 1 Processor -- start 2024-09-05T07:28:56.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.358+0000 7ff54a58f640 1 -- start start 2024-09-05T07:28:56.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.359+0000 7ff54a58f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff544154f10 0x7ff5441f0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:56.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.359+0000 7ff54a58f640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff54415cd80 0x7ff54414fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:56.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.359+0000 7ff54a58f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff54415ec40 0x7ff54414f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:56.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.359+0000 7ff54a58f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff54415c580 con 0x7ff544154f10 2024-09-05T07:28:56.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.359+0000 7ff54a58f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ff5440c9c80 con 0x7ff54415ec40 2024-09-05T07:28:56.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.359+0000 7ff54a58f640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7ff54415c860 con 0x7ff54415cd80 2024-09-05T07:28:56.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.360+0000 7ff548b2c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff54415ec40 0x7ff54414f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:56.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.360+0000 7ff5437fe640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff54415cd80 0x7ff54414fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:56.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.360+0000 7ff5437fe640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff54415cd80 0x7ff54414fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:57442/0 (socket says 172.21.15.26:57442) 2024-09-05T07:28:56.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.360+0000 7ff5437fe640 1 -- 172.21.15.26:0/172695179 learned_addr learned my addr 172.21.15.26:0/172695179 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-09-05T07:28:56.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.363+0000 7ff543fff640 1 --2- 172.21.15.26:0/172695179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff544154f10 0x7ff5441f0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:56.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.364+0000 7ff548b2c640 1 -- 172.21.15.26:0/172695179 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff54415cd80 msgr2=0x7ff54414fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:56.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.364+0000 7ff548b2c640 1 --2- 172.21.15.26:0/172695179 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff54415cd80 0x7ff54414fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:56.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.364+0000 7ff548b2c640 1 -- 172.21.15.26:0/172695179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff544154f10 msgr2=0x7ff5441f0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:56.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.364+0000 7ff548b2c640 1 --2- 172.21.15.26:0/172695179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff544154f10 0x7ff5441f0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:56.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.364+0000 7ff548b2c640 1 -- 172.21.15.26:0/172695179 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff544155440 con 0x7ff54415ec40 2024-09-05T07:28:56.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.366+0000 7ff548b2c640 1 --2- 172.21.15.26:0/172695179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff54415ec40 0x7ff54414f430 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff5440cd8f0 tx=0x7ff53c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:28:56.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.405+0000 7ff540ff9640 1 -- 172.21.15.26:0/172695179 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c041030 con 0x7ff54415ec40 2024-09-05T07:28:56.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.405+0000 7ff540ff9640 1 -- 172.21.15.26:0/172695179 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff53c037040 con 0x7ff54415ec40 2024-09-05T07:28:56.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.405+0000 7ff54a58f640 1 -- 172.21.15.26:0/172695179 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff544150280 con 0x7ff54415ec40 2024-09-05T07:28:56.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.405+0000 7ff540ff9640 1 -- 172.21.15.26:0/172695179 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c036070 con 0x7ff54415ec40 2024-09-05T07:28:56.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.405+0000 7ff54a58f640 1 -- 172.21.15.26:0/172695179 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff544150840 con 0x7ff54415ec40 2024-09-05T07:28:56.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.406+0000 7ff54a58f640 1 -- 172.21.15.26:0/172695179 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5440732a0 con 0x7ff54415ec40 2024-09-05T07:28:56.415 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-09-05T07:28:56.415+0000 7fd093520040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-05T07:28:56.529 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-05T07:28:56.528+0000 7fa1aa71f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-05T07:28:56.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.610+0000 7ff540ff9640 1 -- 172.21.15.26:0/172695179 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff53c044070 con 0x7ff54415ec40 2024-09-05T07:28:56.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.610+0000 7ff540ff9640 1 -- 172.21.15.26:0/172695179 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7ff53c03dad0 con 0x7ff54415ec40 2024-09-05T07:28:56.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.611+0000 7ff540ff9640 1 -- 172.21.15.26:0/172695179 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7ff53c04b070 con 0x7ff54415ec40 2024-09-05T07:28:56.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.682+0000 7ff54a58f640 1 -- 172.21.15.26:0/172695179 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2f01a8b4-dc10-4cdf-a65e-b7f96de4e2b3", "id": 0} v 0) -- 0x7ff5440cb5f0 con 0x7ff54415ec40 2024-09-05T07:28:56.684 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-05T07:28:56.684+0000 7fa1aa71f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-05T07:28:56.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.870+0000 7ff540ff9640 1 -- 172.21.15.26:0/172695179 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2f01a8b4-dc10-4cdf-a65e-b7f96de4e2b3", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7ff53c03dd20 con 0x7ff54415ec40 2024-09-05T07:28:56.870 INFO:teuthology.orchestra.run.smithi026.stdout:0 2024-09-05T07:28:56.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.871+0000 7ff54a58f640 1 -- 172.21.15.26:0/172695179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff54415ec40 msgr2=0x7ff54414f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:56.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.871+0000 7ff54a58f640 1 --2- 172.21.15.26:0/172695179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff54415ec40 0x7ff54414f430 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff5440cd8f0 tx=0x7ff53c004a40 comp rx=0 tx=0).stop 2024-09-05T07:28:56.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.871+0000 7ff54a58f640 1 -- 172.21.15.26:0/172695179 shutdown_connections 2024-09-05T07:28:56.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.871+0000 7ff54a58f640 1 --2- 172.21.15.26:0/172695179 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff54415cd80 0x7ff54414fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:56.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.871+0000 7ff54a58f640 1 --2- 172.21.15.26:0/172695179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff54415ec40 0x7ff54414f430 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:56.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.871+0000 7ff54a58f640 1 --2- 172.21.15.26:0/172695179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff544154f10 0x7ff5441f0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:56.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.871+0000 7ff54a58f640 1 -- 172.21.15.26:0/172695179 >> 172.21.15.26:0/172695179 conn(0x7ff54406fac0 msgr2=0x7ff5440c7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:28:56.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.871+0000 7ff54a58f640 1 -- 172.21.15.26:0/172695179 shutdown_connections 2024-09-05T07:28:56.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:56.871+0000 7ff54a58f640 1 -- 172.21.15.26:0/172695179 wait complete. 2024-09-05T07:28:56.883 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd new d16867fb-2290-486c-9ac8-327ca54326d2 1 2024-09-05T07:28:57.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.026+0000 7f497f7fd640 1 Processor -- start 2024-09-05T07:28:57.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.026+0000 7f497f7fd640 1 -- start start 2024-09-05T07:28:57.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.027+0000 7f497f7fd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f497806f550 0x7f4978067d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:57.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.027+0000 7f497f7fd640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f497815ab70 con 0x7f4978067950 2024-09-05T07:28:57.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.027+0000 7f497f7fd640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f497815ae50 con 0x7f49780afd30 2024-09-05T07:28:57.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.027+0000 7f497f7fd640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f497815b6f0 con 0x7f497806f550 2024-09-05T07:28:57.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.027+0000 7f497dd9a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f497806f550 0x7f4978067d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:57.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.028+0000 7f497d599640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f4978067950 0x7f4978072820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.26:38494/0 (socket says 172.21.15.26:38494) 2024-09-05T07:28:57.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.028+0000 7f497d599640 1 -- 172.21.15.26:0/1384061683 learned_addr learned my addr 172.21.15.26:0/1384061683 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-09-05T07:28:57.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.030+0000 7f496ffff640 1 -- 172.21.15.26:0/1384061683 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3259593051 0 0) 0x7f497815ab70 con 0x7f4978067950 2024-09-05T07:28:57.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.030+0000 7f496ffff640 1 -- 172.21.15.26:0/1384061683 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4964003520 con 0x7f4978067950 2024-09-05T07:28:57.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.033+0000 7f496ffff640 1 -- 172.21.15.26:0/1384061683 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 333878116 0 0) 0x7f4964003520 con 0x7f4978067950 2024-09-05T07:28:57.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.034+0000 7f496ffff640 1 -- 172.21.15.26:0/1384061683 >> v2:172.21.15.26:3300/0 conn(0x7f497806f550 msgr2=0x7f4978067d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:28:57.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.034+0000 7f496ffff640 1 --2- 172.21.15.26:0/1384061683 >> v2:172.21.15.26:3300/0 conn(0x7f497806f550 0x7f4978067d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:57.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.034+0000 7f496ffff640 1 -- 172.21.15.26:0/1384061683 >> v1:172.21.15.26:6789/0 conn(0x7f49780afd30 legacy=0x7f497806ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:28:57.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.034+0000 7f496ffff640 1 -- 172.21.15.26:0/1384061683 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497815b130 con 0x7f4978067950 2024-09-05T07:28:57.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.034+0000 7f496ffff640 1 -- 172.21.15.26:0/1384061683 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1460137602 0 0) 0x7f4974001670 con 0x7f4978067950 2024-09-05T07:28:57.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.034+0000 7f496ffff640 1 -- 172.21.15.26:0/1384061683 >> v1:172.21.15.17:6789/0 conn(0x7f4978067950 legacy=0x7f4978072820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:57.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.034+0000 7f496ffff640 1 --2- 172.21.15.26:0/1384061683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4964003a00 0x7f4964003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:57.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.034+0000 7f496ffff640 1 --2- 172.21.15.26:0/1384061683 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4964004800 0x7f4964004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:57.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.034+0000 7f496ffff640 1 --2- 172.21.15.26:0/1384061683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49640052e0 0x7f496400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:57.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.034+0000 7f496ffff640 1 -- 172.21.15.26:0/1384061683 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f497815b6f0 con 0x7f49640052e0 2024-09-05T07:28:57.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.034+0000 7f496ffff640 1 -- 172.21.15.26:0/1384061683 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f496400c230 con 0x7f4964003a00 2024-09-05T07:28:57.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.034+0000 7f496ffff640 1 -- 172.21.15.26:0/1384061683 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f496400c430 con 0x7f4964004800 2024-09-05T07:28:57.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.034+0000 7f497cd98640 1 --2- 172.21.15.26:0/1384061683 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4964004800 0x7f4964004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:57.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.037+0000 7f497dd9a640 1 --2- 172.21.15.26:0/1384061683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49640052e0 0x7f496400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:57.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.037+0000 7f497cd98640 1 -- 172.21.15.26:0/1384061683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4964003a00 msgr2=0x7f4964003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:28:57.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.037+0000 7f497cd98640 1 --2- 172.21.15.26:0/1384061683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4964003a00 0x7f4964003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:57.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.037+0000 7f497cd98640 1 -- 172.21.15.26:0/1384061683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49640052e0 msgr2=0x7f496400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:28:57.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.037+0000 7f497cd98640 1 --2- 172.21.15.26:0/1384061683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49640052e0 0x7f496400b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:57.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.037+0000 7f497cd98640 1 -- 172.21.15.26:0/1384061683 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4964003520 con 0x7f4964004800 2024-09-05T07:28:57.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.037+0000 7f497dd9a640 1 -- 172.21.15.26:0/1384061683 reap_dead start 2024-09-05T07:28:57.038 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.039+0000 7f497cd98640 1 --2- 172.21.15.26:0/1384061683 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4964004800 0x7f4964004c80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f49780b0160 tx=0x7f4964005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb644a7d9d1f21e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:28:57.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.043+0000 7f496ffff640 1 -- 172.21.15.26:0/1384061683 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4968001240 con 0x7f4964004800 2024-09-05T07:28:57.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.043+0000 7f496ffff640 1 -- 172.21.15.26:0/1384061683 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f496802e070 con 0x7f4964004800 2024-09-05T07:28:57.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.043+0000 7f496ffff640 1 -- 172.21.15.26:0/1384061683 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496802a790 con 0x7f4964004800 2024-09-05T07:28:57.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.043+0000 7f497f7fd640 1 -- 172.21.15.26:0/1384061683 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4964004800 msgr2=0x7f4964004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:57.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.043+0000 7f497f7fd640 1 --2- 172.21.15.26:0/1384061683 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4964004800 0x7f4964004c80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f49780b0160 tx=0x7f4964005830 comp rx=0 tx=0).stop 2024-09-05T07:28:57.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.043+0000 7f497f7fd640 1 -- 172.21.15.26:0/1384061683 shutdown_connections 2024-09-05T07:28:57.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.043+0000 7f497f7fd640 1 --2- 172.21.15.26:0/1384061683 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4964004800 0x7f4964004c80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:57.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.043+0000 7f497f7fd640 1 -- 172.21.15.26:0/1384061683 >> 172.21.15.26:0/1384061683 conn(0x7f49780cd260 msgr2=0x7f49780cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:28:57.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.044+0000 7f497f7fd640 1 -- 172.21.15.26:0/1384061683 shutdown_connections 2024-09-05T07:28:57.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.044+0000 7f497f7fd640 1 -- 172.21.15.26:0/1384061683 wait complete. 2024-09-05T07:28:57.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.045+0000 7f497f7fd640 1 Processor -- start 2024-09-05T07:28:57.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.045+0000 7f497f7fd640 1 -- start start 2024-09-05T07:28:57.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.046+0000 7f497f7fd640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4964004800 0x7f49781f0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:57.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.046+0000 7f497f7fd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49781e59d0 0x7f49780c6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:57.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.046+0000 7f497f7fd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49780cc3e0 0x7f4978150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:57.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.046+0000 7f497f7fd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4978154b60 con 0x7f49780cc3e0 2024-09-05T07:28:57.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.046+0000 7f497f7fd640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f497806e920 con 0x7f49781e59d0 2024-09-05T07:28:57.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.046+0000 7f497f7fd640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f497815a730 con 0x7f4964004800 2024-09-05T07:28:57.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.046+0000 7f497d599640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4964004800 0x7f49781f0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:57.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.046+0000 7f497dd9a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49780cc3e0 0x7f4978150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:57.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.047+0000 7f497d599640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4964004800 0x7f49781f0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:57460/0 (socket says 172.21.15.26:57460) 2024-09-05T07:28:57.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.047+0000 7f497d599640 1 -- 172.21.15.26:0/2358250060 learned_addr learned my addr 172.21.15.26:0/2358250060 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-09-05T07:28:57.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.047+0000 7f497cd98640 1 --2- 172.21.15.26:0/2358250060 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49781e59d0 0x7f49780c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:57.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.050+0000 7f497dd9a640 1 -- 172.21.15.26:0/2358250060 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4964004800 msgr2=0x7f49781f0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:57.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.050+0000 7f497dd9a640 1 --2- 172.21.15.26:0/2358250060 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4964004800 0x7f49781f0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:57.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.050+0000 7f497dd9a640 1 -- 172.21.15.26:0/2358250060 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49781e59d0 msgr2=0x7f49780c6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:57.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.050+0000 7f497dd9a640 1 --2- 172.21.15.26:0/2358250060 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49781e59d0 0x7f49780c6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:57.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.050+0000 7f497dd9a640 1 -- 172.21.15.26:0/2358250060 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497815e730 con 0x7f49780cc3e0 2024-09-05T07:28:57.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.050+0000 7f497d599640 1 --2- 172.21.15.26:0/2358250060 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4964004800 0x7f49781f0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:28:57.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.052+0000 7f497dd9a640 1 --2- 172.21.15.26:0/2358250060 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49780cc3e0 0x7f4978150a40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f49780689b0 tx=0x7f497000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:28:57.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.056+0000 7f496dffb640 1 -- 172.21.15.26:0/2358250060 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497001b070 con 0x7f49780cc3e0 2024-09-05T07:28:57.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.056+0000 7f496dffb640 1 -- 172.21.15.26:0/2358250060 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f497000bcc0 con 0x7f49780cc3e0 2024-09-05T07:28:57.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.056+0000 7f497f7fd640 1 -- 172.21.15.26:0/2358250060 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f497815de90 con 0x7f49780cc3e0 2024-09-05T07:28:57.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.056+0000 7f496dffb640 1 -- 172.21.15.26:0/2358250060 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4970016680 con 0x7f49780cc3e0 2024-09-05T07:28:57.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.056+0000 7f497f7fd640 1 -- 172.21.15.26:0/2358250060 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f497815e450 con 0x7f49780cc3e0 2024-09-05T07:28:57.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.057+0000 7f497f7fd640 1 -- 172.21.15.26:0/2358250060 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4978067d30 con 0x7f49780cc3e0 2024-09-05T07:28:57.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.074+0000 7f496dffb640 1 -- 172.21.15.26:0/2358250060 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f497001e070 con 0x7f49780cc3e0 2024-09-05T07:28:57.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.074+0000 7f496dffb640 1 -- 172.21.15.26:0/2358250060 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f4970020a10 con 0x7f49780cc3e0 2024-09-05T07:28:57.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.199+0000 7f496dffb640 1 -- 172.21.15.26:0/2358250060 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f4970025020 con 0x7f49780cc3e0 2024-09-05T07:28:57.271 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.271+0000 7f497f7fd640 1 -- 172.21.15.26:0/2358250060 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d16867fb-2290-486c-9ac8-327ca54326d2", "id": 1} v 0) -- 0x7f49780b27f0 con 0x7f49780cc3e0 2024-09-05T07:28:57.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.327+0000 7f496dffb640 1 -- 172.21.15.26:0/2358250060 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d16867fb-2290-486c-9ac8-327ca54326d2", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f4970016820 con 0x7f49780cc3e0 2024-09-05T07:28:57.327 INFO:teuthology.orchestra.run.smithi026.stdout:1 2024-09-05T07:28:57.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.328+0000 7f497f7fd640 1 -- 172.21.15.26:0/2358250060 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49780cc3e0 msgr2=0x7f4978150a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:57.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.328+0000 7f497f7fd640 1 --2- 172.21.15.26:0/2358250060 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49780cc3e0 0x7f4978150a40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f49780689b0 tx=0x7f497000dc00 comp rx=0 tx=0).stop 2024-09-05T07:28:57.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.328+0000 7f497f7fd640 1 -- 172.21.15.26:0/2358250060 shutdown_connections 2024-09-05T07:28:57.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.328+0000 7f497f7fd640 1 --2- 172.21.15.26:0/2358250060 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49780cc3e0 0x7f4978150a40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:57.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.328+0000 7f497f7fd640 1 --2- 172.21.15.26:0/2358250060 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49781e59d0 0x7f49780c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:57.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.328+0000 7f497f7fd640 1 --2- 172.21.15.26:0/2358250060 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4964004800 0x7f49781f0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:57.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.328+0000 7f497f7fd640 1 -- 172.21.15.26:0/2358250060 >> 172.21.15.26:0/2358250060 conn(0x7f49780cd260 msgr2=0x7f4978072820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:28:57.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.328+0000 7f497f7fd640 1 -- 172.21.15.26:0/2358250060 shutdown_connections 2024-09-05T07:28:57.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.328+0000 7f497f7fd640 1 -- 172.21.15.26:0/2358250060 wait complete. 2024-09-05T07:28:57.340 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd new 632ad558-bd14-4240-a8f1-5beda951b3b1 2 2024-09-05T07:28:57.381 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-09-05T07:28:57.382+0000 7fd093520040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-05T07:28:57.437 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-09-05T07:28:57.438+0000 7fd093520040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-05T07:28:57.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.440+0000 7f5954f66640 1 Processor -- start 2024-09-05T07:28:57.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.440+0000 7f5954f66640 1 -- start start 2024-09-05T07:28:57.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.441+0000 7f5954f66640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f59500afd30 0x7f5950067d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:57.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.441+0000 7f5954f66640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f595006ee40 0x7f595006f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:57.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.441+0000 7f5954f66640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f595006f7b0 con 0x7f5950067950 2024-09-05T07:28:57.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.441+0000 7f5954f66640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f595015b6f0 con 0x7f595006ee40 2024-09-05T07:28:57.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.441+0000 7f5954f66640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f595015ab70 con 0x7f59500afd30 2024-09-05T07:28:57.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.442+0000 7f594dd9b640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f59500afd30 0x7f5950067d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:57.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.442+0000 7f594ed9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f595006ee40 0x7f595006f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:57.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.442+0000 7f594ed9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f595006ee40 0x7f595006f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.26:55020/0 (socket says 172.21.15.26:55020) 2024-09-05T07:28:57.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.442+0000 7f594ed9d640 1 -- 172.21.15.26:0/3834503658 learned_addr learned my addr 172.21.15.26:0/3834503658 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-09-05T07:28:57.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.445+0000 7f594dd9b640 1 -- 172.21.15.26:0/3834503658 >> v2:172.21.15.17:3300/0 conn(0x7f595006ee40 msgr2=0x7f595006f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:28:57.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.445+0000 7f594dd9b640 1 --2- 172.21.15.26:0/3834503658 >> v2:172.21.15.17:3300/0 conn(0x7f595006ee40 0x7f595006f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:57.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.445+0000 7f594dd9b640 1 -- 172.21.15.26:0/3834503658 >> v1:172.21.15.17:6789/0 conn(0x7f5950067950 legacy=0x7f5950072820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:28:57.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.445+0000 7f594dd9b640 1 -- 172.21.15.26:0/3834503658 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f595015ae50 con 0x7f59500afd30 2024-09-05T07:28:57.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.447+0000 7f594dd9b640 1 --2- 172.21.15.26:0/3834503658 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f59500afd30 0x7f5950067d30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f59380097a0 tx=0x7f593802a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=558e80fd27341e7d server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:28:57.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.451+0000 7f594d59a640 1 -- 172.21.15.26:0/3834503658 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5938037070 con 0x7f59500afd30 2024-09-05T07:28:57.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.451+0000 7f594d59a640 1 -- 172.21.15.26:0/3834503658 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f593802ae40 con 0x7f59500afd30 2024-09-05T07:28:57.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.451+0000 7f594d59a640 1 -- 172.21.15.26:0/3834503658 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5938032660 con 0x7f59500afd30 2024-09-05T07:28:57.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.451+0000 7f5954f66640 1 -- 172.21.15.26:0/3834503658 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f59500afd30 msgr2=0x7f5950067d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:57.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.451+0000 7f5954f66640 1 --2- 172.21.15.26:0/3834503658 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f59500afd30 0x7f5950067d30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f59380097a0 tx=0x7f593802a130 comp rx=0 tx=0).stop 2024-09-05T07:28:57.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.451+0000 7f5954f66640 1 -- 172.21.15.26:0/3834503658 shutdown_connections 2024-09-05T07:28:57.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.451+0000 7f5954f66640 1 --2- 172.21.15.26:0/3834503658 >> v2:172.21.15.17:3300/0 conn(0x7f595006ee40 0x7f595006f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:57.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.451+0000 7f5954f66640 1 --2- 172.21.15.26:0/3834503658 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f59500afd30 0x7f5950067d30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:57.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.452+0000 7f5954f66640 1 -- 172.21.15.26:0/3834503658 >> 172.21.15.26:0/3834503658 conn(0x7f59500cd260 msgr2=0x7f59500cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:28:57.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.452+0000 7f5954f66640 1 -- 172.21.15.26:0/3834503658 shutdown_connections 2024-09-05T07:28:57.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.452+0000 7f5954f66640 1 -- 172.21.15.26:0/3834503658 wait complete. 2024-09-05T07:28:57.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.453+0000 7f5954f66640 1 Processor -- start 2024-09-05T07:28:57.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.453+0000 7f5954f66640 1 -- start start 2024-09-05T07:28:57.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.454+0000 7f5954f66640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5950067950 0x7f59501f1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:57.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.454+0000 7f5954f66640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f595006ee40 0x7f59501538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:57.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.454+0000 7f5954f66640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59500afd30 0x7f5950153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:57.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.454+0000 7f5954f66640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f595006e920 con 0x7f59500afd30 2024-09-05T07:28:57.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.454+0000 7f5954f66640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f595015b410 con 0x7f595006ee40 2024-09-05T07:28:57.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.454+0000 7f5954f66640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f5950072f30 con 0x7f5950067950 2024-09-05T07:28:57.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.454+0000 7f594e59c640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5950067950 0x7f59501f1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:57.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.454+0000 7f594dd9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f595006ee40 0x7f59501538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:57.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.454+0000 7f594ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59500afd30 0x7f5950153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:57.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.455+0000 7f594ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59500afd30 0x7f5950153e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.26:55026/0 (socket says 172.21.15.26:55026) 2024-09-05T07:28:57.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.455+0000 7f594ed9d640 1 -- 172.21.15.26:0/918031148 learned_addr learned my addr 172.21.15.26:0/918031148 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-09-05T07:28:57.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.458+0000 7f594ed9d640 1 -- 172.21.15.26:0/918031148 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5950067950 msgr2=0x7f59501f1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:57.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.458+0000 7f594ed9d640 1 --2- 172.21.15.26:0/918031148 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5950067950 0x7f59501f1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:57.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.458+0000 7f594ed9d640 1 -- 172.21.15.26:0/918031148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f595006ee40 msgr2=0x7f59501538e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:57.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.458+0000 7f594ed9d640 1 --2- 172.21.15.26:0/918031148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f595006ee40 0x7f59501538e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:57.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.458+0000 7f594ed9d640 1 -- 172.21.15.26:0/918031148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59501556e0 con 0x7f59500afd30 2024-09-05T07:28:57.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.460+0000 7f594ed9d640 1 --2- 172.21.15.26:0/918031148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59500afd30 0x7f5950153e20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f594000e8a0 tx=0x7f594000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:28:57.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.464+0000 7f5946ffd640 1 -- 172.21.15.26:0/918031148 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5940017070 con 0x7f59500afd30 2024-09-05T07:28:57.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.464+0000 7f5946ffd640 1 -- 172.21.15.26:0/918031148 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f594000c940 con 0x7f59500afd30 2024-09-05T07:28:57.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.464+0000 7f5954f66640 1 -- 172.21.15.26:0/918031148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59501559c0 con 0x7f59500afd30 2024-09-05T07:28:57.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.464+0000 7f5946ffd640 1 -- 172.21.15.26:0/918031148 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594000cd30 con 0x7f59500afd30 2024-09-05T07:28:57.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.464+0000 7f5954f66640 1 -- 172.21.15.26:0/918031148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5950156000 con 0x7f59500afd30 2024-09-05T07:28:57.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.465+0000 7f5954f66640 1 -- 172.21.15.26:0/918031148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5950154b60 con 0x7f59500afd30 2024-09-05T07:28:57.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.466+0000 7f5946ffd640 1 -- 172.21.15.26:0/918031148 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f594001a070 con 0x7f59500afd30 2024-09-05T07:28:57.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.466+0000 7f5946ffd640 1 -- 172.21.15.26:0/918031148 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f5940013470 con 0x7f59500afd30 2024-09-05T07:28:57.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.573+0000 7f5946ffd640 1 -- 172.21.15.26:0/918031148 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f5940006530 con 0x7f59500afd30 2024-09-05T07:28:57.643 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.643+0000 7f5954f66640 1 -- 172.21.15.26:0/918031148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd new", "uuid": "632ad558-bd14-4240-a8f1-5beda951b3b1", "id": 2} v 0) -- 0x7f59500af560 con 0x7f59500afd30 2024-09-05T07:28:57.654 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-05T07:28:57.654+0000 7fa1aa71f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-05T07:28:57.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.675+0000 7f5946ffd640 1 -- 172.21.15.26:0/918031148 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "632ad558-bd14-4240-a8f1-5beda951b3b1", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f59400067e0 con 0x7f59500afd30 2024-09-05T07:28:57.675 INFO:teuthology.orchestra.run.smithi026.stdout:2 2024-09-05T07:28:57.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.675+0000 7f5954f66640 1 -- 172.21.15.26:0/918031148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59500afd30 msgr2=0x7f5950153e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:57.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.675+0000 7f5954f66640 1 --2- 172.21.15.26:0/918031148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59500afd30 0x7f5950153e20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f594000e8a0 tx=0x7f594000ed60 comp rx=0 tx=0).stop 2024-09-05T07:28:57.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.676+0000 7f5954f66640 1 -- 172.21.15.26:0/918031148 shutdown_connections 2024-09-05T07:28:57.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.676+0000 7f5954f66640 1 --2- 172.21.15.26:0/918031148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59500afd30 0x7f5950153e20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:57.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.676+0000 7f5954f66640 1 --2- 172.21.15.26:0/918031148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f595006ee40 0x7f59501538e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:57.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.676+0000 7f5954f66640 1 --2- 172.21.15.26:0/918031148 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5950067950 0x7f59501f1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:57.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.676+0000 7f5954f66640 1 -- 172.21.15.26:0/918031148 >> 172.21.15.26:0/918031148 conn(0x7f59500cd260 msgr2=0x7f59500c34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:28:57.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.676+0000 7f5954f66640 1 -- 172.21.15.26:0/918031148 shutdown_connections 2024-09-05T07:28:57.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.676+0000 7f5954f66640 1 -- 172.21.15.26:0/918031148 wait complete. 2024-09-05T07:28:57.686 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd new 9727a970-8f98-45b9-8eca-62da1f28ff17 3 2024-09-05T07:28:57.712 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-05T07:28:57.712+0000 7fa1aa71f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-05T07:28:57.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.826+0000 7f617b952640 1 Processor -- start 2024-09-05T07:28:57.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.826+0000 7f617b952640 1 -- start start 2024-09-05T07:28:57.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.827+0000 7f617b952640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f61740b3150 0x7f617415ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:57.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.827+0000 7f617b952640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f61740c3080 0x7f61740ca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:57.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.827+0000 7f617b952640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61740cafc0 con 0x7f61740caaf0 2024-09-05T07:28:57.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.827+0000 7f617b952640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f617415e740 con 0x7f61740b3150 2024-09-05T07:28:57.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.827+0000 7f617b952640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f61740cb2a0 con 0x7f61740c3080 2024-09-05T07:28:57.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.828+0000 7f6179eef640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f61740c3080 0x7f61740ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:57.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.828+0000 7f61796ee640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f61740b3150 0x7f617415ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:57.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.828+0000 7f6179eef640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f61740c3080 0x7f61740ca440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55162/0 (socket says 172.21.15.26:55162) 2024-09-05T07:28:57.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.828+0000 7f6179eef640 1 -- 172.21.15.26:0/2179264178 learned_addr learned my addr 172.21.15.26:0/2179264178 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-09-05T07:28:57.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.830+0000 7f6179eef640 1 -- 172.21.15.26:0/2179264178 >> v2:172.21.15.17:3300/0 conn(0x7f61740b3150 msgr2=0x7f617415ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:28:57.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.830+0000 7f6179eef640 1 --2- 172.21.15.26:0/2179264178 >> v2:172.21.15.17:3300/0 conn(0x7f61740b3150 0x7f617415ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:57.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.830+0000 7f6179eef640 1 -- 172.21.15.26:0/2179264178 >> v1:172.21.15.17:6789/0 conn(0x7f61740caaf0 legacy=0x7f61740c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:57.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.830+0000 7f6179eef640 1 -- 172.21.15.26:0/2179264178 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61740cb580 con 0x7f61740c3080 2024-09-05T07:28:57.831 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-09-05T07:28:57.831+0000 7fd093520040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-05T07:28:57.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.832+0000 7f6179eef640 1 --2- 172.21.15.26:0/2179264178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61740c3080 0x7f61740ca440 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6174075e70 tx=0x7f616c02a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=458ca20811923c40 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:28:57.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.836+0000 7f616bfff640 1 -- 172.21.15.26:0/2179264178 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f616c036070 con 0x7f61740c3080 2024-09-05T07:28:57.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.836+0000 7f616bfff640 1 -- 172.21.15.26:0/2179264178 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f616c031600 con 0x7f61740c3080 2024-09-05T07:28:57.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.836+0000 7f616bfff640 1 -- 172.21.15.26:0/2179264178 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f616c0319d0 con 0x7f61740c3080 2024-09-05T07:28:57.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.837+0000 7f617b952640 1 -- 172.21.15.26:0/2179264178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61740c3080 msgr2=0x7f61740ca440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:57.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.837+0000 7f617b952640 1 --2- 172.21.15.26:0/2179264178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61740c3080 0x7f61740ca440 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6174075e70 tx=0x7f616c02a730 comp rx=0 tx=0).stop 2024-09-05T07:28:57.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.837+0000 7f617b952640 1 -- 172.21.15.26:0/2179264178 shutdown_connections 2024-09-05T07:28:57.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.837+0000 7f617b952640 1 --2- 172.21.15.26:0/2179264178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61740c3080 0x7f61740ca440 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:57.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.837+0000 7f617b952640 1 --2- 172.21.15.26:0/2179264178 >> v2:172.21.15.17:3300/0 conn(0x7f61740b3150 0x7f617415ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:57.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.837+0000 7f617b952640 1 -- 172.21.15.26:0/2179264178 >> 172.21.15.26:0/2179264178 conn(0x7f6174071450 msgr2=0x7f6174071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:28:57.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.837+0000 7f617b952640 1 -- 172.21.15.26:0/2179264178 shutdown_connections 2024-09-05T07:28:57.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.837+0000 7f617b952640 1 -- 172.21.15.26:0/2179264178 wait complete. 2024-09-05T07:28:57.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.839+0000 7f617b952640 1 Processor -- start 2024-09-05T07:28:57.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.839+0000 7f617b952640 1 -- start start 2024-09-05T07:28:57.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.840+0000 7f617b952640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61740b3150 0x7f61740c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:57.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.840+0000 7f617b952640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61740c3080 0x7f617414e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:57.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.840+0000 7f617b952640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61740caaf0 0x7f617414ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:57.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.840+0000 7f617b952640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f61740b3530 con 0x7f61740caaf0 2024-09-05T07:28:57.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.840+0000 7f617b952640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f617415e3d0 con 0x7f61740c3080 2024-09-05T07:28:57.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.840+0000 7f617b952640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f61740ca010 con 0x7f61740b3150 2024-09-05T07:28:57.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.841+0000 7f6178eed640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61740c3080 0x7f617414e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:57.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.841+0000 7f6179eef640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61740caaf0 0x7f617414ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:57.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.841+0000 7f61796ee640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61740b3150 0x7f61740c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:57.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.841+0000 7f6178eed640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61740c3080 0x7f617414e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55166/0 (socket says 172.21.15.26:55166) 2024-09-05T07:28:57.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.841+0000 7f6178eed640 1 -- 172.21.15.26:0/3934517128 learned_addr learned my addr 172.21.15.26:0/3934517128 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-09-05T07:28:57.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.845+0000 7f6178eed640 1 -- 172.21.15.26:0/3934517128 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61740b3150 msgr2=0x7f61740c69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:57.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.845+0000 7f6178eed640 1 --2- 172.21.15.26:0/3934517128 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61740b3150 0x7f61740c69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:57.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.845+0000 7f6178eed640 1 -- 172.21.15.26:0/3934517128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61740caaf0 msgr2=0x7f617414ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:57.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.845+0000 7f6178eed640 1 --2- 172.21.15.26:0/3934517128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61740caaf0 0x7f617414ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:57.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.845+0000 7f6178eed640 1 -- 172.21.15.26:0/3934517128 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f617415b980 con 0x7f61740c3080 2024-09-05T07:28:57.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.847+0000 7f6178eed640 1 --2- 172.21.15.26:0/3934517128 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61740c3080 0x7f617414e830 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f617000c3c0 tx=0x7f617000c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:28:57.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.851+0000 7f6169ffb640 1 -- 172.21.15.26:0/3934517128 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61700052d0 con 0x7f61740c3080 2024-09-05T07:28:57.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.851+0000 7f6169ffb640 1 -- 172.21.15.26:0/3934517128 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6170005490 con 0x7f61740c3080 2024-09-05T07:28:57.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.851+0000 7f6169ffb640 1 -- 172.21.15.26:0/3934517128 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6170007260 con 0x7f61740c3080 2024-09-05T07:28:57.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.851+0000 7f617b952640 1 -- 172.21.15.26:0/3934517128 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6174153b80 con 0x7f61740c3080 2024-09-05T07:28:57.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.851+0000 7f617b952640 1 -- 172.21.15.26:0/3934517128 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6174155690 con 0x7f61740c3080 2024-09-05T07:28:57.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.852+0000 7f617b952640 1 -- 172.21.15.26:0/3934517128 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6174155f60 con 0x7f61740c3080 2024-09-05T07:28:57.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.853+0000 7f6169ffb640 1 -- 172.21.15.26:0/3934517128 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6170007400 con 0x7f61740c3080 2024-09-05T07:28:57.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.853+0000 7f6169ffb640 1 -- 172.21.15.26:0/3934517128 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f6170011590 con 0x7f61740c3080 2024-09-05T07:28:57.925 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-09-05T07:28:57.925+0000 7fd093520040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-05T07:28:57.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:57.961+0000 7f6169ffb640 1 -- 172.21.15.26:0/3934517128 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f61700039e0 con 0x7f61740c3080 2024-09-05T07:28:58.041 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-09-05T07:28:58.041+0000 7fd093520040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-05T07:28:58.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.050+0000 7f617b952640 1 -- 172.21.15.26:0/3934517128 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9727a970-8f98-45b9-8eca-62da1f28ff17", "id": 3} v 0) -- 0x7f617415ebd0 con 0x7f61740c3080 2024-09-05T07:28:58.091 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-09-05T07:28:58.091+0000 7fd093520040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-05T07:28:58.106 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-05T07:28:58.105+0000 7fa1aa71f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-05T07:28:58.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.117+0000 7f6169ffb640 1 -- 172.21.15.26:0/3934517128 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9727a970-8f98-45b9-8eca-62da1f28ff17", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f6170003cd0 con 0x7f61740c3080 2024-09-05T07:28:58.117 INFO:teuthology.orchestra.run.smithi026.stdout:3 2024-09-05T07:28:58.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.118+0000 7f617b952640 1 -- 172.21.15.26:0/3934517128 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61740c3080 msgr2=0x7f617414e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:58.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.118+0000 7f617b952640 1 --2- 172.21.15.26:0/3934517128 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61740c3080 0x7f617414e830 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f617000c3c0 tx=0x7f617000c880 comp rx=0 tx=0).stop 2024-09-05T07:28:58.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.118+0000 7f617b952640 1 -- 172.21.15.26:0/3934517128 shutdown_connections 2024-09-05T07:28:58.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.118+0000 7f617b952640 1 --2- 172.21.15.26:0/3934517128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61740caaf0 0x7f617414ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:58.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.118+0000 7f617b952640 1 --2- 172.21.15.26:0/3934517128 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61740c3080 0x7f617414e830 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:58.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.118+0000 7f617b952640 1 --2- 172.21.15.26:0/3934517128 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61740b3150 0x7f61740c69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:58.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.118+0000 7f617b952640 1 -- 172.21.15.26:0/3934517128 >> 172.21.15.26:0/3934517128 conn(0x7f6174071450 msgr2=0x7f61741547a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:28:58.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.118+0000 7f617b952640 1 -- 172.21.15.26:0/3934517128 shutdown_connections 2024-09-05T07:28:58.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.118+0000 7f617b952640 1 -- 172.21.15.26:0/3934517128 wait complete. 2024-09-05T07:28:58.129 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd new 0e0141e0-51f1-4229-861f-1992afe70c96 4 2024-09-05T07:28:58.196 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-05T07:28:58.195+0000 7fa1aa71f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-05T07:28:58.213 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-09-05T07:28:58.213+0000 7fd093520040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-05T07:28:58.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.229+0000 7f6abd7c0640 1 Processor -- start 2024-09-05T07:28:58.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.229+0000 7f6abd7c0640 1 -- start start 2024-09-05T07:28:58.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.230+0000 7f6abd7c0640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6ab80ccef0 0x7f6ab80b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:58.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.230+0000 7f6abd7c0640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6ab80b43b0 0x7f6ab8157800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:58.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.230+0000 7f6abd7c0640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ab80cd2d0 0x7f6ab8157d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:58.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.230+0000 7f6abd7c0640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f6ab8158280 con 0x7f6ab80ccef0 2024-09-05T07:28:58.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.230+0000 7f6abd7c0640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f6ab80b3b20 con 0x7f6ab80b43b0 2024-09-05T07:28:58.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.230+0000 7f6abd7c0640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f6ab815b590 con 0x7f6ab80cd2d0 2024-09-05T07:28:58.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.230+0000 7f6ab67fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6ab80b43b0 0x7f6ab8157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:58.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.230+0000 7f6ab77fe640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ab80cd2d0 0x7f6ab8157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:58.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.231+0000 7f6ab6ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6ab80ccef0 0x7f6ab80b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:58.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.231+0000 7f6ab67fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6ab80b43b0 0x7f6ab8157800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55172/0 (socket says 172.21.15.26:55172) 2024-09-05T07:28:58.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.231+0000 7f6ab67fc640 1 -- 172.21.15.26:0/562766841 learned_addr learned my addr 172.21.15.26:0/562766841 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-09-05T07:28:58.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.234+0000 7f6ab67fc640 1 -- 172.21.15.26:0/562766841 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ab80cd2d0 msgr2=0x7f6ab8157d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:28:58.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.234+0000 7f6ab67fc640 1 --2- 172.21.15.26:0/562766841 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ab80cd2d0 0x7f6ab8157d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:58.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.234+0000 7f6ab67fc640 1 -- 172.21.15.26:0/562766841 >> v2:172.21.15.17:3300/0 conn(0x7f6ab80ccef0 msgr2=0x7f6ab80b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:28:58.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.234+0000 7f6ab67fc640 1 --2- 172.21.15.26:0/562766841 >> v2:172.21.15.17:3300/0 conn(0x7f6ab80ccef0 0x7f6ab80b3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:58.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.234+0000 7f6ab67fc640 1 -- 172.21.15.26:0/562766841 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab80b2d60 con 0x7f6ab80b43b0 2024-09-05T07:28:58.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.236+0000 7f6ab67fc640 1 --2- 172.21.15.26:0/562766841 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ab80b43b0 0x7f6ab8157800 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8009870 tx=0x7f6aa802a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d66aeee8b354b16 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:28:58.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.240+0000 7f6ab5ffb640 1 -- 172.21.15.26:0/562766841 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa8037070 con 0x7f6ab80b43b0 2024-09-05T07:28:58.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.240+0000 7f6ab5ffb640 1 -- 172.21.15.26:0/562766841 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aa8032440 con 0x7f6ab80b43b0 2024-09-05T07:28:58.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.240+0000 7f6ab5ffb640 1 -- 172.21.15.26:0/562766841 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa8032810 con 0x7f6ab80b43b0 2024-09-05T07:28:58.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.240+0000 7f6abd7c0640 1 -- 172.21.15.26:0/562766841 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ab80b43b0 msgr2=0x7f6ab8157800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:58.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.240+0000 7f6abd7c0640 1 --2- 172.21.15.26:0/562766841 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ab80b43b0 0x7f6ab8157800 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8009870 tx=0x7f6aa802a210 comp rx=0 tx=0).stop 2024-09-05T07:28:58.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.241+0000 7f6abd7c0640 1 -- 172.21.15.26:0/562766841 shutdown_connections 2024-09-05T07:28:58.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.241+0000 7f6abd7c0640 1 --2- 172.21.15.26:0/562766841 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ab80cd2d0 0x7f6ab8157d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:58.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.241+0000 7f6abd7c0640 1 --2- 172.21.15.26:0/562766841 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ab80b43b0 0x7f6ab8157800 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:58.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.241+0000 7f6abd7c0640 1 --2- 172.21.15.26:0/562766841 >> v2:172.21.15.17:3300/0 conn(0x7f6ab80ccef0 0x7f6ab80b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:58.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.241+0000 7f6abd7c0640 1 -- 172.21.15.26:0/562766841 >> 172.21.15.26:0/562766841 conn(0x7f6ab8072230 msgr2=0x7f6ab8072640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:28:58.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.241+0000 7f6abd7c0640 1 -- 172.21.15.26:0/562766841 shutdown_connections 2024-09-05T07:28:58.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.241+0000 7f6abd7c0640 1 -- 172.21.15.26:0/562766841 wait complete. 2024-09-05T07:28:58.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.242+0000 7f6abd7c0640 1 Processor -- start 2024-09-05T07:28:58.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.242+0000 7f6abd7c0640 1 -- start start 2024-09-05T07:28:58.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.243+0000 7f6abd7c0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ab80b43b0 0x7f6ab8153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:58.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.243+0000 7f6abd7c0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ab80ccef0 0x7f6ab81e4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:58.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.243+0000 7f6abd7c0640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ab80cd2d0 0x7f6ab81e51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:58.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.243+0000 7f6abd7c0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab80b3600 con 0x7f6ab80b43b0 2024-09-05T07:28:58.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.243+0000 7f6abd7c0640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab80b3320 con 0x7f6ab80ccef0 2024-09-05T07:28:58.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.243+0000 7f6abd7c0640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f6ab815dee0 con 0x7f6ab80cd2d0 2024-09-05T07:28:58.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.244+0000 7f6ab67fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ab80ccef0 0x7f6ab81e4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:58.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.244+0000 7f6ab6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ab80b43b0 0x7f6ab8153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:58.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.244+0000 7f6ab77fe640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ab80cd2d0 0x7f6ab81e51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:58.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.244+0000 7f6ab67fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ab80ccef0 0x7f6ab81e4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55186/0 (socket says 172.21.15.26:55186) 2024-09-05T07:28:58.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.244+0000 7f6ab67fc640 1 -- 172.21.15.26:0/3657756059 learned_addr learned my addr 172.21.15.26:0/3657756059 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-09-05T07:28:58.249 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.249+0000 7f6ab67fc640 1 -- 172.21.15.26:0/3657756059 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ab80cd2d0 msgr2=0x7f6ab81e51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:58.249 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.249+0000 7f6ab67fc640 1 --2- 172.21.15.26:0/3657756059 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ab80cd2d0 0x7f6ab81e51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:58.249 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.249+0000 7f6ab67fc640 1 -- 172.21.15.26:0/3657756059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ab80b43b0 msgr2=0x7f6ab8153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:58.249 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.249+0000 7f6ab67fc640 1 --2- 172.21.15.26:0/3657756059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ab80b43b0 0x7f6ab8153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:58.249 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.249+0000 7f6ab67fc640 1 -- 172.21.15.26:0/3657756059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab815db70 con 0x7f6ab80ccef0 2024-09-05T07:28:58.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.252+0000 7f6ab67fc640 1 --2- 172.21.15.26:0/3657756059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ab80ccef0 0x7f6ab81e4c70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6aa802a250 tx=0x7f6aa80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:28:58.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.255+0000 7f6a9f7fe640 1 -- 172.21.15.26:0/3657756059 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa8041020 con 0x7f6ab80ccef0 2024-09-05T07:28:58.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.255+0000 7f6a9f7fe640 1 -- 172.21.15.26:0/3657756059 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aa803d620 con 0x7f6ab80ccef0 2024-09-05T07:28:58.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.255+0000 7f6abd7c0640 1 -- 172.21.15.26:0/3657756059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ab8154120 con 0x7f6ab80ccef0 2024-09-05T07:28:58.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.256+0000 7f6a9f7fe640 1 -- 172.21.15.26:0/3657756059 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa8037040 con 0x7f6ab80ccef0 2024-09-05T07:28:58.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.256+0000 7f6abd7c0640 1 -- 172.21.15.26:0/3657756059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ab81e3ce0 con 0x7f6ab80ccef0 2024-09-05T07:28:58.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.257+0000 7f6abd7c0640 1 -- 172.21.15.26:0/3657756059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ab80b3e70 con 0x7f6ab80ccef0 2024-09-05T07:28:58.271 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-09-05T07:28:58.271+0000 7fd093520040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-05T07:28:58.314 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-05T07:28:58.313+0000 7fa1aa71f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-05T07:28:58.318 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-09-05T07:28:58.318+0000 7fd093520040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-05T07:28:58.361 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-05T07:28:58.361+0000 7fa1aa71f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-05T07:28:58.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.364+0000 7f6a9f7fe640 1 -- 172.21.15.26:0/3657756059 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6aa8044020 con 0x7f6ab80ccef0 2024-09-05T07:28:58.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.364+0000 7f6a9f7fe640 1 -- 172.21.15.26:0/3657756059 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f6aa804fc30 con 0x7f6ab80ccef0 2024-09-05T07:28:58.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.364+0000 7f6a9f7fe640 1 -- 172.21.15.26:0/3657756059 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f6aa804b030 con 0x7f6ab80ccef0 2024-09-05T07:28:58.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.435+0000 7f6abd7c0640 1 -- 172.21.15.26:0/3657756059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0e0141e0-51f1-4229-861f-1992afe70c96", "id": 4} v 0) -- 0x7f6ab815e480 con 0x7f6ab80ccef0 2024-09-05T07:28:58.435 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-09-05T07:28:58.435+0000 7fd093520040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-05T07:28:58.485 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-05T07:28:58.483+0000 7fa1aa71f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-05T07:28:58.489 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-09-05T07:28:58.489+0000 7fd093520040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-05T07:28:58.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.506+0000 7f6a9f7fe640 1 -- 172.21.15.26:0/3657756059 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0e0141e0-51f1-4229-861f-1992afe70c96", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f6aa804f430 con 0x7f6ab80ccef0 2024-09-05T07:28:58.506 INFO:teuthology.orchestra.run.smithi026.stdout:4 2024-09-05T07:28:58.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.507+0000 7f6abd7c0640 1 -- 172.21.15.26:0/3657756059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ab80ccef0 msgr2=0x7f6ab81e4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:58.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.507+0000 7f6abd7c0640 1 --2- 172.21.15.26:0/3657756059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ab80ccef0 0x7f6ab81e4c70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6aa802a250 tx=0x7f6aa80046c0 comp rx=0 tx=0).stop 2024-09-05T07:28:58.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.507+0000 7f6abd7c0640 1 -- 172.21.15.26:0/3657756059 shutdown_connections 2024-09-05T07:28:58.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.507+0000 7f6abd7c0640 1 --2- 172.21.15.26:0/3657756059 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6ab80cd2d0 0x7f6ab81e51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:58.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.507+0000 7f6abd7c0640 1 --2- 172.21.15.26:0/3657756059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ab80ccef0 0x7f6ab81e4c70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:58.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.507+0000 7f6abd7c0640 1 --2- 172.21.15.26:0/3657756059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ab80b43b0 0x7f6ab8153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:58.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.507+0000 7f6abd7c0640 1 -- 172.21.15.26:0/3657756059 >> 172.21.15.26:0/3657756059 conn(0x7f6ab8072230 msgr2=0x7f6ab80ce570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:28:58.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.507+0000 7f6abd7c0640 1 -- 172.21.15.26:0/3657756059 shutdown_connections 2024-09-05T07:28:58.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.507+0000 7f6abd7c0640 1 -- 172.21.15.26:0/3657756059 wait complete. 2024-09-05T07:28:58.517 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd new 5603d79b-fcf8-45aa-a1db-96918af450be 5 2024-09-05T07:28:58.540 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-05T07:28:58.539+0000 7fa1aa71f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-05T07:28:58.545 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-09-05T07:28:58.546+0000 7fd093520040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-05T07:28:58.586 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-05T07:28:58.586+0000 7fa1aa71f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-05T07:28:58.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.616+0000 7fb45c398640 1 Processor -- start 2024-09-05T07:28:58.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.616+0000 7fb45c398640 1 -- start start 2024-09-05T07:28:58.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.617+0000 7fb45c398640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb454067950 0x7fb454067d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:58.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.617+0000 7fb45c398640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb45406ee40 0x7fb45406f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:58.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.617+0000 7fb45c398640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb45406f7d0 con 0x7fb4540afd30 2024-09-05T07:28:58.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.617+0000 7fb45c398640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fb45415b6f0 con 0x7fb454067950 2024-09-05T07:28:58.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.617+0000 7fb45c398640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fb45415ab70 con 0x7fb45406ee40 2024-09-05T07:28:58.618 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-09-05T07:28:58.617+0000 7fd093520040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-05T07:28:58.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.618+0000 7fb45a935640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb45406ee40 0x7fb45406f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:58.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.618+0000 7fb45a134640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb454067950 0x7fb454067d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:58.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.618+0000 7fb459933640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb4540afd30 0x7fb454072820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46572/0 (socket says 172.21.15.26:46572) 2024-09-05T07:28:58.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.618+0000 7fb459933640 1 -- 172.21.15.26:0/2574814899 learned_addr learned my addr 172.21.15.26:0/2574814899 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-09-05T07:28:58.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.622+0000 7fb45a134640 1 -- 172.21.15.26:0/2574814899 >> v2:172.21.15.26:3300/0 conn(0x7fb45406ee40 msgr2=0x7fb45406f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:28:58.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.622+0000 7fb45a134640 1 --2- 172.21.15.26:0/2574814899 >> v2:172.21.15.26:3300/0 conn(0x7fb45406ee40 0x7fb45406f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:58.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.622+0000 7fb45a134640 1 -- 172.21.15.26:0/2574814899 >> v1:172.21.15.26:6789/0 conn(0x7fb4540afd30 legacy=0x7fb454072820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:28:58.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.622+0000 7fb45a134640 1 -- 172.21.15.26:0/2574814899 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb45415ae50 con 0x7fb454067950 2024-09-05T07:28:58.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.625+0000 7fb45a134640 1 --2- 172.21.15.26:0/2574814899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb454067950 0x7fb454067d30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb45406feb0 tx=0x7fb44802a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd9dfd9de8a12f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:28:58.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.629+0000 7fb459132640 1 -- 172.21.15.26:0/2574814899 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb448037070 con 0x7fb454067950 2024-09-05T07:28:58.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.629+0000 7fb459132640 1 -- 172.21.15.26:0/2574814899 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb448032440 con 0x7fb454067950 2024-09-05T07:28:58.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.629+0000 7fb459132640 1 -- 172.21.15.26:0/2574814899 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44802ae60 con 0x7fb454067950 2024-09-05T07:28:58.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.629+0000 7fb45c398640 1 -- 172.21.15.26:0/2574814899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb454067950 msgr2=0x7fb454067d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:58.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.629+0000 7fb45c398640 1 --2- 172.21.15.26:0/2574814899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb454067950 0x7fb454067d30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb45406feb0 tx=0x7fb44802a150 comp rx=0 tx=0).stop 2024-09-05T07:28:58.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.630+0000 7fb45c398640 1 -- 172.21.15.26:0/2574814899 shutdown_connections 2024-09-05T07:28:58.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.630+0000 7fb45c398640 1 --2- 172.21.15.26:0/2574814899 >> v2:172.21.15.26:3300/0 conn(0x7fb45406ee40 0x7fb45406f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:58.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.630+0000 7fb45c398640 1 --2- 172.21.15.26:0/2574814899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb454067950 0x7fb454067d30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:58.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.630+0000 7fb45c398640 1 -- 172.21.15.26:0/2574814899 >> 172.21.15.26:0/2574814899 conn(0x7fb4540cd260 msgr2=0x7fb4540cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:28:58.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.630+0000 7fb45c398640 1 -- 172.21.15.26:0/2574814899 shutdown_connections 2024-09-05T07:28:58.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.630+0000 7fb45c398640 1 -- 172.21.15.26:0/2574814899 wait complete. 2024-09-05T07:28:58.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.631+0000 7fb45c398640 1 Processor -- start 2024-09-05T07:28:58.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.631+0000 7fb45c398640 1 -- start start 2024-09-05T07:28:58.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.631+0000 7fb45c398640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb454067950 0x7fb45414ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:58.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.631+0000 7fb45c398640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb45406ee40 0x7fb45415e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:58.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.631+0000 7fb45c398640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4540afd30 0x7fb4540cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:58.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.631+0000 7fb45c398640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb45406e920 con 0x7fb454067950 2024-09-05T07:28:58.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.632+0000 7fb45c398640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb45415b410 con 0x7fb4540afd30 2024-09-05T07:28:58.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.632+0000 7fb45c398640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fb454072f30 con 0x7fb45406ee40 2024-09-05T07:28:58.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.632+0000 7fb45a134640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb454067950 0x7fb45414ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:58.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.632+0000 7fb459933640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb45406ee40 0x7fb45415e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:58.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.632+0000 7fb459933640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb45406ee40 0x7fb45415e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:57504/0 (socket says 172.21.15.26:57504) 2024-09-05T07:28:58.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.632+0000 7fb459933640 1 -- 172.21.15.26:0/1562259788 learned_addr learned my addr 172.21.15.26:0/1562259788 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-09-05T07:28:58.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.636+0000 7fb45a935640 1 --2- 172.21.15.26:0/1562259788 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4540afd30 0x7fb4540cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:58.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.636+0000 7fb459933640 1 -- 172.21.15.26:0/1562259788 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4540afd30 msgr2=0x7fb4540cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:58.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.636+0000 7fb459933640 1 --2- 172.21.15.26:0/1562259788 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4540afd30 0x7fb4540cc5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:58.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.636+0000 7fb459933640 1 -- 172.21.15.26:0/1562259788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb454067950 msgr2=0x7fb45414ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:58.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.636+0000 7fb459933640 1 --2- 172.21.15.26:0/1562259788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb454067950 0x7fb45414ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:58.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.636+0000 7fb459933640 1 -- 172.21.15.26:0/1562259788 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4540c5ab0 con 0x7fb45406ee40 2024-09-05T07:28:58.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.639+0000 7fb459933640 1 --2- 172.21.15.26:0/1562259788 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb45406ee40 0x7fb45415e610 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb45000b440 tx=0x7fb45000b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:28:58.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.642+0000 7fb446ffd640 1 -- 172.21.15.26:0/1562259788 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb450015020 con 0x7fb45406ee40 2024-09-05T07:28:58.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.642+0000 7fb446ffd640 1 -- 172.21.15.26:0/1562259788 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4500118b0 con 0x7fb45406ee40 2024-09-05T07:28:58.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.642+0000 7fb446ffd640 1 -- 172.21.15.26:0/1562259788 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb450011ca0 con 0x7fb45406ee40 2024-09-05T07:28:58.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.642+0000 7fb45c398640 1 -- 172.21.15.26:0/1562259788 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4540c4360 con 0x7fb45406ee40 2024-09-05T07:28:58.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.642+0000 7fb45c398640 1 -- 172.21.15.26:0/1562259788 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4540c6e20 con 0x7fb45406ee40 2024-09-05T07:28:58.643 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.643+0000 7fb45c398640 1 -- 172.21.15.26:0/1562259788 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb454154b60 con 0x7fb45406ee40 2024-09-05T07:28:58.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.646+0000 7fb446ffd640 1 -- 172.21.15.26:0/1562259788 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb450018020 con 0x7fb45406ee40 2024-09-05T07:28:58.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.646+0000 7fb446ffd640 1 -- 172.21.15.26:0/1562259788 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fb45001ad90 con 0x7fb45406ee40 2024-09-05T07:28:58.666 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-09-05T07:28:58.666+0000 7fd093520040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-05T07:28:58.711 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-05T07:28:58.710+0000 7fa1aa71f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-05T07:28:58.711 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-09-05T07:28:58.712+0000 7fd093520040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-05T07:28:58.752 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.752+0000 7fb446ffd640 1 -- 172.21.15.26:0/1562259788 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fb45001f020 con 0x7fb45406ee40 2024-09-05T07:28:58.763 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-05T07:28:58.763+0000 7fa1aa71f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-05T07:28:58.816 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-05T07:28:58.816+0000 7fa1aa71f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-05T07:28:58.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.824+0000 7fb45c398640 1 -- 172.21.15.26:0/1562259788 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5603d79b-fcf8-45aa-a1db-96918af450be", "id": 5} v 0) -- 0x7fb4540af560 con 0x7fb45406ee40 2024-09-05T07:28:58.892 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-05T07:28:58.889+0000 7fa1aa71f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-05T07:28:58.916 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.916+0000 7fb446ffd640 1 -- 172.21.15.26:0/1562259788 <== mon.2 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5603d79b-fcf8-45aa-a1db-96918af450be", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fb4540c5ab0 con 0x7fb45406ee40 2024-09-05T07:28:58.916 INFO:teuthology.orchestra.run.smithi026.stdout:5 2024-09-05T07:28:58.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.917+0000 7fb45c398640 1 -- 172.21.15.26:0/1562259788 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb45406ee40 msgr2=0x7fb45415e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:58.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.917+0000 7fb45c398640 1 --2- 172.21.15.26:0/1562259788 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb45406ee40 0x7fb45415e610 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb45000b440 tx=0x7fb45000b900 comp rx=0 tx=0).stop 2024-09-05T07:28:58.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.917+0000 7fb45c398640 1 -- 172.21.15.26:0/1562259788 shutdown_connections 2024-09-05T07:28:58.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.917+0000 7fb45c398640 1 --2- 172.21.15.26:0/1562259788 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb45406ee40 0x7fb45415e610 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:58.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.917+0000 7fb45c398640 1 --2- 172.21.15.26:0/1562259788 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4540afd30 0x7fb4540cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:58.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.917+0000 7fb45c398640 1 --2- 172.21.15.26:0/1562259788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb454067950 0x7fb45414ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:58.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.917+0000 7fb45c398640 1 -- 172.21.15.26:0/1562259788 >> 172.21.15.26:0/1562259788 conn(0x7fb4540cd260 msgr2=0x7fb4540c7950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:28:58.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.917+0000 7fb45c398640 1 -- 172.21.15.26:0/1562259788 shutdown_connections 2024-09-05T07:28:58.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:58.917+0000 7fb45c398640 1 -- 172.21.15.26:0/1562259788 wait complete. 2024-09-05T07:28:58.928 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd new 14f3b696-1b3c-4749-8f61-ac10edbb5b49 6 2024-09-05T07:28:58.937 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-05T07:28:58.936+0000 7fa1aa71f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-05T07:28:58.985 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-05T07:28:58.985+0000 7fa1aa71f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-05T07:28:59.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.073+0000 7f5ec5c23640 1 Processor -- start 2024-09-05T07:28:59.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.073+0000 7f5ec5c23640 1 -- start start 2024-09-05T07:28:59.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.074+0000 7f5ec5c23640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5ec0151370 0x7f5ec00c5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:59.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.074+0000 7f5ec5c23640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5ec00c7fb0 0x7f5ec00c9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:59.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.074+0000 7f5ec5c23640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ec00c7230 con 0x7f5ec00c9e70 2024-09-05T07:28:59.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.074+0000 7f5ec5c23640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f5ec00c5670 con 0x7f5ec0151370 2024-09-05T07:28:59.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.074+0000 7f5ec5c23640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f5ec00c39f0 con 0x7f5ec00c7fb0 2024-09-05T07:28:59.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.075+0000 7f5ebffff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5ec00c7fb0 0x7f5ec00c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:59.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.075+0000 7f5ebf7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5ec0151370 0x7f5ec00c5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:59.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.075+0000 7f5ebffff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5ec00c7fb0 0x7f5ec00c9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:57510/0 (socket says 172.21.15.26:57510) 2024-09-05T07:28:59.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.075+0000 7f5ebffff640 1 -- 172.21.15.26:0/2152853392 learned_addr learned my addr 172.21.15.26:0/2152853392 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-09-05T07:28:59.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.077+0000 7f5ebffff640 1 -- 172.21.15.26:0/2152853392 >> v2:172.21.15.26:3300/0 conn(0x7f5ec0151370 msgr2=0x7f5ec00c5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:28:59.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.077+0000 7f5ebffff640 1 --2- 172.21.15.26:0/2152853392 >> v2:172.21.15.26:3300/0 conn(0x7f5ec0151370 0x7f5ec00c5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:59.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.077+0000 7f5ebffff640 1 -- 172.21.15.26:0/2152853392 >> v1:172.21.15.26:6789/0 conn(0x7f5ec00c9e70 legacy=0x7f5ec01578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:59.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.077+0000 7f5ebffff640 1 -- 172.21.15.26:0/2152853392 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec00c8b90 con 0x7f5ec00c7fb0 2024-09-05T07:28:59.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.079+0000 7f5ebffff640 1 --2- 172.21.15.26:0/2152853392 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5ec00c7fb0 0x7f5ec00c9290 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5eb800d150 tx=0x7f5eb802c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be9b4c709106465 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:28:59.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.083+0000 7f5ebeffd640 1 -- 172.21.15.26:0/2152853392 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8009600 con 0x7f5ec00c7fb0 2024-09-05T07:28:59.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.084+0000 7f5ebeffd640 1 -- 172.21.15.26:0/2152853392 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5eb8037070 con 0x7f5ec00c7fb0 2024-09-05T07:28:59.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.084+0000 7f5ebeffd640 1 -- 172.21.15.26:0/2152853392 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb80099c0 con 0x7f5ec00c7fb0 2024-09-05T07:28:59.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.084+0000 7f5ec5c23640 1 -- 172.21.15.26:0/2152853392 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5ec00c7fb0 msgr2=0x7f5ec00c9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:59.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.084+0000 7f5ec5c23640 1 --2- 172.21.15.26:0/2152853392 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5ec00c7fb0 0x7f5ec00c9290 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5eb800d150 tx=0x7f5eb802c930 comp rx=0 tx=0).stop 2024-09-05T07:28:59.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.084+0000 7f5ec5c23640 1 -- 172.21.15.26:0/2152853392 shutdown_connections 2024-09-05T07:28:59.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.084+0000 7f5ec5c23640 1 --2- 172.21.15.26:0/2152853392 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5ec00c7fb0 0x7f5ec00c9290 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:59.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.084+0000 7f5ec5c23640 1 --2- 172.21.15.26:0/2152853392 >> v2:172.21.15.26:3300/0 conn(0x7f5ec0151370 0x7f5ec00c5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:59.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.084+0000 7f5ec5c23640 1 -- 172.21.15.26:0/2152853392 >> 172.21.15.26:0/2152853392 conn(0x7f5ec006fac0 msgr2=0x7f5ec006fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:28:59.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.084+0000 7f5ec5c23640 1 -- 172.21.15.26:0/2152853392 shutdown_connections 2024-09-05T07:28:59.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.084+0000 7f5ec5c23640 1 -- 172.21.15.26:0/2152853392 wait complete. 2024-09-05T07:28:59.086 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.086+0000 7f5ec5c23640 1 Processor -- start 2024-09-05T07:28:59.086 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.087+0000 7f5ec5c23640 1 -- start start 2024-09-05T07:28:59.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.088+0000 7f5ec5c23640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ec00c7fb0 0x7f5ec00cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:59.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.088+0000 7f5ec5c23640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ec00c9e70 0x7f5ec01f0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:59.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.088+0000 7f5ec5c23640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5ec0151370 0x7f5ec01f1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:59.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.088+0000 7f5ec5c23640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec00c77b0 con 0x7f5ec00c7fb0 2024-09-05T07:28:59.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.088+0000 7f5ec5c23640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec00c74d0 con 0x7f5ec00c9e70 2024-09-05T07:28:59.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.088+0000 7f5ec5c23640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f5ec00c7a90 con 0x7f5ec0151370 2024-09-05T07:28:59.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.088+0000 7f5ebffff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5ec0151370 0x7f5ec01f1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:59.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.089+0000 7f5ebf7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ec00c7fb0 0x7f5ec00cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:59.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.089+0000 7f5ebffff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5ec0151370 0x7f5ec01f1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:57526/0 (socket says 172.21.15.26:57526) 2024-09-05T07:28:59.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.089+0000 7f5ebffff640 1 -- 172.21.15.26:0/788552208 learned_addr learned my addr 172.21.15.26:0/788552208 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-09-05T07:28:59.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.092+0000 7f5ebffff640 1 -- 172.21.15.26:0/788552208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ec00c9e70 msgr2=0x7f5ec01f0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:59.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.092+0000 7f5ebffff640 1 --2- 172.21.15.26:0/788552208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ec00c9e70 0x7f5ec01f0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:59.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.092+0000 7f5ebffff640 1 -- 172.21.15.26:0/788552208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ec00c7fb0 msgr2=0x7f5ec00cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:59.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.092+0000 7f5ebffff640 1 --2- 172.21.15.26:0/788552208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ec00c7fb0 0x7f5ec00cbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:59.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.092+0000 7f5ebffff640 1 -- 172.21.15.26:0/788552208 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec00c3ec0 con 0x7f5ec0151370 2024-09-05T07:28:59.094 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.094+0000 7f5ebffff640 1 --2- 172.21.15.26:0/788552208 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5ec0151370 0x7f5ec01f1400 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5eb800d270 tx=0x7f5eb8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:28:59.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.098+0000 7f5ebcff9640 1 -- 172.21.15.26:0/788552208 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8009dc0 con 0x7f5ec0151370 2024-09-05T07:28:59.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.098+0000 7f5ebcff9640 1 -- 172.21.15.26:0/788552208 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5eb8032420 con 0x7f5ec0151370 2024-09-05T07:28:59.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.099+0000 7f5ec5c23640 1 -- 172.21.15.26:0/788552208 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ec01f4130 con 0x7f5ec0151370 2024-09-05T07:28:59.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.099+0000 7f5ebcff9640 1 -- 172.21.15.26:0/788552208 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8032810 con 0x7f5ec0151370 2024-09-05T07:28:59.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.099+0000 7f5ec5c23640 1 -- 172.21.15.26:0/788552208 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ec01f46f0 con 0x7f5ec0151370 2024-09-05T07:28:59.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.100+0000 7f5ec5c23640 1 -- 172.21.15.26:0/788552208 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ec00c87e0 con 0x7f5ec0151370 2024-09-05T07:28:59.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.103+0000 7f5ebcff9640 1 -- 172.21.15.26:0/788552208 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5eb8043020 con 0x7f5ec0151370 2024-09-05T07:28:59.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.103+0000 7f5ebcff9640 1 -- 172.21.15.26:0/788552208 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f5eb804e9e0 con 0x7f5ec0151370 2024-09-05T07:28:59.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.213+0000 7f5ebcff9640 1 -- 172.21.15.26:0/788552208 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f5eb80093e0 con 0x7f5ec0151370 2024-09-05T07:28:59.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.302+0000 7f5ec5c23640 1 -- 172.21.15.26:0/788552208 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd new", "uuid": "14f3b696-1b3c-4749-8f61-ac10edbb5b49", "id": 6} v 0) -- 0x7f5ec00708d0 con 0x7f5ec0151370 2024-09-05T07:28:59.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.366+0000 7f5ebcff9640 1 -- 172.21.15.26:0/788552208 <== mon.2 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "14f3b696-1b3c-4749-8f61-ac10edbb5b49", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f5eb80540b0 con 0x7f5ec0151370 2024-09-05T07:28:59.366 INFO:teuthology.orchestra.run.smithi026.stdout:6 2024-09-05T07:28:59.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.367+0000 7f5ec5c23640 1 -- 172.21.15.26:0/788552208 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5ec0151370 msgr2=0x7f5ec01f1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:59.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.367+0000 7f5ec5c23640 1 --2- 172.21.15.26:0/788552208 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5ec0151370 0x7f5ec01f1400 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5eb800d270 tx=0x7f5eb8004a40 comp rx=0 tx=0).stop 2024-09-05T07:28:59.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.367+0000 7f5ec5c23640 1 -- 172.21.15.26:0/788552208 shutdown_connections 2024-09-05T07:28:59.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.367+0000 7f5ec5c23640 1 --2- 172.21.15.26:0/788552208 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5ec0151370 0x7f5ec01f1400 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:59.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.367+0000 7f5ec5c23640 1 --2- 172.21.15.26:0/788552208 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ec00c9e70 0x7f5ec01f0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:59.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.367+0000 7f5ec5c23640 1 --2- 172.21.15.26:0/788552208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ec00c7fb0 0x7f5ec00cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:59.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.367+0000 7f5ec5c23640 1 -- 172.21.15.26:0/788552208 >> 172.21.15.26:0/788552208 conn(0x7f5ec006fac0 msgr2=0x7f5ec0156150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:28:59.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.368+0000 7f5ec5c23640 1 -- 172.21.15.26:0/788552208 shutdown_connections 2024-09-05T07:28:59.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.368+0000 7f5ec5c23640 1 -- 172.21.15.26:0/788552208 wait complete. 2024-09-05T07:28:59.378 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd new be7b4121-c71b-4908-ba4a-9c4389423201 7 2024-09-05T07:28:59.433 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-09-05T07:28:59.433+0000 7fd093520040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-05T07:28:59.483 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.483+0000 7f62faa5e640 1 Processor -- start 2024-09-05T07:28:59.483 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.483+0000 7f62faa5e640 1 -- start start 2024-09-05T07:28:59.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.484+0000 7f62faa5e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f62f4154bf0 0x7f62f40b4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:59.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.484+0000 7f62faa5e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f62f4072230 0x7f62f4072660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:59.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.484+0000 7f62faa5e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62f40cd730 con 0x7f62f40cd2c0 2024-09-05T07:28:59.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.484+0000 7f62faa5e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f62f40cb470 con 0x7f62f4154bf0 2024-09-05T07:28:59.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.484+0000 7f62faa5e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f62f40cb750 con 0x7f62f4072230 2024-09-05T07:28:59.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.485+0000 7f62f3fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f62f4154bf0 0x7f62f40b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:59.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.485+0000 7f62f3fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f62f4154bf0 0x7f62f40b4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.26:55122/0 (socket says 172.21.15.26:55122) 2024-09-05T07:28:59.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.485+0000 7f62f3fff640 1 -- 172.21.15.26:0/1115513365 learned_addr learned my addr 172.21.15.26:0/1115513365 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-09-05T07:28:59.489 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.489+0000 7f62f3fff640 1 -- 172.21.15.26:0/1115513365 >> v2:172.21.15.26:3300/0 conn(0x7f62f4072230 msgr2=0x7f62f4072660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:28:59.489 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.489+0000 7f62f3fff640 1 --2- 172.21.15.26:0/1115513365 >> v2:172.21.15.26:3300/0 conn(0x7f62f4072230 0x7f62f4072660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:59.489 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.489+0000 7f62f3fff640 1 -- 172.21.15.26:0/1115513365 >> v1:172.21.15.26:6789/0 conn(0x7f62f40cd2c0 legacy=0x7f62f415b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:28:59.489 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.489+0000 7f62f3fff640 1 -- 172.21.15.26:0/1115513365 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f40cc7e0 con 0x7f62f4154bf0 2024-09-05T07:28:59.491 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.491+0000 7f62f3fff640 1 --2- 172.21.15.26:0/1115513365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62f4154bf0 0x7f62f40b4680 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f62f40734b0 tx=0x7f62e402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aedfffedacb943b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:28:59.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.591+0000 7f62f2ffd640 1 -- 172.21.15.26:0/1115513365 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e4037070 con 0x7f62f4154bf0 2024-09-05T07:28:59.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.597+0000 7f62f2ffd640 1 -- 172.21.15.26:0/1115513365 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e4032440 con 0x7f62f4154bf0 2024-09-05T07:28:59.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.597+0000 7f62f2ffd640 1 -- 172.21.15.26:0/1115513365 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e4032810 con 0x7f62f4154bf0 2024-09-05T07:28:59.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.598+0000 7f62faa5e640 1 -- 172.21.15.26:0/1115513365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62f4154bf0 msgr2=0x7f62f40b4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:59.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.598+0000 7f62faa5e640 1 --2- 172.21.15.26:0/1115513365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62f4154bf0 0x7f62f40b4680 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f62f40734b0 tx=0x7f62e402a230 comp rx=0 tx=0).stop 2024-09-05T07:28:59.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.598+0000 7f62faa5e640 1 -- 172.21.15.26:0/1115513365 shutdown_connections 2024-09-05T07:28:59.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.598+0000 7f62faa5e640 1 --2- 172.21.15.26:0/1115513365 >> v2:172.21.15.26:3300/0 conn(0x7f62f4072230 0x7f62f4072660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:59.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.598+0000 7f62faa5e640 1 --2- 172.21.15.26:0/1115513365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62f4154bf0 0x7f62f40b4680 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:59.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.598+0000 7f62faa5e640 1 -- 172.21.15.26:0/1115513365 >> 172.21.15.26:0/1115513365 conn(0x7f62f406bc10 msgr2=0x7f62f406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:28:59.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.598+0000 7f62faa5e640 1 -- 172.21.15.26:0/1115513365 shutdown_connections 2024-09-05T07:28:59.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.598+0000 7f62faa5e640 1 -- 172.21.15.26:0/1115513365 wait complete. 2024-09-05T07:28:59.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.599+0000 7f62faa5e640 1 Processor -- start 2024-09-05T07:28:59.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.600+0000 7f62faa5e640 1 -- start start 2024-09-05T07:28:59.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.600+0000 7f62faa5e640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62f4072230 0x7f62f41e3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:59.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.600+0000 7f62faa5e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62f40cd2c0 0x7f62f40ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:59.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.600+0000 7f62faa5e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62f4154bf0 0x7f62f40d06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:28:59.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.600+0000 7f62faa5e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f62f40cbb70 con 0x7f62f40cd2c0 2024-09-05T07:28:59.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.600+0000 7f62faa5e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f62f40ccda0 con 0x7f62f4154bf0 2024-09-05T07:28:59.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.600+0000 7f62faa5e640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f62f40cbcf0 con 0x7f62f4072230 2024-09-05T07:28:59.601 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.601+0000 7f62f3fff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62f4072230 0x7f62f41e3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:59.601 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.601+0000 7f62f8ffb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62f4154bf0 0x7f62f40d06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:59.601 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.601+0000 7f62f8ffb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62f4154bf0 0x7f62f40d06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55260/0 (socket says 172.21.15.26:55260) 2024-09-05T07:28:59.601 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.601+0000 7f62f8ffb640 1 -- 172.21.15.26:0/3091797504 learned_addr learned my addr 172.21.15.26:0/3091797504 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-09-05T07:28:59.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.604+0000 7f62f37fe640 1 --2- 172.21.15.26:0/3091797504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62f40cd2c0 0x7f62f40ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:28:59.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.605+0000 7f62f8ffb640 1 -- 172.21.15.26:0/3091797504 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62f4072230 msgr2=0x7f62f41e3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:59.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.605+0000 7f62f8ffb640 1 --2- 172.21.15.26:0/3091797504 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62f4072230 0x7f62f41e3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:59.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.605+0000 7f62f8ffb640 1 -- 172.21.15.26:0/3091797504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62f40cd2c0 msgr2=0x7f62f40ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:28:59.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.605+0000 7f62f8ffb640 1 --2- 172.21.15.26:0/3091797504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62f40cd2c0 0x7f62f40ca2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:28:59.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.605+0000 7f62f8ffb640 1 -- 172.21.15.26:0/3091797504 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f40c9820 con 0x7f62f4154bf0 2024-09-05T07:28:59.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.616+0000 7f62f8ffb640 1 --2- 172.21.15.26:0/3091797504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62f4154bf0 0x7f62f40d06f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f62ec00b9a0 tx=0x7f62ec00be60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:28:59.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.623+0000 7f62f0ff9640 1 -- 172.21.15.26:0/3091797504 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ec019070 con 0x7f62f4154bf0 2024-09-05T07:28:59.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.623+0000 7f62f0ff9640 1 -- 172.21.15.26:0/3091797504 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62ec00cbc0 con 0x7f62f4154bf0 2024-09-05T07:28:59.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.623+0000 7f62f0ff9640 1 -- 172.21.15.26:0/3091797504 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ec014440 con 0x7f62f4154bf0 2024-09-05T07:28:59.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.623+0000 7f62faa5e640 1 -- 172.21.15.26:0/3091797504 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62f41f0fe0 con 0x7f62f4154bf0 2024-09-05T07:28:59.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.623+0000 7f62faa5e640 1 -- 172.21.15.26:0/3091797504 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62f40c9ac0 con 0x7f62f4154bf0 2024-09-05T07:28:59.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.624+0000 7f62faa5e640 1 -- 172.21.15.26:0/3091797504 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62f4076450 con 0x7f62f4154bf0 2024-09-05T07:28:59.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.625+0000 7f62f0ff9640 1 -- 172.21.15.26:0/3091797504 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f62ec01c070 con 0x7f62f4154bf0 2024-09-05T07:28:59.687 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-09-05T07:28:59.686+0000 7fa1aa71f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-05T07:28:59.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.730+0000 7f62f0ff9640 1 -- 172.21.15.26:0/3091797504 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f62ec01da10 con 0x7f62f4154bf0 2024-09-05T07:28:59.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.731+0000 7f62f0ff9640 1 -- 172.21.15.26:0/3091797504 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f62f4076450 con 0x7f62f4154bf0 2024-09-05T07:28:59.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.835+0000 7f62faa5e640 1 -- 172.21.15.26:0/3091797504 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd new", "uuid": "be7b4121-c71b-4908-ba4a-9c4389423201", "id": 7} v 0) -- 0x7f62f40b4680 con 0x7f62f4154bf0 2024-09-05T07:28:59.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:28:59.877+0000 7f62f0ff9640 1 -- 172.21.15.26:0/3091797504 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mgrmap(e 2) ==== 45274+0+0 (secure 0 0 0) 0x7f62ec01d3b0 con 0x7f62f4154bf0 2024-09-05T07:29:00.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:29:00.278+0000 7f62f0ff9640 1 -- 172.21.15.26:0/3091797504 <== mon.1 v2:172.21.15.26:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "be7b4121-c71b-4908-ba4a-9c4389423201", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f62ec023080 con 0x7f62f4154bf0 2024-09-05T07:29:00.278 INFO:teuthology.orchestra.run.smithi026.stdout:7 2024-09-05T07:29:00.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:29:00.279+0000 7f62faa5e640 1 -- 172.21.15.26:0/3091797504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62f4154bf0 msgr2=0x7f62f40d06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:00.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:29:00.279+0000 7f62faa5e640 1 --2- 172.21.15.26:0/3091797504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62f4154bf0 0x7f62f40d06f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f62ec00b9a0 tx=0x7f62ec00be60 comp rx=0 tx=0).stop 2024-09-05T07:29:00.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:29:00.279+0000 7f62faa5e640 1 -- 172.21.15.26:0/3091797504 shutdown_connections 2024-09-05T07:29:00.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:29:00.279+0000 7f62faa5e640 1 --2- 172.21.15.26:0/3091797504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62f4154bf0 0x7f62f40d06f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:00.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:29:00.279+0000 7f62faa5e640 1 --2- 172.21.15.26:0/3091797504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62f40cd2c0 0x7f62f40ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:00.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:29:00.279+0000 7f62faa5e640 1 --2- 172.21.15.26:0/3091797504 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62f4072230 0x7f62f41e3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:00.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:29:00.279+0000 7f62faa5e640 1 -- 172.21.15.26:0/3091797504 >> 172.21.15.26:0/3091797504 conn(0x7f62f406bc10 msgr2=0x7f62f406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:00.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:29:00.279+0000 7f62faa5e640 1 -- 172.21.15.26:0/3091797504 shutdown_connections 2024-09-05T07:29:00.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-09-05T07:29:00.280+0000 7f62faa5e640 1 -- 172.21.15.26:0/3091797504 wait complete. 2024-09-05T07:29:00.289 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-05T07:29:00.290 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2024-09-05T07:29:00.292 INFO:tasks.ceph.osd.0:Started 2024-09-05T07:29:00.292 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-05T07:29:00.292 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2024-09-05T07:29:00.294 INFO:tasks.ceph.osd.1:Started 2024-09-05T07:29:00.294 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-05T07:29:00.294 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2024-09-05T07:29:00.296 INFO:tasks.ceph.osd.2:Started 2024-09-05T07:29:00.297 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-05T07:29:00.297 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2024-09-05T07:29:00.299 INFO:tasks.ceph.osd.3:Started 2024-09-05T07:29:00.299 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-05T07:29:00.299 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2024-09-05T07:29:00.301 INFO:tasks.ceph.osd.4:Started 2024-09-05T07:29:00.301 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-05T07:29:00.301 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2024-09-05T07:29:00.303 INFO:tasks.ceph.osd.5:Started 2024-09-05T07:29:00.303 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-05T07:29:00.303 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2024-09-05T07:29:00.305 INFO:tasks.ceph.osd.6:Started 2024-09-05T07:29:00.305 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-05T07:29:00.306 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2024-09-05T07:29:00.307 INFO:tasks.ceph.osd.7:Started 2024-09-05T07:29:00.308 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-05T07:29:00.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.442+0000 7fd3947e4640 1 Processor -- start 2024-09-05T07:29:00.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.442+0000 7fd3947e4640 1 -- start start 2024-09-05T07:29:00.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.443+0000 7fd3947e4640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd38c0cafa0 0x7fd38c15b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:00.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.443+0000 7fd3947e4640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd38c06c8c0 con 0x7fd38c0c5a80 2024-09-05T07:29:00.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.443+0000 7fd3947e4640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd38c0cb950 con 0x7fd38c154770 2024-09-05T07:29:00.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.443+0000 7fd3947e4640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fd38c0c5310 con 0x7fd38c0cafa0 2024-09-05T07:29:00.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.445+0000 7fd392580640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd38c154770 0x7fd38c0d05c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.17:56916/0 (socket says 172.21.15.17:56916) 2024-09-05T07:29:00.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.445+0000 7fd392580640 1 -- 172.21.15.17:0/707914092 learned_addr learned my addr 172.21.15.17:0/707914092 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:29:00.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.481+0000 7fd391d7f640 1 --2- 172.21.15.17:0/707914092 >> v2:172.21.15.17:3300/0 conn(0x7fd38c0cafa0 0x7fd38c15b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:00.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.488+0000 7fd391d7f640 1 -- 172.21.15.17:0/707914092 >> v1:172.21.15.26:6789/0 conn(0x7fd38c154770 legacy=0x7fd38c0d05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:00.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.488+0000 7fd391d7f640 1 -- 172.21.15.17:0/707914092 >> v1:172.21.15.17:6789/0 conn(0x7fd38c0c5a80 legacy=0x7fd38c0c5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:00.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.488+0000 7fd391d7f640 1 -- 172.21.15.17:0/707914092 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd38c06cb60 con 0x7fd38c0cafa0 2024-09-05T07:29:00.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.493+0000 7fd391d7f640 1 --2- 172.21.15.17:0/707914092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd38c0cafa0 0x7fd38c15b240 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0097a0 tx=0x7fd37c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe2bb1d9d4c8e29 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:00.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.509+0000 7fd39157e640 1 -- 172.21.15.17:0/707914092 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37c037070 con 0x7fd38c0cafa0 2024-09-05T07:29:00.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.509+0000 7fd39157e640 1 -- 172.21.15.17:0/707914092 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd37c02ae50 con 0x7fd38c0cafa0 2024-09-05T07:29:00.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.509+0000 7fd39157e640 1 -- 172.21.15.17:0/707914092 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37c032660 con 0x7fd38c0cafa0 2024-09-05T07:29:00.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.510+0000 7fd3947e4640 1 -- 172.21.15.17:0/707914092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd38c0cafa0 msgr2=0x7fd38c15b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:00.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.510+0000 7fd3947e4640 1 --2- 172.21.15.17:0/707914092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd38c0cafa0 0x7fd38c15b240 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0097a0 tx=0x7fd37c02a140 comp rx=0 tx=0).stop 2024-09-05T07:29:00.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.510+0000 7fd3947e4640 1 -- 172.21.15.17:0/707914092 shutdown_connections 2024-09-05T07:29:00.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.510+0000 7fd3947e4640 1 --2- 172.21.15.17:0/707914092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd38c0cafa0 0x7fd38c15b240 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:00.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.510+0000 7fd3947e4640 1 -- 172.21.15.17:0/707914092 >> 172.21.15.17:0/707914092 conn(0x7fd38c073710 msgr2=0x7fd38c073b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:00.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.510+0000 7fd3947e4640 1 -- 172.21.15.17:0/707914092 shutdown_connections 2024-09-05T07:29:00.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.510+0000 7fd3947e4640 1 -- 172.21.15.17:0/707914092 wait complete. 2024-09-05T07:29:00.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.511+0000 7fd3947e4640 1 Processor -- start 2024-09-05T07:29:00.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.511+0000 7fd3947e4640 1 -- start start 2024-09-05T07:29:00.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.512+0000 7fd3947e4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd38c0c5a80 0x7fd38c1f3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:00.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.512+0000 7fd3947e4640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd38c0cafa0 0x7fd38c1f3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:00.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.512+0000 7fd3947e4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd38c154770 0x7fd38c0c9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:00.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.512+0000 7fd3947e4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd38c154b50 con 0x7fd38c0c5a80 2024-09-05T07:29:00.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.512+0000 7fd3947e4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd38c0cbc30 con 0x7fd38c154770 2024-09-05T07:29:00.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.512+0000 7fd3947e4640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fd38c0d0cd0 con 0x7fd38c0cafa0 2024-09-05T07:29:00.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.512+0000 7fd391d7f640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd38c0cafa0 0x7fd38c1f3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:00.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.513+0000 7fd392d81640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd38c154770 0x7fd38c0c9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:00.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.513+0000 7fd391d7f640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd38c0cafa0 0x7fd38c1f3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:40624/0 (socket says 172.21.15.17:40624) 2024-09-05T07:29:00.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.513+0000 7fd392d81640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd38c154770 0x7fd38c0c9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:57012/0 (socket says 172.21.15.17:57012) 2024-09-05T07:29:00.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.513+0000 7fd391d7f640 1 -- 172.21.15.17:0/3900816159 learned_addr learned my addr 172.21.15.17:0/3900816159 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:00.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.515+0000 7fd392580640 1 --2- 172.21.15.17:0/3900816159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd38c0c5a80 0x7fd38c1f3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:00.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.518+0000 7fd391d7f640 1 -- 172.21.15.17:0/3900816159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd38c154770 msgr2=0x7fd38c0c9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:00.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.518+0000 7fd391d7f640 1 --2- 172.21.15.17:0/3900816159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd38c154770 0x7fd38c0c9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:00.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.518+0000 7fd391d7f640 1 -- 172.21.15.17:0/3900816159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd38c0c5a80 msgr2=0x7fd38c1f3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:00.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.518+0000 7fd391d7f640 1 --2- 172.21.15.17:0/3900816159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd38c0c5a80 0x7fd38c1f3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:00.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.518+0000 7fd391d7f640 1 -- 172.21.15.17:0/3900816159 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd38c1f2680 con 0x7fd38c0cafa0 2024-09-05T07:29:00.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.521+0000 7fd391d7f640 1 --2- 172.21.15.17:0/3900816159 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd38c0cafa0 0x7fd38c1f3fe0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0098c0 tx=0x7fd37c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:00.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.523+0000 7fd382ffd640 1 -- 172.21.15.17:0/3900816159 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37c042020 con 0x7fd38c0cafa0 2024-09-05T07:29:00.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.523+0000 7fd3947e4640 1 -- 172.21.15.17:0/3900816159 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd38c1f4a10 con 0x7fd38c0cafa0 2024-09-05T07:29:00.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.523+0000 7fd3947e4640 1 -- 172.21.15.17:0/3900816159 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd38c1f2c20 con 0x7fd38c0cafa0 2024-09-05T07:29:00.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.524+0000 7fd3947e4640 1 -- 172.21.15.17:0/3900816159 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd38c06bca0 con 0x7fd38c0cafa0 2024-09-05T07:29:00.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.524+0000 7fd382ffd640 1 -- 172.21.15.17:0/3900816159 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd37c03d670 con 0x7fd38c0cafa0 2024-09-05T07:29:00.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.524+0000 7fd382ffd640 1 -- 172.21.15.17:0/3900816159 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37c037040 con 0x7fd38c0cafa0 2024-09-05T07:29:00.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.638+0000 7fd382ffd640 1 -- 172.21.15.17:0/3900816159 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 2) ==== 45274+0+0 (secure 0 0 0) 0x7fd37c045020 con 0x7fd38c0cafa0 2024-09-05T07:29:00.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.645+0000 7fd382ffd640 1 -- 172.21.15.17:0/3900816159 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fd37c03e7a0 con 0x7fd38c0cafa0 2024-09-05T07:29:00.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.645+0000 7fd382ffd640 1 -- 172.21.15.17:0/3900816159 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd37c04c030 con 0x7fd38c0cafa0 2024-09-05T07:29:00.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.704+0000 7fd3947e4640 1 -- 172.21.15.17:0/3900816159 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd38c1532f0 con 0x7fd38c0cafa0 2024-09-05T07:29:00.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.828+0000 7fd382ffd640 1 -- 172.21.15.17:0/3900816159 <== mon.2 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fd37c0463b0 con 0x7fd38c0cafa0 2024-09-05T07:29:00.828 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:29:00.829 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":10,"fsid":"848dac54-74f8-48f3-8686-c6495dcb972b","created":"2024-09-05T07:28:54.070215+0000","modified":"2024-09-05T07:29:00.001829+0000","last_up_change":"0.000000","last_in_change":"2024-09-05T07:29:00.001829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2f01a8b4-dc10-4cdf-a65e-b7f96de4e2b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d16867fb-2290-486c-9ac8-327ca54326d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"632ad558-bd14-4240-a8f1-5beda951b3b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9727a970-8f98-45b9-8eca-62da1f28ff17","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0e0141e0-51f1-4229-861f-1992afe70c96","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5603d79b-fcf8-45aa-a1db-96918af450be","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"14f3b696-1b3c-4749-8f61-ac10edbb5b49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"be7b4121-c71b-4908-ba4a-9c4389423201","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T07:29:00.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.828+0000 7fd3947e4640 1 -- 172.21.15.17:0/3900816159 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd38c0cafa0 msgr2=0x7fd38c1f3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:00.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.828+0000 7fd3947e4640 1 --2- 172.21.15.17:0/3900816159 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd38c0cafa0 0x7fd38c1f3fe0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0098c0 tx=0x7fd37c0046c0 comp rx=0 tx=0).stop 2024-09-05T07:29:00.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.829+0000 7fd3947e4640 1 -- 172.21.15.17:0/3900816159 shutdown_connections 2024-09-05T07:29:00.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.829+0000 7fd3947e4640 1 --2- 172.21.15.17:0/3900816159 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd38c0cafa0 0x7fd38c1f3fe0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:00.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.829+0000 7fd3947e4640 1 --2- 172.21.15.17:0/3900816159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd38c154770 0x7fd38c0c9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:00.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.829+0000 7fd3947e4640 1 --2- 172.21.15.17:0/3900816159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd38c0c5a80 0x7fd38c1f3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:00.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.829+0000 7fd3947e4640 1 -- 172.21.15.17:0/3900816159 >> 172.21.15.17:0/3900816159 conn(0x7fd38c073710 msgr2=0x7fd38c14f310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:00.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.829+0000 7fd3947e4640 1 -- 172.21.15.17:0/3900816159 shutdown_connections 2024-09-05T07:29:00.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:00.829+0000 7fd3947e4640 1 -- 172.21.15.17:0/3900816159 wait complete. 2024-09-05T07:29:00.839 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-05T07:29:00.840 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-05T07:29:01.268 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-09-05T07:29:01.268+0000 7fd0334f6640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-05T07:29:01.299 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-09-05T07:29:01.299+0000 7fd0334f6640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-05T07:29:01.646 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-05T07:29:01.737 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.737+0000 7f6f64f52640 1 Processor -- start 2024-09-05T07:29:01.738 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.737+0000 7f6f64f52640 1 -- start start 2024-09-05T07:29:01.738 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.738+0000 7f6f64f52640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6f600c7650 0x7f6f6015dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:01.738 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.738+0000 7f6f64f52640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6f600cb360 0x7f6f600d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:01.738 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.738+0000 7f6f64f52640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f6015e670 con 0x7f6f60154d60 2024-09-05T07:29:01.738 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.738+0000 7f6f64f52640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f6f600cca40 con 0x7f6f600cb360 2024-09-05T07:29:01.739 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.738+0000 7f6f64f52640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f6f6015e950 con 0x7f6f600c7650 2024-09-05T07:29:01.739 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.738+0000 7f6f5ed9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6f600cb360 0x7f6f600d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:01.739 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.739+0000 7f6f5dd9b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6f600c7650 0x7f6f6015dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:01.739 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.739+0000 7f6f5e59c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f6f60154d60 0x7f6f6015b460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:57208/0 (socket says 172.21.15.17:57208) 2024-09-05T07:29:01.739 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.739+0000 7f6f5e59c640 1 -- 172.21.15.17:0/2000339986 learned_addr learned my addr 172.21.15.17:0/2000339986 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:29:01.741 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.741+0000 7f6f5dd9b640 1 -- 172.21.15.17:0/2000339986 >> v2:172.21.15.17:3300/0 conn(0x7f6f600cb360 msgr2=0x7f6f600d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:01.742 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.741+0000 7f6f5dd9b640 1 --2- 172.21.15.17:0/2000339986 >> v2:172.21.15.17:3300/0 conn(0x7f6f600cb360 0x7f6f600d01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:01.742 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.741+0000 7f6f5dd9b640 1 -- 172.21.15.17:0/2000339986 >> v1:172.21.15.17:6789/0 conn(0x7f6f60154d60 legacy=0x7f6f6015b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:01.742 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.741+0000 7f6f5dd9b640 1 -- 172.21.15.17:0/2000339986 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f6015ec30 con 0x7f6f600c7650 2024-09-05T07:29:01.745 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.745+0000 7f6f5dd9b640 1 --2- 172.21.15.17:0/2000339986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f600c7650 0x7f6f6015dfc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6f600cb310 tx=0x7f6f5402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3fe11632a5a0925 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:01.749 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.749+0000 7f6f5d59a640 1 -- 172.21.15.17:0/2000339986 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f54037070 con 0x7f6f600c7650 2024-09-05T07:29:01.749 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.749+0000 7f6f5d59a640 1 -- 172.21.15.17:0/2000339986 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f54032440 con 0x7f6f600c7650 2024-09-05T07:29:01.750 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.749+0000 7f6f5d59a640 1 -- 172.21.15.17:0/2000339986 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f54032810 con 0x7f6f600c7650 2024-09-05T07:29:01.750 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.749+0000 7f6f64f52640 1 -- 172.21.15.17:0/2000339986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f600c7650 msgr2=0x7f6f6015dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:01.750 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.750+0000 7f6f64f52640 1 --2- 172.21.15.17:0/2000339986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f600c7650 0x7f6f6015dfc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6f600cb310 tx=0x7f6f5402a230 comp rx=0 tx=0).stop 2024-09-05T07:29:01.750 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.750+0000 7f6f64f52640 1 -- 172.21.15.17:0/2000339986 shutdown_connections 2024-09-05T07:29:01.751 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.750+0000 7f6f64f52640 1 --2- 172.21.15.17:0/2000339986 >> v2:172.21.15.17:3300/0 conn(0x7f6f600cb360 0x7f6f600d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:01.751 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.750+0000 7f6f64f52640 1 --2- 172.21.15.17:0/2000339986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f600c7650 0x7f6f6015dfc0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:01.751 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.750+0000 7f6f64f52640 1 -- 172.21.15.17:0/2000339986 >> 172.21.15.17:0/2000339986 conn(0x7f6f6006e4d0 msgr2=0x7f6f600732b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:01.751 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.750+0000 7f6f64f52640 1 -- 172.21.15.17:0/2000339986 shutdown_connections 2024-09-05T07:29:01.751 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.750+0000 7f6f64f52640 1 -- 172.21.15.17:0/2000339986 wait complete. 2024-09-05T07:29:01.751 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.751+0000 7f6f64f52640 1 Processor -- start 2024-09-05T07:29:01.751 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.751+0000 7f6f64f52640 1 -- start start 2024-09-05T07:29:01.752 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.752+0000 7f6f64f52640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f600c7650 0x7f6f600cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:01.752 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.752+0000 7f6f64f52640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f600cb360 0x7f6f601f37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:01.752 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.752+0000 7f6f64f52640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f60154d60 0x7f6f6015bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:01.752 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.752+0000 7f6f64f52640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6f60155140 con 0x7f6f600cb360 2024-09-05T07:29:01.752 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.752+0000 7f6f64f52640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f6f6015af40 con 0x7f6f60154d60 2024-09-05T07:29:01.753 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.752+0000 7f6f64f52640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f6f600cb7f0 con 0x7f6f600c7650 2024-09-05T07:29:01.753 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.752+0000 7f6f5ed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f60154d60 0x7f6f6015bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:01.753 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.752+0000 7f6f5dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f600cb360 0x7f6f601f37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:01.753 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.752+0000 7f6f5e59c640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f600c7650 0x7f6f600cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:01.754 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.753+0000 7f6f5dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f600cb360 0x7f6f601f37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50070/0 (socket says 172.21.15.17:50070) 2024-09-05T07:29:01.754 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.753+0000 7f6f5dd9b640 1 -- 172.21.15.17:0/63809978 learned_addr learned my addr 172.21.15.17:0/63809978 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:01.756 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.756+0000 7f6f5dd9b640 1 -- 172.21.15.17:0/63809978 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f600c7650 msgr2=0x7f6f600cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:01.756 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.756+0000 7f6f5dd9b640 1 --2- 172.21.15.17:0/63809978 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f600c7650 0x7f6f600cf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:01.756 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.756+0000 7f6f5dd9b640 1 -- 172.21.15.17:0/63809978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f60154d60 msgr2=0x7f6f6015bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:01.756 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.756+0000 7f6f5dd9b640 1 --2- 172.21.15.17:0/63809978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f60154d60 0x7f6f6015bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:01.756 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.756+0000 7f6f5dd9b640 1 -- 172.21.15.17:0/63809978 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f601e4c60 con 0x7f6f600cb360 2024-09-05T07:29:01.757 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.756+0000 7f6f5ed9d640 1 --2- 172.21.15.17:0/63809978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f60154d60 0x7f6f6015bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:29:01.758 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.758+0000 7f6f5dd9b640 1 --2- 172.21.15.17:0/63809978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f600cb360 0x7f6f601f37b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6f5402a820 tx=0x7f6f540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:01.765 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.761+0000 7f6f4effd640 1 -- 172.21.15.17:0/63809978 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f54042020 con 0x7f6f600cb360 2024-09-05T07:29:01.765 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.761+0000 7f6f4effd640 1 -- 172.21.15.17:0/63809978 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f54030780 con 0x7f6f600cb360 2024-09-05T07:29:01.765 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.761+0000 7f6f4effd640 1 -- 172.21.15.17:0/63809978 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f54037040 con 0x7f6f600cb360 2024-09-05T07:29:01.765 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.761+0000 7f6f64f52640 1 -- 172.21.15.17:0/63809978 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f601e46a0 con 0x7f6f600cb360 2024-09-05T07:29:01.765 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.762+0000 7f6f64f52640 1 -- 172.21.15.17:0/63809978 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f6015cd10 con 0x7f6f600cb360 2024-09-05T07:29:01.765 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:01.762+0000 7f6f64f52640 1 -- 172.21.15.17:0/63809978 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f6015dfc0 con 0x7f6f600cb360 2024-09-05T07:29:01.829 INFO:tasks.ceph.osd.4.smithi026.stderr:2024-09-05T07:29:01.829+0000 7fa7d281c640 -1 Falling back to public interface 2024-09-05T07:29:01.852 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-05T07:29:01.851+0000 7f319c13e640 -1 Falling back to public interface 2024-09-05T07:29:02.029 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-05T07:29:02.028+0000 7fc437c18640 -1 Falling back to public interface 2024-09-05T07:29:02.036 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:02.036+0000 7f6f4effd640 1 -- 172.21.15.17:0/63809978 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 3) ==== 90336+0+0 (secure 0 0 0) 0x7f6f54045020 con 0x7f6f600cb360 2024-09-05T07:29:02.037 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:02.037+0000 7f6f4effd640 1 --2- 172.21.15.17:0/63809978 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f6f4006bcd0 0x7f6f4006e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:02.037 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:02.037+0000 7f6f5e59c640 1 --2- 172.21.15.17:0/63809978 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f6f4006bcd0 0x7f6f4006e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:02.037 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:02.037+0000 7f6f5e59c640 1 --2- 172.21.15.17:0/63809978 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f6f4006bcd0 0x7f6f4006e190 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6f50007fd0 tx=0x7f6f50007e80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:02.052 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:02.051+0000 7f6f4effd640 1 -- 172.21.15.17:0/63809978 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f6f54078f50 con 0x7f6f600cb360 2024-09-05T07:29:02.052 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:02.052+0000 7f6f4effd640 1 -- 172.21.15.17:0/63809978 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6f5404c020 con 0x7f6f600cb360 2024-09-05T07:29:02.091 INFO:tasks.ceph.osd.6.smithi026.stderr:2024-09-05T07:29:02.091+0000 7f687e614640 -1 Falling back to public interface 2024-09-05T07:29:02.228 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:02.227+0000 7f6f64f52640 1 -- 172.21.15.17:0/63809978 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6f600cbc50 con 0x7f6f600cb360 2024-09-05T07:29:02.272 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:02.272+0000 7f6f4effd640 1 -- 172.21.15.17:0/63809978 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f6f5407a2c0 con 0x7f6f600cb360 2024-09-05T07:29:02.273 INFO:teuthology.misc.health.smithi017.stdout: 2024-09-05T07:29:02.273 INFO:teuthology.misc.health.smithi017.stdout:{"epoch":10,"fsid":"848dac54-74f8-48f3-8686-c6495dcb972b","created":"2024-09-05T07:28:54.070215+0000","modified":"2024-09-05T07:29:00.001829+0000","last_up_change":"0.000000","last_in_change":"2024-09-05T07:29:00.001829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2f01a8b4-dc10-4cdf-a65e-b7f96de4e2b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d16867fb-2290-486c-9ac8-327ca54326d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"632ad558-bd14-4240-a8f1-5beda951b3b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9727a970-8f98-45b9-8eca-62da1f28ff17","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0e0141e0-51f1-4229-861f-1992afe70c96","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5603d79b-fcf8-45aa-a1db-96918af450be","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"14f3b696-1b3c-4749-8f61-ac10edbb5b49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"be7b4121-c71b-4908-ba4a-9c4389423201","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T07:29:02.275 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:02.274+0000 7f6f64f52640 1 -- 172.21.15.17:0/63809978 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f6f4006bcd0 msgr2=0x7f6f4006e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:02.275 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:02.274+0000 7f6f64f52640 1 --2- 172.21.15.17:0/63809978 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f6f4006bcd0 0x7f6f4006e190 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6f50007fd0 tx=0x7f6f50007e80 comp rx=0 tx=0).stop 2024-09-05T07:29:02.275 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:02.274+0000 7f6f64f52640 1 -- 172.21.15.17:0/63809978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f600cb360 msgr2=0x7f6f601f37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:02.276 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:02.274+0000 7f6f64f52640 1 --2- 172.21.15.17:0/63809978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f600cb360 0x7f6f601f37b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6f5402a820 tx=0x7f6f540046c0 comp rx=0 tx=0).stop 2024-09-05T07:29:02.276 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:02.275+0000 7f6f64f52640 1 -- 172.21.15.17:0/63809978 shutdown_connections 2024-09-05T07:29:02.276 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:02.275+0000 7f6f64f52640 1 --2- 172.21.15.17:0/63809978 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f6f4006bcd0 0x7f6f4006e190 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:02.276 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:02.275+0000 7f6f64f52640 1 --2- 172.21.15.17:0/63809978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6f60154d60 0x7f6f6015bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:02.276 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:02.275+0000 7f6f64f52640 1 --2- 172.21.15.17:0/63809978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f600cb360 0x7f6f601f37b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:02.276 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:02.275+0000 7f6f64f52640 1 --2- 172.21.15.17:0/63809978 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6f600c7650 0x7f6f600cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:02.276 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:02.275+0000 7f6f64f52640 1 -- 172.21.15.17:0/63809978 >> 172.21.15.17:0/63809978 conn(0x7f6f6006e4d0 msgr2=0x7f6f600c9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:02.276 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:02.275+0000 7f6f64f52640 1 -- 172.21.15.17:0/63809978 shutdown_connections 2024-09-05T07:29:02.276 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:02.275+0000 7f6f64f52640 1 -- 172.21.15.17:0/63809978 wait complete. 2024-09-05T07:29:02.284 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-05T07:29:02.324 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-05T07:29:02.323+0000 7f0f48156640 -1 Falling back to public interface 2024-09-05T07:29:02.328 INFO:tasks.ceph.osd.5.smithi026.stderr:2024-09-05T07:29:02.328+0000 7f7b94ad6640 -1 Falling back to public interface 2024-09-05T07:29:02.333 INFO:tasks.ceph.osd.7.smithi026.stderr:2024-09-05T07:29:02.334+0000 7fd0e122f640 -1 Falling back to public interface 2024-09-05T07:29:02.357 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-05T07:29:02.356+0000 7f7d1c20b640 -1 Falling back to public interface 2024-09-05T07:29:06.151 INFO:tasks.ceph.osd.4.smithi026.stderr:2024-09-05T07:29:06.151+0000 7fa7d281c640 -1 osd.4 0 log_to_monitors true 2024-09-05T07:29:06.182 INFO:tasks.ceph.osd.6.smithi026.stderr:2024-09-05T07:29:06.182+0000 7f687e614640 -1 osd.6 0 log_to_monitors true 2024-09-05T07:29:06.307 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-05T07:29:06.307+0000 7fc437c18640 -1 osd.2 0 log_to_monitors true 2024-09-05T07:29:06.361 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-05T07:29:06.360+0000 7f0f48156640 -1 osd.1 0 log_to_monitors true 2024-09-05T07:29:06.396 INFO:tasks.ceph.osd.5.smithi026.stderr:2024-09-05T07:29:06.396+0000 7f7b94ad6640 -1 osd.5 0 log_to_monitors true 2024-09-05T07:29:06.398 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-05T07:29:06.398+0000 7f319c13e640 -1 osd.3 0 log_to_monitors true 2024-09-05T07:29:06.415 INFO:tasks.ceph.osd.7.smithi026.stderr:2024-09-05T07:29:06.415+0000 7fd0e122f640 -1 osd.7 0 log_to_monitors true 2024-09-05T07:29:06.894 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-05T07:29:06.893+0000 7f7d1c20b640 -1 osd.0 0 log_to_monitors true 2024-09-05T07:29:07.241 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:29:07.244 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:29:08.333 INFO:tasks.ceph.osd.6.smithi026.stderr:2024-09-05T07:29:08.333+0000 7f6879777640 -1 osd.6 0 waiting for initial osdmap 2024-09-05T07:29:08.356 INFO:tasks.ceph.osd.4.smithi026.stderr:2024-09-05T07:29:08.356+0000 7fa7cda37640 -1 osd.4 0 waiting for initial osdmap 2024-09-05T07:29:08.370 INFO:tasks.ceph.osd.6.smithi026.stderr:2024-09-05T07:29:08.371+0000 7f6871da9640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T07:29:08.576 INFO:tasks.ceph.osd.4.smithi026.stderr:2024-09-05T07:29:08.577+0000 7fa7c6069640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T07:29:09.091 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-05T07:29:09.231 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.231+0000 7fc8028f1640 1 Processor -- start 2024-09-05T07:29:09.231 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.231+0000 7fc8028f1640 1 -- start start 2024-09-05T07:29:09.232 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.232+0000 7fc8028f1640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc7fc154cd0 0x7fc7fc15e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:09.233 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.232+0000 7fc8028f1640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc7fc0c7cd0 0x7fc7fc15e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:09.233 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.232+0000 7fc8028f1640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7fc15a8b0 con 0x7fc7fc1548f0 2024-09-05T07:29:09.233 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.232+0000 7fc8028f1640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fc7fc15ab20 con 0x7fc7fc0c7cd0 2024-09-05T07:29:09.233 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.232+0000 7fc8028f1640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fc7fc15ae00 con 0x7fc7fc154cd0 2024-09-05T07:29:09.233 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.232+0000 7fc7fbfff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc7fc1548f0 0x7fc7fc06eb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39014/0 (socket says 172.21.15.17:39014) 2024-09-05T07:29:09.233 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.233+0000 7fc7fbfff640 1 -- 172.21.15.17:0/705129268 learned_addr learned my addr 172.21.15.17:0/705129268 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:29:09.234 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.233+0000 7fc7fb7fe640 1 --2- 172.21.15.17:0/705129268 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc7fc154cd0 0x7fc7fc15e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:09.236 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.236+0000 7fc7fb7fe640 1 -- 172.21.15.17:0/705129268 >> v2:172.21.15.17:3300/0 conn(0x7fc7fc0c7cd0 msgr2=0x7fc7fc15e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:09.236 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.236+0000 7fc7fb7fe640 1 --2- 172.21.15.17:0/705129268 >> v2:172.21.15.17:3300/0 conn(0x7fc7fc0c7cd0 0x7fc7fc15e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:09.236 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.236+0000 7fc7fb7fe640 1 -- 172.21.15.17:0/705129268 >> v1:172.21.15.17:6789/0 conn(0x7fc7fc1548f0 legacy=0x7fc7fc06eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:09.236 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.236+0000 7fc7fb7fe640 1 -- 172.21.15.17:0/705129268 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7fc15b0e0 con 0x7fc7fc154cd0 2024-09-05T07:29:09.238 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.238+0000 7fc7fb7fe640 1 --2- 172.21.15.17:0/705129268 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc7fc154cd0 0x7fc7fc15e070 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc7f00097a0 tx=0x7fc7f002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cee61b200e689bf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:09.243 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.243+0000 7fc7faffd640 1 -- 172.21.15.17:0/705129268 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f0037070 con 0x7fc7fc154cd0 2024-09-05T07:29:09.243 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.243+0000 7fc7faffd640 1 -- 172.21.15.17:0/705129268 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7f0032440 con 0x7fc7fc154cd0 2024-09-05T07:29:09.243 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.243+0000 7fc7faffd640 1 -- 172.21.15.17:0/705129268 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f0032810 con 0x7fc7fc154cd0 2024-09-05T07:29:09.244 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.244+0000 7fc8028f1640 1 -- 172.21.15.17:0/705129268 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc7fc154cd0 msgr2=0x7fc7fc15e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:09.244 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.244+0000 7fc8028f1640 1 --2- 172.21.15.17:0/705129268 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc7fc154cd0 0x7fc7fc15e070 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc7f00097a0 tx=0x7fc7f002a210 comp rx=0 tx=0).stop 2024-09-05T07:29:09.245 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.244+0000 7fc8028f1640 1 -- 172.21.15.17:0/705129268 shutdown_connections 2024-09-05T07:29:09.245 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.244+0000 7fc8028f1640 1 --2- 172.21.15.17:0/705129268 >> v2:172.21.15.17:3300/0 conn(0x7fc7fc0c7cd0 0x7fc7fc15e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:09.245 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.244+0000 7fc8028f1640 1 --2- 172.21.15.17:0/705129268 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc7fc154cd0 0x7fc7fc15e070 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:09.245 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.244+0000 7fc8028f1640 1 -- 172.21.15.17:0/705129268 >> 172.21.15.17:0/705129268 conn(0x7fc7fc062630 msgr2=0x7fc7fc062a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:09.245 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.245+0000 7fc8028f1640 1 -- 172.21.15.17:0/705129268 shutdown_connections 2024-09-05T07:29:09.245 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.245+0000 7fc8028f1640 1 -- 172.21.15.17:0/705129268 wait complete. 2024-09-05T07:29:09.247 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.247+0000 7fc8028f1640 1 Processor -- start 2024-09-05T07:29:09.247 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.247+0000 7fc8028f1640 1 -- start start 2024-09-05T07:29:09.249 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.248+0000 7fc8028f1640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc7fc0c7cd0 0x7fc7fc153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:09.249 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.249+0000 7fc8028f1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7fc1548f0 0x7fc7fc0c55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:09.249 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.249+0000 7fc8028f1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7fc154cd0 0x7fc7fc1e4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:09.251 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.250+0000 7fc8028f1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc7fc06bbf0 con 0x7fc7fc154cd0 2024-09-05T07:29:09.251 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.250+0000 7fc8028f1640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc7fc15b6a0 con 0x7fc7fc1548f0 2024-09-05T07:29:09.252 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.250+0000 7fc8028f1640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fc7fc06f270 con 0x7fc7fc0c7cd0 2024-09-05T07:29:09.252 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.250+0000 7fc7fbfff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc7fc0c7cd0 0x7fc7fc153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:09.252 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.251+0000 7fc7fbfff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc7fc0c7cd0 0x7fc7fc153730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:49866/0 (socket says 172.21.15.17:49866) 2024-09-05T07:29:09.252 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.251+0000 7fc7fbfff640 1 -- 172.21.15.17:0/483349798 learned_addr learned my addr 172.21.15.17:0/483349798 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:09.252 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.251+0000 7fc800e8e640 1 --2- 172.21.15.17:0/483349798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7fc154cd0 0x7fc7fc1e4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:09.252 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.251+0000 7fc7fb7fe640 1 --2- 172.21.15.17:0/483349798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7fc1548f0 0x7fc7fc0c55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:09.255 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.255+0000 7fc7fbfff640 1 -- 172.21.15.17:0/483349798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7fc1548f0 msgr2=0x7fc7fc0c55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:09.255 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.255+0000 7fc7fbfff640 1 --2- 172.21.15.17:0/483349798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7fc1548f0 0x7fc7fc0c55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:09.256 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.255+0000 7fc7fbfff640 1 -- 172.21.15.17:0/483349798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7fc154cd0 msgr2=0x7fc7fc1e4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:09.256 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.255+0000 7fc7fbfff640 1 --2- 172.21.15.17:0/483349798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7fc154cd0 0x7fc7fc1e4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:09.256 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.255+0000 7fc7fbfff640 1 -- 172.21.15.17:0/483349798 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7fc15da90 con 0x7fc7fc0c7cd0 2024-09-05T07:29:09.258 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.258+0000 7fc7fbfff640 1 --2- 172.21.15.17:0/483349798 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc7fc0c7cd0 0x7fc7fc153730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec00c4d0 tx=0x7fc7ec00c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:09.262 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.262+0000 7fc7f8ff9640 1 -- 172.21.15.17:0/483349798 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec017070 con 0x7fc7fc0c7cd0 2024-09-05T07:29:09.262 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.262+0000 7fc7f8ff9640 1 -- 172.21.15.17:0/483349798 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7ec005ce0 con 0x7fc7fc0c7cd0 2024-09-05T07:29:09.262 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.262+0000 7fc7f8ff9640 1 -- 172.21.15.17:0/483349798 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec007270 con 0x7fc7fc0c7cd0 2024-09-05T07:29:09.263 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.262+0000 7fc8028f1640 1 -- 172.21.15.17:0/483349798 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7fc15d4d0 con 0x7fc7fc0c7cd0 2024-09-05T07:29:09.263 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.262+0000 7fc8028f1640 1 -- 172.21.15.17:0/483349798 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7fc152c50 con 0x7fc7fc0c7cd0 2024-09-05T07:29:09.264 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.264+0000 7fc8028f1640 1 -- 172.21.15.17:0/483349798 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7fc069200 con 0x7fc7fc0c7cd0 2024-09-05T07:29:09.297 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.296+0000 7fc7f8ff9640 1 -- 172.21.15.17:0/483349798 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 4) ==== 90442+0+0 (secure 0 0 0) 0x7fc7ec01a070 con 0x7fc7fc0c7cd0 2024-09-05T07:29:09.297 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.296+0000 7fc7f8ff9640 1 --2- 172.21.15.17:0/483349798 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc7e806be20 0x7fc7e806e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:09.297 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.297+0000 7fc7fb7fe640 1 --2- 172.21.15.17:0/483349798 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc7e806be20 0x7fc7e806e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:09.298 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.297+0000 7fc7fb7fe640 1 --2- 172.21.15.17:0/483349798 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc7e806be20 0x7fc7e806e2e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0034000 tx=0x7fc7f002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:09.301 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.300+0000 7fc7f8ff9640 1 -- 172.21.15.17:0/483349798 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(13..13 src has 1..13) ==== 2231+0+0 (secure 0 0 0) 0x7fc7ec0568e0 con 0x7fc7fc0c7cd0 2024-09-05T07:29:09.345 INFO:tasks.ceph.osd.7.smithi026.stderr:2024-09-05T07:29:09.345+0000 7fd0dd9d2640 -1 osd.7 0 waiting for initial osdmap 2024-09-05T07:29:09.389 INFO:tasks.ceph.osd.7.smithi026.stderr:2024-09-05T07:29:09.389+0000 7fd0d4fcd640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T07:29:09.584 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.583+0000 7fc7f8ff9640 1 -- 172.21.15.17:0/483349798 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc7ec058840 con 0x7fc7fc0c7cd0 2024-09-05T07:29:09.926 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:09.926+0000 7fc8028f1640 1 -- 172.21.15.17:0/483349798 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc7fc06f090 con 0x7fc7fc0c7cd0 2024-09-05T07:29:09.978 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-05T07:29:09.978+0000 7f0f438c2640 -1 osd.1 0 waiting for initial osdmap 2024-09-05T07:29:10.002 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-05T07:29:10.002+0000 7f0f3bef4640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T07:29:10.003 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-05T07:29:10.002+0000 7fc433d8e640 -1 osd.2 0 waiting for initial osdmap 2024-09-05T07:29:10.014 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:10.014+0000 7fc7f8ff9640 1 -- 172.21.15.17:0/483349798 <== mon.2 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+8017 (secure 0 0 0) 0x7fc7fc06f090 con 0x7fc7fc0c7cd0 2024-09-05T07:29:10.015 INFO:teuthology.misc.health.smithi017.stdout: 2024-09-05T07:29:10.015 INFO:teuthology.misc.health.smithi017.stdout:{"epoch":14,"fsid":"848dac54-74f8-48f3-8686-c6495dcb972b","created":"2024-09-05T07:28:54.070215+0000","modified":"2024-09-05T07:29:09.310412+0000","last_up_change":"2024-09-05T07:29:09.310412+0000","last_in_change":"2024-09-05T07:29:00.001829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2f01a8b4-dc10-4cdf-a65e-b7f96de4e2b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d16867fb-2290-486c-9ac8-327ca54326d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"632ad558-bd14-4240-a8f1-5beda951b3b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9727a970-8f98-45b9-8eca-62da1f28ff17","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0e0141e0-51f1-4229-861f-1992afe70c96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6803","nonce":3740556509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6805","nonce":3740556509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6809","nonce":3740556509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6807","nonce":3740556509}]},"public_addr":"172.21.15.26:6803/3740556509","cluster_addr":"172.21.15.26:6805/3740556509","heartbeat_back_addr":"172.21.15.26:6809/3740556509","heartbeat_front_addr":"172.21.15.26:6807/3740556509","state":["exists","up"]},{"osd":5,"uuid":"5603d79b-fcf8-45aa-a1db-96918af450be","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"14f3b696-1b3c-4749-8f61-ac10edbb5b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6811","nonce":158775588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6813","nonce":158775588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6817","nonce":158775588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6815","nonce":158775588}]},"public_addr":"172.21.15.26:6811/158775588","cluster_addr":"172.21.15.26:6813/158775588","heartbeat_back_addr":"172.21.15.26:6817/158775588","heartbeat_front_addr":"172.21.15.26:6815/158775588","state":["exists","up"]},{"osd":7,"uuid":"be7b4121-c71b-4908-ba4a-9c4389423201","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T07:29:10.016 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-05T07:29:10.016+0000 7f7d1740e640 -1 osd.0 0 waiting for initial osdmap 2024-09-05T07:29:10.017 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:10.017+0000 7fc8028f1640 1 -- 172.21.15.17:0/483349798 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc7e806be20 msgr2=0x7fc7e806e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:10.018 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:10.017+0000 7fc8028f1640 1 --2- 172.21.15.17:0/483349798 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc7e806be20 0x7fc7e806e2e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0034000 tx=0x7fc7f002e000 comp rx=0 tx=0).stop 2024-09-05T07:29:10.018 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:10.017+0000 7fc8028f1640 1 -- 172.21.15.17:0/483349798 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc7fc0c7cd0 msgr2=0x7fc7fc153730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:10.018 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:10.017+0000 7fc8028f1640 1 --2- 172.21.15.17:0/483349798 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc7fc0c7cd0 0x7fc7fc153730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec00c4d0 tx=0x7fc7ec00c990 comp rx=0 tx=0).stop 2024-09-05T07:29:10.018 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:10.017+0000 7fc8028f1640 1 -- 172.21.15.17:0/483349798 shutdown_connections 2024-09-05T07:29:10.018 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:10.017+0000 7fc8028f1640 1 --2- 172.21.15.17:0/483349798 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc7e806be20 0x7fc7e806e2e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:10.018 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:10.017+0000 7fc8028f1640 1 --2- 172.21.15.17:0/483349798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7fc154cd0 0x7fc7fc1e4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:10.018 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:10.017+0000 7fc8028f1640 1 --2- 172.21.15.17:0/483349798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7fc1548f0 0x7fc7fc0c55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:10.018 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:10.017+0000 7fc8028f1640 1 --2- 172.21.15.17:0/483349798 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc7fc0c7cd0 0x7fc7fc153730 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:10.018 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:10.017+0000 7fc8028f1640 1 -- 172.21.15.17:0/483349798 >> 172.21.15.17:0/483349798 conn(0x7fc7fc062630 msgr2=0x7fc7fc15e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:10.018 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:10.017+0000 7fc8028f1640 1 -- 172.21.15.17:0/483349798 shutdown_connections 2024-09-05T07:29:10.018 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:10.017+0000 7fc8028f1640 1 -- 172.21.15.17:0/483349798 wait complete. 2024-09-05T07:29:10.025 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-05T07:29:10.025+0000 7fc42b389640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T07:29:10.030 DEBUG:teuthology.misc:2 of 8 OSDs are up 2024-09-05T07:29:10.041 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-05T07:29:10.041+0000 7f31988e1640 -1 osd.3 0 waiting for initial osdmap 2024-09-05T07:29:10.061 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-05T07:29:10.061+0000 7f318fedc640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T07:29:10.098 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-05T07:29:10.098+0000 7f7d0fa40640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T07:29:10.753 INFO:tasks.ceph.osd.5.smithi026.stderr:2024-09-05T07:29:10.753+0000 7f7b90242640 -1 osd.5 0 waiting for initial osdmap 2024-09-05T07:29:10.777 INFO:tasks.ceph.osd.5.smithi026.stderr:2024-09-05T07:29:10.777+0000 7f7b88874640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T07:29:16.838 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-05T07:29:16.939 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.938+0000 7fd937635640 1 Processor -- start 2024-09-05T07:29:16.939 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.939+0000 7fd937635640 1 -- start start 2024-09-05T07:29:16.940 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.939+0000 7fd937635640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd9300cc700 0x7fd9300cb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:16.941 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.939+0000 7fd937635640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd9300d0330 0x7fd9300d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:16.941 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.939+0000 7fd937635640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd93015ee90 con 0x7fd930154e40 2024-09-05T07:29:16.941 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.939+0000 7fd937635640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fd9300cb960 con 0x7fd9300d0330 2024-09-05T07:29:16.941 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.939+0000 7fd937635640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fd93015b4b0 con 0x7fd9300cc700 2024-09-05T07:29:16.941 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.940+0000 7fd935bd2640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd9300d0330 0x7fd9300d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:16.942 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.940+0000 7fd934bd0640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd9300cc700 0x7fd9300cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:16.942 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.941+0000 7fd935bd2640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd9300d0330 0x7fd9300d07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56714/0 (socket says 172.21.15.17:56714) 2024-09-05T07:29:16.942 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.941+0000 7fd935bd2640 1 -- 172.21.15.17:0/1976418755 learned_addr learned my addr 172.21.15.17:0/1976418755 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:16.943 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.943+0000 7fd935bd2640 1 -- 172.21.15.17:0/1976418755 >> v2:172.21.15.26:3300/0 conn(0x7fd9300cc700 msgr2=0x7fd9300cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:16.944 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.943+0000 7fd935bd2640 1 --2- 172.21.15.17:0/1976418755 >> v2:172.21.15.26:3300/0 conn(0x7fd9300cc700 0x7fd9300cb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:16.944 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.943+0000 7fd935bd2640 1 -- 172.21.15.17:0/1976418755 >> v1:172.21.15.26:6789/0 conn(0x7fd930154e40 legacy=0x7fd9300c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:16.944 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.943+0000 7fd935bd2640 1 -- 172.21.15.17:0/1976418755 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd93015e930 con 0x7fd9300d0330 2024-09-05T07:29:16.945 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.945+0000 7fd935bd2640 1 --2- 172.21.15.17:0/1976418755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9300d0330 0x7fd9300d07c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd9300ca9a0 tx=0x7fd92802a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9424c8dc256d0718 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:16.949 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.949+0000 7fd927fff640 1 -- 172.21.15.17:0/1976418755 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd928036070 con 0x7fd9300d0330 2024-09-05T07:29:16.950 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.949+0000 7fd927fff640 1 -- 172.21.15.17:0/1976418755 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd928031600 con 0x7fd9300d0330 2024-09-05T07:29:16.950 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.949+0000 7fd927fff640 1 -- 172.21.15.17:0/1976418755 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9280319d0 con 0x7fd9300d0330 2024-09-05T07:29:16.951 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.950+0000 7fd937635640 1 -- 172.21.15.17:0/1976418755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9300d0330 msgr2=0x7fd9300d07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:16.951 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.950+0000 7fd937635640 1 --2- 172.21.15.17:0/1976418755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9300d0330 0x7fd9300d07c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd9300ca9a0 tx=0x7fd92802a780 comp rx=0 tx=0).stop 2024-09-05T07:29:16.951 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.950+0000 7fd937635640 1 -- 172.21.15.17:0/1976418755 shutdown_connections 2024-09-05T07:29:16.951 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.950+0000 7fd937635640 1 --2- 172.21.15.17:0/1976418755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9300d0330 0x7fd9300d07c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:16.951 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.950+0000 7fd937635640 1 --2- 172.21.15.17:0/1976418755 >> v2:172.21.15.26:3300/0 conn(0x7fd9300cc700 0x7fd9300cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:16.951 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.950+0000 7fd937635640 1 -- 172.21.15.17:0/1976418755 >> 172.21.15.17:0/1976418755 conn(0x7fd930073940 msgr2=0x7fd930062630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:16.951 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.950+0000 7fd937635640 1 -- 172.21.15.17:0/1976418755 shutdown_connections 2024-09-05T07:29:16.951 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.950+0000 7fd937635640 1 -- 172.21.15.17:0/1976418755 wait complete. 2024-09-05T07:29:16.952 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.951+0000 7fd937635640 1 Processor -- start 2024-09-05T07:29:16.952 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.952+0000 7fd937635640 1 -- start start 2024-09-05T07:29:16.953 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.952+0000 7fd937635640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9300cc700 0x7fd9300b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:16.953 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.952+0000 7fd937635640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9300d0330 0x7fd9301f0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:16.954 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.952+0000 7fd937635640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd930154e40 0x7fd9301f10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:16.954 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.952+0000 7fd937635640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd93015ab80 con 0x7fd930154e40 2024-09-05T07:29:16.954 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.952+0000 7fd937635640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd93015b940 con 0x7fd9300cc700 2024-09-05T07:29:16.954 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.952+0000 7fd937635640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fd93015ae60 con 0x7fd9300d0330 2024-09-05T07:29:16.954 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.953+0000 7fd935bd2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd930154e40 0x7fd9301f10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:16.954 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.953+0000 7fd9353d1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9300cc700 0x7fd9300b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:16.954 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.953+0000 7fd934bd0640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9300d0330 0x7fd9301f0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:16.954 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.953+0000 7fd935bd2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd930154e40 0x7fd9301f10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56718/0 (socket says 172.21.15.17:56718) 2024-09-05T07:29:16.954 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.953+0000 7fd935bd2640 1 -- 172.21.15.17:0/3405064951 learned_addr learned my addr 172.21.15.17:0/3405064951 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:16.954 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.953+0000 7fd9353d1640 1 --2- 172.21.15.17:0/3405064951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9300cc700 0x7fd9300b57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:34308/0 (socket says 172.21.15.17:34308) 2024-09-05T07:29:16.957 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.957+0000 7fd9353d1640 1 -- 172.21.15.17:0/3405064951 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9300d0330 msgr2=0x7fd9301f0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:16.957 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.957+0000 7fd9353d1640 1 --2- 172.21.15.17:0/3405064951 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9300d0330 0x7fd9301f0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:16.957 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.957+0000 7fd9353d1640 1 -- 172.21.15.17:0/3405064951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd930154e40 msgr2=0x7fd9301f10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:16.957 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.957+0000 7fd9353d1640 1 --2- 172.21.15.17:0/3405064951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd930154e40 0x7fd9301f10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:16.957 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.957+0000 7fd9353d1640 1 -- 172.21.15.17:0/3405064951 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9301f4840 con 0x7fd9300cc700 2024-09-05T07:29:16.960 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.960+0000 7fd9353d1640 1 --2- 172.21.15.17:0/3405064951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9300cc700 0x7fd9300b57c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd92c00b440 tx=0x7fd92c00b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:16.964 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.964+0000 7fd925ffb640 1 -- 172.21.15.17:0/3405064951 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c015030 con 0x7fd9300cc700 2024-09-05T07:29:16.964 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.964+0000 7fd925ffb640 1 -- 172.21.15.17:0/3405064951 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd92c004020 con 0x7fd9300cc700 2024-09-05T07:29:16.964 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.964+0000 7fd925ffb640 1 -- 172.21.15.17:0/3405064951 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c004410 con 0x7fd9300cc700 2024-09-05T07:29:16.964 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.964+0000 7fd937635640 1 -- 172.21.15.17:0/3405064951 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd93015db90 con 0x7fd9300cc700 2024-09-05T07:29:16.964 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.964+0000 7fd937635640 1 -- 172.21.15.17:0/3405064951 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd93015e430 con 0x7fd9300cc700 2024-09-05T07:29:16.965 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.965+0000 7fd937635640 1 -- 172.21.15.17:0/3405064951 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd93015b140 con 0x7fd9300cc700 2024-09-05T07:29:16.985 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.984+0000 7fd925ffb640 1 -- 172.21.15.17:0/3405064951 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) ==== 90442+0+0 (secure 0 0 0) 0x7fd92c018070 con 0x7fd9300cc700 2024-09-05T07:29:16.985 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.985+0000 7fd925ffb640 1 --2- 172.21.15.17:0/3405064951 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd91406bdf0 0x7fd91406e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:16.985 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.985+0000 7fd934bd0640 1 --2- 172.21.15.17:0/3405064951 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd91406bdf0 0x7fd91406e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:16.986 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.985+0000 7fd934bd0640 1 --2- 172.21.15.17:0/3405064951 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd91406bdf0 0x7fd91406e2b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd930151da0 tx=0x7fd920009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:16.988 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:16.987+0000 7fd925ffb640 1 -- 172.21.15.17:0/3405064951 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fd92c05fac0 con 0x7fd9300cc700 2024-09-05T07:29:17.262 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:17.262+0000 7fd925ffb640 1 -- 172.21.15.17:0/3405064951 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd92c0592d0 con 0x7fd9300cc700 2024-09-05T07:29:17.483 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:17.483+0000 7fd937635640 1 -- 172.21.15.17:0/3405064951 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd9300cc2d0 con 0x7fd9300cc700 2024-09-05T07:29:17.518 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:17.518+0000 7fd925ffb640 1 -- 172.21.15.17:0/3405064951 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd92c055940 con 0x7fd9300cc700 2024-09-05T07:29:17.711 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:17.710+0000 7fd925ffb640 1 -- 172.21.15.17:0/3405064951 <== mon.1 v2:172.21.15.26:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12848 (secure 0 0 0) 0x7fd92c03ecb0 con 0x7fd9300cc700 2024-09-05T07:29:17.711 INFO:teuthology.misc.health.smithi017.stdout: 2024-09-05T07:29:17.711 INFO:teuthology.misc.health.smithi017.stdout:{"epoch":18,"fsid":"848dac54-74f8-48f3-8686-c6495dcb972b","created":"2024-09-05T07:28:54.070215+0000","modified":"2024-09-05T07:29:14.074736+0000","last_up_change":"2024-09-05T07:29:11.992790+0000","last_in_change":"2024-09-05T07:29:00.001829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T07:29:10.227047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f01a8b4-dc10-4cdf-a65e-b7f96de4e2b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2731314060},{"type":"v1","addr":"172.21.15.17:6825","nonce":2731314060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2731314060},{"type":"v1","addr":"172.21.15.17:6827","nonce":2731314060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2731314060},{"type":"v1","addr":"172.21.15.17:6831","nonce":2731314060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2731314060},{"type":"v1","addr":"172.21.15.17:6829","nonce":2731314060}]},"public_addr":"172.21.15.17:6825/2731314060","cluster_addr":"172.21.15.17:6827/2731314060","heartbeat_back_addr":"172.21.15.17:6831/2731314060","heartbeat_front_addr":"172.21.15.17:6829/2731314060","state":["exists","up"]},{"osd":1,"uuid":"d16867fb-2290-486c-9ac8-327ca54326d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3327408852},{"type":"v1","addr":"172.21.15.17:6817","nonce":3327408852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3327408852},{"type":"v1","addr":"172.21.15.17:6819","nonce":3327408852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3327408852},{"type":"v1","addr":"172.21.15.17:6823","nonce":3327408852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3327408852},{"type":"v1","addr":"172.21.15.17:6821","nonce":3327408852}]},"public_addr":"172.21.15.17:6817/3327408852","cluster_addr":"172.21.15.17:6819/3327408852","heartbeat_back_addr":"172.21.15.17:6823/3327408852","heartbeat_front_addr":"172.21.15.17:6821/3327408852","state":["exists","up"]},{"osd":2,"uuid":"632ad558-bd14-4240-a8f1-5beda951b3b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":363420609},{"type":"v1","addr":"172.21.15.17:6809","nonce":363420609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":363420609},{"type":"v1","addr":"172.21.15.17:6811","nonce":363420609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":363420609},{"type":"v1","addr":"172.21.15.17:6815","nonce":363420609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":363420609},{"type":"v1","addr":"172.21.15.17:6813","nonce":363420609}]},"public_addr":"172.21.15.17:6809/363420609","cluster_addr":"172.21.15.17:6811/363420609","heartbeat_back_addr":"172.21.15.17:6815/363420609","heartbeat_front_addr":"172.21.15.17:6813/363420609","state":["exists","up"]},{"osd":3,"uuid":"9727a970-8f98-45b9-8eca-62da1f28ff17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":3512342499},{"type":"v1","addr":"172.21.15.17:6801","nonce":3512342499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":3512342499},{"type":"v1","addr":"172.21.15.17:6803","nonce":3512342499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":3512342499},{"type":"v1","addr":"172.21.15.17:6807","nonce":3512342499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":3512342499},{"type":"v1","addr":"172.21.15.17:6805","nonce":3512342499}]},"public_addr":"172.21.15.17:6801/3512342499","cluster_addr":"172.21.15.17:6803/3512342499","heartbeat_back_addr":"172.21.15.17:6807/3512342499","heartbeat_front_addr":"172.21.15.17:6805/3512342499","state":["exists","up"]},{"osd":4,"uuid":"0e0141e0-51f1-4229-861f-1992afe70c96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6803","nonce":3740556509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6805","nonce":3740556509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6809","nonce":3740556509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6807","nonce":3740556509}]},"public_addr":"172.21.15.26:6803/3740556509","cluster_addr":"172.21.15.26:6805/3740556509","heartbeat_back_addr":"172.21.15.26:6809/3740556509","heartbeat_front_addr":"172.21.15.26:6807/3740556509","state":["exists","up"]},{"osd":5,"uuid":"5603d79b-fcf8-45aa-a1db-96918af450be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3020770750},{"type":"v1","addr":"172.21.15.26:6819","nonce":3020770750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3020770750},{"type":"v1","addr":"172.21.15.26:6821","nonce":3020770750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3020770750},{"type":"v1","addr":"172.21.15.26:6825","nonce":3020770750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3020770750},{"type":"v1","addr":"172.21.15.26:6823","nonce":3020770750}]},"public_addr":"172.21.15.26:6819/3020770750","cluster_addr":"172.21.15.26:6821/3020770750","heartbeat_back_addr":"172.21.15.26:6825/3020770750","heartbeat_front_addr":"172.21.15.26:6823/3020770750","state":["exists","up"]},{"osd":6,"uuid":"14f3b696-1b3c-4749-8f61-ac10edbb5b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6811","nonce":158775588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6813","nonce":158775588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6817","nonce":158775588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6815","nonce":158775588}]},"public_addr":"172.21.15.26:6811/158775588","cluster_addr":"172.21.15.26:6813/158775588","heartbeat_back_addr":"172.21.15.26:6817/158775588","heartbeat_front_addr":"172.21.15.26:6815/158775588","state":["exists","up"]},{"osd":7,"uuid":"be7b4121-c71b-4908-ba4a-9c4389423201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":4176189153},{"type":"v1","addr":"172.21.15.26:6827","nonce":4176189153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":4176189153},{"type":"v1","addr":"172.21.15.26:6829","nonce":4176189153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":4176189153},{"type":"v1","addr":"172.21.15.26:6833","nonce":4176189153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":4176189153},{"type":"v1","addr":"172.21.15.26:6831","nonce":4176189153}]},"public_addr":"172.21.15.26:6827/4176189153","cluster_addr":"172.21.15.26:6829/4176189153","heartbeat_back_addr":"172.21.15.26:6833/4176189153","heartbeat_front_addr":"172.21.15.26:6831/4176189153","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.923722+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.404043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.275202+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.434925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.159606+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.379036+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.196000+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.387333+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T07:29:17.713 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:17.712+0000 7fd937635640 1 -- 172.21.15.17:0/3405064951 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd91406bdf0 msgr2=0x7fd91406e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:17.713 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:17.712+0000 7fd937635640 1 --2- 172.21.15.17:0/3405064951 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd91406bdf0 0x7fd91406e2b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd930151da0 tx=0x7fd920009190 comp rx=0 tx=0).stop 2024-09-05T07:29:17.713 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:17.712+0000 7fd937635640 1 -- 172.21.15.17:0/3405064951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9300cc700 msgr2=0x7fd9300b57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:17.713 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:17.712+0000 7fd937635640 1 --2- 172.21.15.17:0/3405064951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9300cc700 0x7fd9300b57c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd92c00b440 tx=0x7fd92c00b900 comp rx=0 tx=0).stop 2024-09-05T07:29:17.713 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:17.712+0000 7fd937635640 1 -- 172.21.15.17:0/3405064951 shutdown_connections 2024-09-05T07:29:17.713 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:17.712+0000 7fd937635640 1 --2- 172.21.15.17:0/3405064951 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd91406bdf0 0x7fd91406e2b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:17.713 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:17.712+0000 7fd937635640 1 --2- 172.21.15.17:0/3405064951 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9300d0330 0x7fd9301f0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:17.713 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:17.712+0000 7fd937635640 1 --2- 172.21.15.17:0/3405064951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd930154e40 0x7fd9301f10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:17.714 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:17.712+0000 7fd937635640 1 --2- 172.21.15.17:0/3405064951 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9300cc700 0x7fd9300b57c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:17.714 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:17.712+0000 7fd937635640 1 -- 172.21.15.17:0/3405064951 >> 172.21.15.17:0/3405064951 conn(0x7fd930073940 msgr2=0x7fd930152660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:17.714 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:17.712+0000 7fd937635640 1 -- 172.21.15.17:0/3405064951 shutdown_connections 2024-09-05T07:29:17.714 INFO:teuthology.misc.health.smithi017.stderr:2024-09-05T07:29:17.712+0000 7fd937635640 1 -- 172.21.15.17:0/3405064951 wait complete. 2024-09-05T07:29:17.725 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-05T07:29:17.728 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-05T07:29:17.728 DEBUG:tasks.ceph_manager:running mds.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-09-05T07:29:17.729 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-05T07:29:17.729 DEBUG:teuthology.orchestra.run.smithi017:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a 2024-09-05T07:29:17.731 INFO:tasks.ceph.mds.a:Started 2024-09-05T07:29:17.731 DEBUG:tasks.ceph_manager:running mds.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-09-05T07:29:17.731 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-05T07:29:17.732 DEBUG:teuthology.orchestra.run.smithi017:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c 2024-09-05T07:29:17.734 INFO:tasks.ceph.mds.c:Started 2024-09-05T07:29:17.734 DEBUG:tasks.ceph_manager:running mds.e under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.e.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-09-05T07:29:17.734 INFO:tasks.ceph.mds.e:Restarting daemon 2024-09-05T07:29:17.734 DEBUG:teuthology.orchestra.run.smithi017:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e 2024-09-05T07:29:17.736 INFO:tasks.ceph.mds.e:Started 2024-09-05T07:29:17.736 DEBUG:tasks.ceph_manager:running mds.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-09-05T07:29:17.737 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-05T07:29:17.737 DEBUG:teuthology.orchestra.run.smithi026:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b 2024-09-05T07:29:17.739 INFO:tasks.ceph.mds.b:Started 2024-09-05T07:29:17.739 DEBUG:tasks.ceph_manager:running mds.d under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.d.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-09-05T07:29:17.739 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-05T07:29:17.739 DEBUG:teuthology.orchestra.run.smithi026:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d 2024-09-05T07:29:17.741 INFO:tasks.ceph.mds.d:Started 2024-09-05T07:29:17.741 DEBUG:tasks.ceph_manager:running mds.f under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.f.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-09-05T07:29:17.741 INFO:tasks.ceph.mds.f:Restarting daemon 2024-09-05T07:29:17.742 DEBUG:teuthology.orchestra.run.smithi026:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f 2024-09-05T07:29:17.743 INFO:tasks.ceph.mds.f:Started 2024-09-05T07:29:17.744 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-05T07:29:17.744 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-05T07:29:17.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.850+0000 7f4ffc5d8640 1 Processor -- start 2024-09-05T07:29:17.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.850+0000 7f4ffc5d8640 1 -- start start 2024-09-05T07:29:17.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.851+0000 7f4ffc5d8640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ff40c9790 0x7f4ff4157810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:17.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.851+0000 7f4ffc5d8640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ff40c50a0 con 0x7f4ff40c87e0 2024-09-05T07:29:17.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.851+0000 7f4ffc5d8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ff40c7d70 con 0x7f4ff40c9b70 2024-09-05T07:29:17.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.851+0000 7f4ffc5d8640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f4ff40c4cf0 con 0x7f4ff40c9790 2024-09-05T07:29:17.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.852+0000 7f4ffa374640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ff40c9790 0x7f4ff4157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:17.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.852+0000 7f4ff9b73640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4ff40c9b70 0x7f4ff406ff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.17:39568/0 (socket says 172.21.15.17:39568) 2024-09-05T07:29:17.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.852+0000 7f4ff9b73640 1 -- 172.21.15.17:0/2468875622 learned_addr learned my addr 172.21.15.17:0/2468875622 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:29:17.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.855+0000 7f4ffa374640 1 -- 172.21.15.17:0/2468875622 >> v1:172.21.15.26:6789/0 conn(0x7f4ff40c9b70 legacy=0x7f4ff406ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:17.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.855+0000 7f4ffa374640 1 -- 172.21.15.17:0/2468875622 >> v1:172.21.15.17:6789/0 conn(0x7f4ff40c87e0 legacy=0x7f4ff4150c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:17.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.855+0000 7f4ffa374640 1 -- 172.21.15.17:0/2468875622 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff40c8050 con 0x7f4ff40c9790 2024-09-05T07:29:17.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.858+0000 7f4ffa374640 1 --2- 172.21.15.17:0/2468875622 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ff40c9790 0x7f4ff4157810 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4ff00097d0 tx=0x7f4ff002b360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b28d3571df3efd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:17.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.862+0000 7f4ff9372640 1 -- 172.21.15.17:0/2468875622 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0038070 con 0x7f4ff40c9790 2024-09-05T07:29:17.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.863+0000 7f4ff9372640 1 -- 172.21.15.17:0/2468875622 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ff0033640 con 0x7f4ff40c9790 2024-09-05T07:29:17.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.863+0000 7f4ff9372640 1 -- 172.21.15.17:0/2468875622 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0033a10 con 0x7f4ff40c9790 2024-09-05T07:29:17.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.863+0000 7f4ffc5d8640 1 -- 172.21.15.17:0/2468875622 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ff40c9790 msgr2=0x7f4ff4157810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:17.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.863+0000 7f4ffc5d8640 1 --2- 172.21.15.17:0/2468875622 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ff40c9790 0x7f4ff4157810 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4ff00097d0 tx=0x7f4ff002b360 comp rx=0 tx=0).stop 2024-09-05T07:29:17.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.864+0000 7f4ffc5d8640 1 -- 172.21.15.17:0/2468875622 shutdown_connections 2024-09-05T07:29:17.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.864+0000 7f4ffc5d8640 1 --2- 172.21.15.17:0/2468875622 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ff40c9790 0x7f4ff4157810 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:17.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.864+0000 7f4ffc5d8640 1 -- 172.21.15.17:0/2468875622 >> 172.21.15.17:0/2468875622 conn(0x7f4ff406bdf0 msgr2=0x7f4ff406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:17.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.864+0000 7f4ffc5d8640 1 -- 172.21.15.17:0/2468875622 shutdown_connections 2024-09-05T07:29:17.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.864+0000 7f4ffc5d8640 1 -- 172.21.15.17:0/2468875622 wait complete. 2024-09-05T07:29:17.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.866+0000 7f4ffc5d8640 1 Processor -- start 2024-09-05T07:29:17.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.866+0000 7f4ffc5d8640 1 -- start start 2024-09-05T07:29:17.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.867+0000 7f4ffc5d8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ff40c87e0 0x7f4ff40caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:17.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.867+0000 7f4ffc5d8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ff40c9790 0x7f4ff4155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:17.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.867+0000 7f4ffc5d8640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ff40c9b70 0x7f4ff41f4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:17.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.867+0000 7f4ffc5d8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff406f700 con 0x7f4ff40c9790 2024-09-05T07:29:17.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.867+0000 7f4ffc5d8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff406f9e0 con 0x7f4ff40c87e0 2024-09-05T07:29:17.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.867+0000 7f4ffc5d8640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f4ff4070610 con 0x7f4ff40c9b70 2024-09-05T07:29:17.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.868+0000 7f4ffab75640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ff40c9b70 0x7f4ff41f4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:17.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.868+0000 7f4ffa374640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ff40c87e0 0x7f4ff40caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:17.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.868+0000 7f4ffab75640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ff40c9b70 0x7f4ff41f4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:49900/0 (socket says 172.21.15.17:49900) 2024-09-05T07:29:17.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.868+0000 7f4ffab75640 1 -- 172.21.15.17:0/616630886 learned_addr learned my addr 172.21.15.17:0/616630886 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:17.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.872+0000 7f4ffa374640 1 -- 172.21.15.17:0/616630886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ff40c9b70 msgr2=0x7f4ff41f4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:17.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.872+0000 7f4ffa374640 1 --2- 172.21.15.17:0/616630886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ff40c9b70 0x7f4ff41f4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:17.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.872+0000 7f4ffa374640 1 -- 172.21.15.17:0/616630886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ff40c9790 msgr2=0x7f4ff4155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:17.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.872+0000 7f4ffa374640 1 --2- 172.21.15.17:0/616630886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ff40c9790 0x7f4ff4155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:17.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.872+0000 7f4ffa374640 1 -- 172.21.15.17:0/616630886 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff4146ed0 con 0x7f4ff40c87e0 2024-09-05T07:29:17.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.876+0000 7f4ffa374640 1 --2- 172.21.15.17:0/616630886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ff40c87e0 0x7f4ff40caad0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0032000 tx=0x7f4ff00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:17.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.880+0000 7f4feaffd640 1 -- 172.21.15.17:0/616630886 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0038050 con 0x7f4ff40c87e0 2024-09-05T07:29:17.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.880+0000 7f4feaffd640 1 -- 172.21.15.17:0/616630886 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ff0044070 con 0x7f4ff40c87e0 2024-09-05T07:29:17.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.880+0000 7f4ffc5d8640 1 -- 172.21.15.17:0/616630886 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ff41f5200 con 0x7f4ff40c87e0 2024-09-05T07:29:17.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.880+0000 7f4feaffd640 1 -- 172.21.15.17:0/616630886 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0031e40 con 0x7f4ff40c87e0 2024-09-05T07:29:17.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.880+0000 7f4ffc5d8640 1 -- 172.21.15.17:0/616630886 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ff414d250 con 0x7f4ff40c87e0 2024-09-05T07:29:17.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.882+0000 7f4ffc5d8640 1 -- 172.21.15.17:0/616630886 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ff4146b60 con 0x7f4ff40c87e0 2024-09-05T07:29:17.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.907+0000 7f4feaffd640 1 -- 172.21.15.17:0/616630886 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ff0049460 con 0x7f4ff40c87e0 2024-09-05T07:29:17.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.908+0000 7f4feaffd640 1 --2- 172.21.15.17:0/616630886 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f4fd806beb0 0x7f4fd806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:17.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.908+0000 7f4ff9b73640 1 --2- 172.21.15.17:0/616630886 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f4fd806beb0 0x7f4fd806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:17.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:17.909+0000 7f4ff9b73640 1 --2- 172.21.15.17:0/616630886 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f4fd806beb0 0x7f4fd806e370 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4000f60 tx=0x7f4fe4007a80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:18.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:18.183+0000 7f4feaffd640 1 -- 172.21.15.17:0/616630886 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f4ff00335f0 con 0x7f4ff40c87e0 2024-09-05T07:29:18.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:18.194+0000 7f4feaffd640 1 -- 172.21.15.17:0/616630886 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4ff007b160 con 0x7f4ff40c87e0 2024-09-05T07:29:18.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:18.438+0000 7f4ffc5d8640 1 -- 172.21.15.17:0/616630886 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ff40c3710 con 0x7f4ff40c87e0 2024-09-05T07:29:18.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:18.483+0000 7f4feaffd640 1 -- 172.21.15.17:0/616630886 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f4ff007aa60 con 0x7f4ff40c87e0 2024-09-05T07:29:18.484 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:29:18.484 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":1,"btime":"2024-09-05T07:28:54:065587+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-05T07:29:18.485 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 1 2024-09-05T07:29:18.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:18.485+0000 7f4ffc5d8640 1 -- 172.21.15.17:0/616630886 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f4fd806beb0 msgr2=0x7f4fd806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:18.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:18.485+0000 7f4ffc5d8640 1 --2- 172.21.15.17:0/616630886 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f4fd806beb0 0x7f4fd806e370 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4000f60 tx=0x7f4fe4007a80 comp rx=0 tx=0).stop 2024-09-05T07:29:18.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:18.486+0000 7f4ffc5d8640 1 -- 172.21.15.17:0/616630886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ff40c87e0 msgr2=0x7f4ff40caad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:18.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:18.486+0000 7f4ffc5d8640 1 --2- 172.21.15.17:0/616630886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ff40c87e0 0x7f4ff40caad0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0032000 tx=0x7f4ff00046c0 comp rx=0 tx=0).stop 2024-09-05T07:29:18.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:18.486+0000 7f4ffc5d8640 1 -- 172.21.15.17:0/616630886 shutdown_connections 2024-09-05T07:29:18.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:18.486+0000 7f4ffc5d8640 1 --2- 172.21.15.17:0/616630886 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f4fd806beb0 0x7f4fd806e370 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:18.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:18.486+0000 7f4ffc5d8640 1 --2- 172.21.15.17:0/616630886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ff40c9b70 0x7f4ff41f4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:18.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:18.486+0000 7f4ffc5d8640 1 --2- 172.21.15.17:0/616630886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ff40c9790 0x7f4ff4155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:18.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:18.486+0000 7f4ffc5d8640 1 --2- 172.21.15.17:0/616630886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ff40c87e0 0x7f4ff40caad0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:18.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:18.486+0000 7f4ffc5d8640 1 -- 172.21.15.17:0/616630886 >> 172.21.15.17:0/616630886 conn(0x7f4ff406bdf0 msgr2=0x7f4ff4150080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:18.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:18.486+0000 7f4ffc5d8640 1 -- 172.21.15.17:0/616630886 shutdown_connections 2024-09-05T07:29:18.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:18.486+0000 7f4ffc5d8640 1 -- 172.21.15.17:0/616630886 wait complete. 2024-09-05T07:29:20.498 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-05T07:29:20.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.630+0000 7fb2eed2c640 1 Processor -- start 2024-09-05T07:29:20.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.630+0000 7fb2eed2c640 1 -- start start 2024-09-05T07:29:20.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.630+0000 7fb2eed2c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb2e80c9290 0x7fb2e815ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:20.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.630+0000 7fb2eed2c640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2e806bcb0 con 0x7fb2e81596c0 2024-09-05T07:29:20.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.630+0000 7fb2eed2c640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2e806bf50 con 0x7fb2e80c79c0 2024-09-05T07:29:20.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.630+0000 7fb2eed2c640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fb2e806cd10 con 0x7fb2e80c9290 2024-09-05T07:29:20.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.631+0000 7fb2ed2c9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb2e80c9290 0x7fb2e815ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:20.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.631+0000 7fb2ecac8640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fb2e81596c0 0x7fb2e80729b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:50584/0 (socket says 172.21.15.17:50584) 2024-09-05T07:29:20.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.631+0000 7fb2ecac8640 1 -- 172.21.15.17:0/1818986345 learned_addr learned my addr 172.21.15.17:0/1818986345 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:29:20.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.635+0000 7fb2ed2c9640 1 -- 172.21.15.17:0/1818986345 >> v1:172.21.15.26:6789/0 conn(0x7fb2e80c79c0 legacy=0x7fb2e80c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:20.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.635+0000 7fb2ed2c9640 1 -- 172.21.15.17:0/1818986345 >> v1:172.21.15.17:6789/0 conn(0x7fb2e81596c0 legacy=0x7fb2e80729b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:20.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.635+0000 7fb2e77fe640 1 -- 172.21.15.17:0/1818986345 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3411528229 0 0) 0x7fb2e806bcb0 con 0x7fb2e81596c0 2024-09-05T07:29:20.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.635+0000 7fb2ed2c9640 1 -- 172.21.15.17:0/1818986345 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2e806c230 con 0x7fb2e80c9290 2024-09-05T07:29:20.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.639+0000 7fb2ed2c9640 1 --2- 172.21.15.17:0/1818986345 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2e80c9290 0x7fb2e815ca10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0009d90 tx=0x7fb2e002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7bc7edc6967957bd server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:20.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.644+0000 7fb2e77fe640 1 -- 172.21.15.17:0/1818986345 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e0007740 con 0x7fb2e80c9290 2024-09-05T07:29:20.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.644+0000 7fb2e77fe640 1 -- 172.21.15.17:0/1818986345 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2e00078e0 con 0x7fb2e80c9290 2024-09-05T07:29:20.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.644+0000 7fb2e77fe640 1 -- 172.21.15.17:0/1818986345 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e0007cb0 con 0x7fb2e80c9290 2024-09-05T07:29:20.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.645+0000 7fb2eed2c640 1 -- 172.21.15.17:0/1818986345 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2e80c9290 msgr2=0x7fb2e815ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:20.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.645+0000 7fb2eed2c640 1 --2- 172.21.15.17:0/1818986345 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2e80c9290 0x7fb2e815ca10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0009d90 tx=0x7fb2e002a6f0 comp rx=0 tx=0).stop 2024-09-05T07:29:20.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.645+0000 7fb2eed2c640 1 -- 172.21.15.17:0/1818986345 shutdown_connections 2024-09-05T07:29:20.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.645+0000 7fb2eed2c640 1 --2- 172.21.15.17:0/1818986345 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2e80c9290 0x7fb2e815ca10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:20.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.645+0000 7fb2eed2c640 1 -- 172.21.15.17:0/1818986345 >> 172.21.15.17:0/1818986345 conn(0x7fb2e80c9ae0 msgr2=0x7fb2e80c9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:20.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.645+0000 7fb2eed2c640 1 -- 172.21.15.17:0/1818986345 shutdown_connections 2024-09-05T07:29:20.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.645+0000 7fb2eed2c640 1 -- 172.21.15.17:0/1818986345 wait complete. 2024-09-05T07:29:20.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.646+0000 7fb2eed2c640 1 Processor -- start 2024-09-05T07:29:20.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.646+0000 7fb2eed2c640 1 -- start start 2024-09-05T07:29:20.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.647+0000 7fb2eed2c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2e80c79c0 0x7fb2e81e1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:20.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.647+0000 7fb2eed2c640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb2e80c9290 0x7fb2e81f1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:20.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.647+0000 7fb2eed2c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2e81596c0 0x7fb2e81ef3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:20.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.647+0000 7fb2eed2c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e806c7f0 con 0x7fb2e81596c0 2024-09-05T07:29:20.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.647+0000 7fb2eed2c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e815cf50 con 0x7fb2e80c79c0 2024-09-05T07:29:20.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.647+0000 7fb2eed2c640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fb2e80c9880 con 0x7fb2e80c9290 2024-09-05T07:29:20.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.648+0000 7fb2e7fff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb2e80c9290 0x7fb2e81f1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:20.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.648+0000 7fb2ecac8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2e80c79c0 0x7fb2e81e1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:20.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.648+0000 7fb2ed2c9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2e81596c0 0x7fb2e81ef3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:20.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.648+0000 7fb2e7fff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb2e80c9290 0x7fb2e81f1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:54730/0 (socket says 172.21.15.17:54730) 2024-09-05T07:29:20.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.648+0000 7fb2e7fff640 1 -- 172.21.15.17:0/4279620554 learned_addr learned my addr 172.21.15.17:0/4279620554 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:20.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.652+0000 7fb2e7fff640 1 -- 172.21.15.17:0/4279620554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2e80c79c0 msgr2=0x7fb2e81e1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:20.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.652+0000 7fb2e7fff640 1 --2- 172.21.15.17:0/4279620554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2e80c79c0 0x7fb2e81e1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:20.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.652+0000 7fb2e7fff640 1 -- 172.21.15.17:0/4279620554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2e81596c0 msgr2=0x7fb2e81ef3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:20.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.652+0000 7fb2e7fff640 1 --2- 172.21.15.17:0/4279620554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2e81596c0 0x7fb2e81ef3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:20.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.652+0000 7fb2e7fff640 1 -- 172.21.15.17:0/4279620554 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2e80c2040 con 0x7fb2e80c9290 2024-09-05T07:29:20.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.655+0000 7fb2e7fff640 1 --2- 172.21.15.17:0/4279620554 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb2e80c9290 0x7fb2e81f1df0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb2d400c450 tx=0x7fb2d400c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:20.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.659+0000 7fb2e57fa640 1 -- 172.21.15.17:0/4279620554 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d40052d0 con 0x7fb2e80c9290 2024-09-05T07:29:20.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.659+0000 7fb2e57fa640 1 -- 172.21.15.17:0/4279620554 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2d4005470 con 0x7fb2e80c9290 2024-09-05T07:29:20.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.660+0000 7fb2eed2c640 1 -- 172.21.15.17:0/4279620554 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2e81f2330 con 0x7fb2e80c9290 2024-09-05T07:29:20.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.660+0000 7fb2e57fa640 1 -- 172.21.15.17:0/4279620554 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4012870 con 0x7fb2e80c9290 2024-09-05T07:29:20.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.660+0000 7fb2eed2c640 1 -- 172.21.15.17:0/4279620554 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2e80c22e0 con 0x7fb2e80c9290 2024-09-05T07:29:20.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.661+0000 7fb2eed2c640 1 -- 172.21.15.17:0/4279620554 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2e81501e0 con 0x7fb2e80c9290 2024-09-05T07:29:20.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.686+0000 7fb2e57fa640 1 -- 172.21.15.17:0/4279620554 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb2d4012a10 con 0x7fb2e80c9290 2024-09-05T07:29:20.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.686+0000 7fb2e57fa640 1 --2- 172.21.15.17:0/4279620554 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fb2cc06beb0 0x7fb2cc06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:20.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.686+0000 7fb2ecac8640 1 --2- 172.21.15.17:0/4279620554 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fb2cc06beb0 0x7fb2cc06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:20.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.687+0000 7fb2ecac8640 1 --2- 172.21.15.17:0/4279620554 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fb2cc06beb0 0x7fb2cc06e370 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc007fd0 tx=0x7fb2dc007de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:20.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.689+0000 7fb2e57fa640 1 -- 172.21.15.17:0/4279620554 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fb2d405fff0 con 0x7fb2e80c9290 2024-09-05T07:29:20.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:20.974+0000 7fb2e57fa640 1 -- 172.21.15.17:0/4279620554 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb2d4059800 con 0x7fb2e80c9290 2024-09-05T07:29:21.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:21.187+0000 7fb2eed2c640 1 -- 172.21.15.17:0/4279620554 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb2e8159aa0 con 0x7fb2e80c9290 2024-09-05T07:29:21.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:21.208+0000 7fb2e57fa640 1 -- 172.21.15.17:0/4279620554 <== mon.2 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fb2d405db00 con 0x7fb2e80c9290 2024-09-05T07:29:21.209 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:29:21.209 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":1,"btime":"2024-09-05T07:28:54:065587+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-05T07:29:21.209 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 1 2024-09-05T07:29:21.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:21.211+0000 7fb2eed2c640 1 -- 172.21.15.17:0/4279620554 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fb2cc06beb0 msgr2=0x7fb2cc06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:21.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:21.211+0000 7fb2eed2c640 1 --2- 172.21.15.17:0/4279620554 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fb2cc06beb0 0x7fb2cc06e370 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc007fd0 tx=0x7fb2dc007de0 comp rx=0 tx=0).stop 2024-09-05T07:29:21.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:21.211+0000 7fb2eed2c640 1 -- 172.21.15.17:0/4279620554 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb2e80c9290 msgr2=0x7fb2e81f1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:21.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:21.211+0000 7fb2eed2c640 1 --2- 172.21.15.17:0/4279620554 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb2e80c9290 0x7fb2e81f1df0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb2d400c450 tx=0x7fb2d400c910 comp rx=0 tx=0).stop 2024-09-05T07:29:21.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:21.211+0000 7fb2eed2c640 1 -- 172.21.15.17:0/4279620554 shutdown_connections 2024-09-05T07:29:21.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:21.211+0000 7fb2eed2c640 1 --2- 172.21.15.17:0/4279620554 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fb2cc06beb0 0x7fb2cc06e370 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:21.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:21.211+0000 7fb2eed2c640 1 --2- 172.21.15.17:0/4279620554 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb2e80c9290 0x7fb2e81f1df0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:21.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:21.211+0000 7fb2eed2c640 1 --2- 172.21.15.17:0/4279620554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2e81596c0 0x7fb2e81ef3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:21.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:21.211+0000 7fb2eed2c640 1 --2- 172.21.15.17:0/4279620554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2e80c79c0 0x7fb2e81e1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:21.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:21.211+0000 7fb2eed2c640 1 -- 172.21.15.17:0/4279620554 >> 172.21.15.17:0/4279620554 conn(0x7fb2e80c9ae0 msgr2=0x7fb2e81580b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:21.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:21.211+0000 7fb2eed2c640 1 -- 172.21.15.17:0/4279620554 shutdown_connections 2024-09-05T07:29:21.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:21.211+0000 7fb2eed2c640 1 -- 172.21.15.17:0/4279620554 wait complete. 2024-09-05T07:29:23.223 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-05T07:29:23.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.325+0000 7f1fe77c6640 1 Processor -- start 2024-09-05T07:29:23.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.325+0000 7f1fe77c6640 1 -- start start 2024-09-05T07:29:23.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.326+0000 7f1fe77c6640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1fe0154770 0x7f1fe015b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:23.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.326+0000 7f1fe77c6640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fe00c5a80 0x7f1fe00c5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:23.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.326+0000 7f1fe77c6640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fe006c8c0 con 0x7f1fe00cafa0 2024-09-05T07:29:23.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.326+0000 7f1fe77c6640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f1fe00c5310 con 0x7f1fe0154770 2024-09-05T07:29:23.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.326+0000 7f1fe77c6640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f1fe00cb950 con 0x7f1fe00c5a80 2024-09-05T07:29:23.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.327+0000 7f1fe5562640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1fe0154770 0x7f1fe015b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:23.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.327+0000 7f1fe5562640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1fe0154770 0x7f1fe015b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44022/0 (socket says 172.21.15.17:44022) 2024-09-05T07:29:23.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.327+0000 7f1fe5562640 1 -- 172.21.15.17:0/2729584827 learned_addr learned my addr 172.21.15.17:0/2729584827 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:23.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.328+0000 7f1fe5d63640 1 --2- 172.21.15.17:0/2729584827 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fe00c5a80 0x7f1fe00c5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:23.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.330+0000 7f1fe5d63640 1 -- 172.21.15.17:0/2729584827 >> v2:172.21.15.17:3300/0 conn(0x7f1fe0154770 msgr2=0x7f1fe015b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:23.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.330+0000 7f1fe5d63640 1 --2- 172.21.15.17:0/2729584827 >> v2:172.21.15.17:3300/0 conn(0x7f1fe0154770 0x7f1fe015b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:23.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.330+0000 7f1fe5d63640 1 -- 172.21.15.17:0/2729584827 >> v1:172.21.15.17:6789/0 conn(0x7f1fe00cafa0 legacy=0x7f1fe00d05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:23.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.330+0000 7f1fe5d63640 1 -- 172.21.15.17:0/2729584827 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fe006cb60 con 0x7f1fe00c5a80 2024-09-05T07:29:23.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.332+0000 7f1fe5d63640 1 --2- 172.21.15.17:0/2729584827 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fe00c5a80 0x7f1fe00c5ef0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1fe00c5490 tx=0x7f1fd802a5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70a0b8fb4d1fe6f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:23.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.337+0000 7f1fd7fff640 1 -- 172.21.15.17:0/2729584827 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8007740 con 0x7f1fe00c5a80 2024-09-05T07:29:23.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.337+0000 7f1fd7fff640 1 -- 172.21.15.17:0/2729584827 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fd80078e0 con 0x7f1fe00c5a80 2024-09-05T07:29:23.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.337+0000 7f1fd7fff640 1 -- 172.21.15.17:0/2729584827 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8007cb0 con 0x7f1fe00c5a80 2024-09-05T07:29:23.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.338+0000 7f1fe77c6640 1 -- 172.21.15.17:0/2729584827 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fe00c5a80 msgr2=0x7f1fe00c5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:23.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.338+0000 7f1fe77c6640 1 --2- 172.21.15.17:0/2729584827 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fe00c5a80 0x7f1fe00c5ef0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1fe00c5490 tx=0x7f1fd802a5b0 comp rx=0 tx=0).stop 2024-09-05T07:29:23.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.338+0000 7f1fe77c6640 1 -- 172.21.15.17:0/2729584827 shutdown_connections 2024-09-05T07:29:23.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.338+0000 7f1fe77c6640 1 --2- 172.21.15.17:0/2729584827 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fe00c5a80 0x7f1fe00c5ef0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:23.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.338+0000 7f1fe77c6640 1 --2- 172.21.15.17:0/2729584827 >> v2:172.21.15.17:3300/0 conn(0x7f1fe0154770 0x7f1fe015b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:23.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.338+0000 7f1fe77c6640 1 -- 172.21.15.17:0/2729584827 >> 172.21.15.17:0/2729584827 conn(0x7f1fe0073710 msgr2=0x7f1fe0073b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:23.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.338+0000 7f1fe77c6640 1 -- 172.21.15.17:0/2729584827 shutdown_connections 2024-09-05T07:29:23.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.338+0000 7f1fe77c6640 1 -- 172.21.15.17:0/2729584827 wait complete. 2024-09-05T07:29:23.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.340+0000 7f1fe77c6640 1 Processor -- start 2024-09-05T07:29:23.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.340+0000 7f1fe77c6640 1 -- start start 2024-09-05T07:29:23.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.341+0000 7f1fe77c6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fe00c5a80 0x7f1fe0155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:23.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.341+0000 7f1fe77c6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fe00cafa0 0x7f1fe0155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:23.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.341+0000 7f1fe77c6640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fe0154770 0x7f1fe01f18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:23.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.341+0000 7f1fe77c6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe00c6430 con 0x7f1fe00cafa0 2024-09-05T07:29:23.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.341+0000 7f1fe77c6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe00cbc30 con 0x7f1fe00c5a80 2024-09-05T07:29:23.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.341+0000 7f1fe77c6640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f1fe0154b50 con 0x7f1fe0154770 2024-09-05T07:29:23.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.342+0000 7f1fe5562640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fe00c5a80 0x7f1fe0155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:23.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.342+0000 7f1fe5562640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fe00c5a80 0x7f1fe0155030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:53492/0 (socket says 172.21.15.17:53492) 2024-09-05T07:29:23.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.342+0000 7f1fe5562640 1 -- 172.21.15.17:0/364550393 learned_addr learned my addr 172.21.15.17:0/364550393 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:23.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.344+0000 7f1fe4d61640 1 --2- 172.21.15.17:0/364550393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fe00cafa0 0x7f1fe0155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:23.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.344+0000 7f1fe5d63640 1 --2- 172.21.15.17:0/364550393 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fe0154770 0x7f1fe01f18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:23.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.348+0000 7f1fe5d63640 1 -- 172.21.15.17:0/364550393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fe00c5a80 msgr2=0x7f1fe0155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:23.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.348+0000 7f1fe5d63640 1 --2- 172.21.15.17:0/364550393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fe00c5a80 0x7f1fe0155030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:23.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.348+0000 7f1fe5d63640 1 -- 172.21.15.17:0/364550393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fe00cafa0 msgr2=0x7f1fe0155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:23.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.348+0000 7f1fe5d63640 1 --2- 172.21.15.17:0/364550393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fe00cafa0 0x7f1fe0155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:23.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.348+0000 7f1fe5d63640 1 -- 172.21.15.17:0/364550393 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fe00c9ed0 con 0x7f1fe0154770 2024-09-05T07:29:23.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.351+0000 7f1fe5d63640 1 --2- 172.21.15.17:0/364550393 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fe0154770 0x7f1fe01f18c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1fe00cdda0 tx=0x7f1fd8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:23.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.355+0000 7f1fd5ffb640 1 -- 172.21.15.17:0/364550393 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8040070 con 0x7f1fe0154770 2024-09-05T07:29:23.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.355+0000 7f1fd5ffb640 1 -- 172.21.15.17:0/364550393 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fd8031bc0 con 0x7f1fe0154770 2024-09-05T07:29:23.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.355+0000 7f1fd5ffb640 1 -- 172.21.15.17:0/364550393 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8009450 con 0x7f1fe0154770 2024-09-05T07:29:23.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.355+0000 7f1fe77c6640 1 -- 172.21.15.17:0/364550393 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fe00c95c0 con 0x7f1fe0154770 2024-09-05T07:29:23.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.355+0000 7f1fe77c6640 1 -- 172.21.15.17:0/364550393 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fe00c9880 con 0x7f1fe0154770 2024-09-05T07:29:23.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.357+0000 7f1fe77c6640 1 -- 172.21.15.17:0/364550393 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fe006bca0 con 0x7f1fe0154770 2024-09-05T07:29:23.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.653+0000 7f1fd5ffb640 1 -- 172.21.15.17:0/364550393 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1fd8039040 con 0x7f1fe0154770 2024-09-05T07:29:23.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.654+0000 7f1fd5ffb640 1 --2- 172.21.15.17:0/364550393 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f1fc406be80 0x7f1fc406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:23.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.654+0000 7f1fe5562640 1 --2- 172.21.15.17:0/364550393 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f1fc406be80 0x7f1fc406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:23.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.655+0000 7f1fe5562640 1 --2- 172.21.15.17:0/364550393 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f1fc406be80 0x7f1fc406e340 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc006f40 tx=0x7f1fdc009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:23.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.657+0000 7f1fd5ffb640 1 -- 172.21.15.17:0/364550393 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f1fd8078cf0 con 0x7f1fe0154770 2024-09-05T07:29:23.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.674+0000 7f1fd5ffb640 1 -- 172.21.15.17:0/364550393 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1fd80aae20 con 0x7f1fe0154770 2024-09-05T07:29:23.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.906+0000 7f1fe77c6640 1 -- 172.21.15.17:0/364550393 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1fe01f1620 con 0x7f1fe0154770 2024-09-05T07:29:23.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.912+0000 7f1fd5ffb640 1 -- 172.21.15.17:0/364550393 <== mon.2 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f1fd807ac50 con 0x7f1fe0154770 2024-09-05T07:29:23.914 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:29:23.914 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":1,"btime":"2024-09-05T07:28:54:065587+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-05T07:29:23.915 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 1 2024-09-05T07:29:23.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.914+0000 7f1fe77c6640 1 -- 172.21.15.17:0/364550393 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f1fc406be80 msgr2=0x7f1fc406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:23.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.914+0000 7f1fe77c6640 1 --2- 172.21.15.17:0/364550393 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f1fc406be80 0x7f1fc406e340 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc006f40 tx=0x7f1fdc009240 comp rx=0 tx=0).stop 2024-09-05T07:29:23.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.914+0000 7f1fe77c6640 1 -- 172.21.15.17:0/364550393 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fe0154770 msgr2=0x7f1fe01f18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:23.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.914+0000 7f1fe77c6640 1 --2- 172.21.15.17:0/364550393 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fe0154770 0x7f1fe01f18c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1fe00cdda0 tx=0x7f1fd8004a40 comp rx=0 tx=0).stop 2024-09-05T07:29:23.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.914+0000 7f1fe77c6640 1 -- 172.21.15.17:0/364550393 shutdown_connections 2024-09-05T07:29:23.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.914+0000 7f1fe77c6640 1 --2- 172.21.15.17:0/364550393 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f1fc406be80 0x7f1fc406e340 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:23.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.914+0000 7f1fe77c6640 1 --2- 172.21.15.17:0/364550393 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1fe0154770 0x7f1fe01f18c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:23.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.914+0000 7f1fe77c6640 1 --2- 172.21.15.17:0/364550393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fe00cafa0 0x7f1fe0155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:23.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.914+0000 7f1fe77c6640 1 --2- 172.21.15.17:0/364550393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fe00c5a80 0x7f1fe0155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:23.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.914+0000 7f1fe77c6640 1 -- 172.21.15.17:0/364550393 >> 172.21.15.17:0/364550393 conn(0x7f1fe0073710 msgr2=0x7f1fe0072230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:23.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.914+0000 7f1fe77c6640 1 -- 172.21.15.17:0/364550393 shutdown_connections 2024-09-05T07:29:23.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:23.914+0000 7f1fe77c6640 1 -- 172.21.15.17:0/364550393 wait complete. 2024-09-05T07:29:24.261 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2024-09-05T07:29:24.317 INFO:tasks.ceph.mds.e.smithi017.stdout:starting mds.e at 2024-09-05T07:29:24.330 INFO:tasks.ceph.mds.f.smithi026.stdout:starting mds.f at 2024-09-05T07:29:24.410 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2024-09-05T07:29:24.430 INFO:tasks.ceph.mds.d.smithi026.stdout:starting mds.d at 2024-09-05T07:29:24.450 INFO:tasks.ceph.mds.b.smithi026.stdout:starting mds.b at 2024-09-05T07:29:25.927 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-05T07:29:26.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.035+0000 7f81906b7640 1 Processor -- start 2024-09-05T07:29:26.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.035+0000 7f81906b7640 1 -- start start 2024-09-05T07:29:26.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.036+0000 7f81906b7640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8188154b60 0x7f818806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:26.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.036+0000 7f81906b7640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f818806c230 0x7f818815e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:26.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.036+0000 7f81906b7640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8188072920 con 0x7f818806c780 2024-09-05T07:29:26.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.036+0000 7f81906b7640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f8188072c00 con 0x7f8188154b60 2024-09-05T07:29:26.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.036+0000 7f81906b7640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f8188072ee0 con 0x7f818806c230 2024-09-05T07:29:26.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.038+0000 7f818dc52640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f818806c780 0x7f8188067950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.17:35934/0 (socket says 172.21.15.17:35934) 2024-09-05T07:29:26.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.038+0000 7f818dc52640 1 -- 172.21.15.17:0/930940700 learned_addr learned my addr 172.21.15.17:0/930940700 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:29:26.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.039+0000 7f818e453640 1 --2- 172.21.15.17:0/930940700 >> v2:172.21.15.26:3300/0 conn(0x7f8188154b60 0x7f818806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:26.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.039+0000 7f818ec54640 1 --2- 172.21.15.17:0/930940700 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f818806c230 0x7f818815e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:26.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.042+0000 7f818ec54640 1 -- 172.21.15.17:0/930940700 >> v2:172.21.15.26:3300/0 conn(0x7f8188154b60 msgr2=0x7f818806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:26.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.042+0000 7f818ec54640 1 --2- 172.21.15.17:0/930940700 >> v2:172.21.15.26:3300/0 conn(0x7f8188154b60 0x7f818806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:26.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.042+0000 7f818ec54640 1 -- 172.21.15.17:0/930940700 >> v1:172.21.15.26:6789/0 conn(0x7f818806c780 legacy=0x7f8188067950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:26.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.042+0000 7f818ec54640 1 -- 172.21.15.17:0/930940700 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f818806cd60 con 0x7f818806c230 2024-09-05T07:29:26.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.044+0000 7f818ec54640 1 --2- 172.21.15.17:0/930940700 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f818806c230 0x7f818815e020 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8180009d90 tx=0x7f818002a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c95c4ad86f15a47 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:26.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.049+0000 7f818d451640 1 -- 172.21.15.17:0/930940700 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8180007740 con 0x7f818806c230 2024-09-05T07:29:26.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.049+0000 7f818d451640 1 -- 172.21.15.17:0/930940700 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81800078e0 con 0x7f818806c230 2024-09-05T07:29:26.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.049+0000 7f818d451640 1 -- 172.21.15.17:0/930940700 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8180007cb0 con 0x7f818806c230 2024-09-05T07:29:26.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.050+0000 7f81906b7640 1 -- 172.21.15.17:0/930940700 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f818806c230 msgr2=0x7f818815e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:26.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.050+0000 7f81906b7640 1 --2- 172.21.15.17:0/930940700 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f818806c230 0x7f818815e020 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8180009d90 tx=0x7f818002a6f0 comp rx=0 tx=0).stop 2024-09-05T07:29:26.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.050+0000 7f81906b7640 1 -- 172.21.15.17:0/930940700 shutdown_connections 2024-09-05T07:29:26.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.050+0000 7f81906b7640 1 --2- 172.21.15.17:0/930940700 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f818806c230 0x7f818815e020 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:26.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.050+0000 7f81906b7640 1 --2- 172.21.15.17:0/930940700 >> v2:172.21.15.26:3300/0 conn(0x7f8188154b60 0x7f818806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:26.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.050+0000 7f81906b7640 1 -- 172.21.15.17:0/930940700 >> 172.21.15.17:0/930940700 conn(0x7f81880cd440 msgr2=0x7f81880cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:26.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.050+0000 7f81906b7640 1 -- 172.21.15.17:0/930940700 shutdown_connections 2024-09-05T07:29:26.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.050+0000 7f81906b7640 1 -- 172.21.15.17:0/930940700 wait complete. 2024-09-05T07:29:26.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.051+0000 7f81906b7640 1 Processor -- start 2024-09-05T07:29:26.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.051+0000 7f81906b7640 1 -- start start 2024-09-05T07:29:26.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.052+0000 7f81906b7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f818806c230 0x7f81880c3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:26.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.052+0000 7f81906b7640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f818806c780 0x7f81881f0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:26.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.052+0000 7f81906b7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8188154b60 0x7f8188144cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:26.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.052+0000 7f81906b7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f81881550c0 con 0x7f818806c230 2024-09-05T07:29:26.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.052+0000 7f81906b7640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8188154f40 con 0x7f8188154b60 2024-09-05T07:29:26.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.052+0000 7f81906b7640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f8188068060 con 0x7f818806c780 2024-09-05T07:29:26.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.053+0000 7f818ec54640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8188154b60 0x7f8188144cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:26.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.053+0000 7f818e453640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f818806c230 0x7f81880c3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:26.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.053+0000 7f818dc52640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f818806c780 0x7f81881f0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:26.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.053+0000 7f818ec54640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8188154b60 0x7f8188144cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:53546/0 (socket says 172.21.15.17:53546) 2024-09-05T07:29:26.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.053+0000 7f818ec54640 1 -- 172.21.15.17:0/438473949 learned_addr learned my addr 172.21.15.17:0/438473949 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:26.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.057+0000 7f818ec54640 1 -- 172.21.15.17:0/438473949 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f818806c780 msgr2=0x7f81881f0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:26.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.057+0000 7f818ec54640 1 --2- 172.21.15.17:0/438473949 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f818806c780 0x7f81881f0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:26.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.057+0000 7f818ec54640 1 -- 172.21.15.17:0/438473949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f818806c230 msgr2=0x7f81880c3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:26.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.057+0000 7f818ec54640 1 --2- 172.21.15.17:0/438473949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f818806c230 0x7f81880c3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:26.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.057+0000 7f818ec54640 1 -- 172.21.15.17:0/438473949 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81880c5800 con 0x7f8188154b60 2024-09-05T07:29:26.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.059+0000 7f818ec54640 1 --2- 172.21.15.17:0/438473949 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8188154b60 0x7f8188144cd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8180009eb0 tx=0x7f8180004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:26.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.063+0000 7f817effd640 1 -- 172.21.15.17:0/438473949 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8180040070 con 0x7f8188154b60 2024-09-05T07:29:26.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.063+0000 7f817effd640 1 -- 172.21.15.17:0/438473949 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8180031b40 con 0x7f8188154b60 2024-09-05T07:29:26.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.063+0000 7f817effd640 1 -- 172.21.15.17:0/438473949 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8180045460 con 0x7f8188154b60 2024-09-05T07:29:26.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.063+0000 7f81906b7640 1 -- 172.21.15.17:0/438473949 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f818814bc30 con 0x7f8188154b60 2024-09-05T07:29:26.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.063+0000 7f81906b7640 1 -- 172.21.15.17:0/438473949 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81880c5ef0 con 0x7f8188154b60 2024-09-05T07:29:26.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.064+0000 7f81906b7640 1 -- 172.21.15.17:0/438473949 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f818806bc10 con 0x7f8188154b60 2024-09-05T07:29:26.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.382+0000 7f817effd640 1 -- 172.21.15.17:0/438473949 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8180039040 con 0x7f8188154b60 2024-09-05T07:29:26.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.382+0000 7f817effd640 1 --2- 172.21.15.17:0/438473949 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f816c06be80 0x7f816c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:26.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.383+0000 7f818e453640 1 --2- 172.21.15.17:0/438473949 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f816c06be80 0x7f816c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:26.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.383+0000 7f818e453640 1 --2- 172.21.15.17:0/438473949 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f816c06be80 0x7f816c06e340 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8184009aa0 tx=0x7f8184009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:26.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.386+0000 7f817effd640 1 -- 172.21.15.17:0/438473949 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f81800814c0 con 0x7f8188154b60 2024-09-05T07:29:26.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.400+0000 7f817effd640 1 -- 172.21.15.17:0/438473949 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f818007acd0 con 0x7f8188154b60 2024-09-05T07:29:26.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.610+0000 7f81906b7640 1 -- 172.21.15.17:0/438473949 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81880cbca0 con 0x7f8188154b60 2024-09-05T07:29:26.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.628+0000 7f817effd640 1 -- 172.21.15.17:0/438473949 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5545 (secure 0 0 0) 0x7f818007efd0 con 0x7f8188154b60 2024-09-05T07:29:26.628 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:29:26.628 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":3,"btime":"2024-09-05T07:29:25:820213+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4221,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/1677649004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1677649004},{"type":"v1","addr":"172.21.15.17:6833","nonce":1677649004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/840343339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":840343339},{"type":"v1","addr":"172.21.15.26:6837","nonce":840343339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4233,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6839/914231229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":914231229},{"type":"v1","addr":"172.21.15.26:6839","nonce":914231229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/4100397916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":4100397916},{"type":"v1","addr":"172.21.15.17:6837","nonce":4100397916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2818017162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2818017162},{"type":"v1","addr":"172.21.15.17:6835","nonce":2818017162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4261,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/656329439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":656329439},{"type":"v1","addr":"172.21.15.26:6835","nonce":656329439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-05T07:29:26.630 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 3 2024-09-05T07:29:26.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.629+0000 7f81906b7640 1 -- 172.21.15.17:0/438473949 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f816c06be80 msgr2=0x7f816c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:26.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.629+0000 7f81906b7640 1 --2- 172.21.15.17:0/438473949 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f816c06be80 0x7f816c06e340 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8184009aa0 tx=0x7f8184009190 comp rx=0 tx=0).stop 2024-09-05T07:29:26.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.629+0000 7f81906b7640 1 -- 172.21.15.17:0/438473949 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8188154b60 msgr2=0x7f8188144cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:26.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.629+0000 7f81906b7640 1 --2- 172.21.15.17:0/438473949 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8188154b60 0x7f8188144cd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8180009eb0 tx=0x7f8180004a40 comp rx=0 tx=0).stop 2024-09-05T07:29:26.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.629+0000 7f81906b7640 1 -- 172.21.15.17:0/438473949 shutdown_connections 2024-09-05T07:29:26.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.629+0000 7f81906b7640 1 --2- 172.21.15.17:0/438473949 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f816c06be80 0x7f816c06e340 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:26.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.629+0000 7f81906b7640 1 --2- 172.21.15.17:0/438473949 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f818806c780 0x7f81881f0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:26.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.629+0000 7f81906b7640 1 --2- 172.21.15.17:0/438473949 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8188154b60 0x7f8188144cd0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:26.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.629+0000 7f81906b7640 1 --2- 172.21.15.17:0/438473949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f818806c230 0x7f81880c3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:26.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.629+0000 7f81906b7640 1 -- 172.21.15.17:0/438473949 >> 172.21.15.17:0/438473949 conn(0x7f81880cd440 msgr2=0x7f818806e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:26.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.629+0000 7f81906b7640 1 -- 172.21.15.17:0/438473949 shutdown_connections 2024-09-05T07:29:26.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.629+0000 7f81906b7640 1 -- 172.21.15.17:0/438473949 wait complete. 2024-09-05T07:29:26.641 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-05T07:29:26.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.739+0000 7fecb4e77640 1 Processor -- start 2024-09-05T07:29:26.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.739+0000 7fecb4e77640 1 -- start start 2024-09-05T07:29:26.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.740+0000 7fecb4e77640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fecb0154770 0x7fecb015b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:26.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.740+0000 7fecb4e77640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fecb00c5a80 0x7fecb00c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:26.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.740+0000 7fecb4e77640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecb006c8c0 con 0x7fecb00cafa0 2024-09-05T07:29:26.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.740+0000 7fecb4e77640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fecb00c5310 con 0x7fecb00c5a80 2024-09-05T07:29:26.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.740+0000 7fecb4e77640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fecb00cb950 con 0x7fecb0154770 2024-09-05T07:29:26.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.741+0000 7fecae59c640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fecb0154770 0x7fecb015b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:26.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.741+0000 7fecaed9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fecb00c5a80 0x7fecb00c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:26.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.741+0000 7fecadd9b640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fecb00cafa0 0x7fecb00d05c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.17:35944/0 (socket says 172.21.15.17:35944) 2024-09-05T07:29:26.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.741+0000 7fecadd9b640 1 -- 172.21.15.17:0/3747645653 learned_addr learned my addr 172.21.15.17:0/3747645653 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:29:26.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.743+0000 7fecae59c640 1 -- 172.21.15.17:0/3747645653 >> v2:172.21.15.26:3300/0 conn(0x7fecb00c5a80 msgr2=0x7fecb00c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:26.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.743+0000 7fecae59c640 1 --2- 172.21.15.17:0/3747645653 >> v2:172.21.15.26:3300/0 conn(0x7fecb00c5a80 0x7fecb00c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:26.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.743+0000 7fecae59c640 1 -- 172.21.15.17:0/3747645653 >> v1:172.21.15.26:6789/0 conn(0x7fecb00cafa0 legacy=0x7fecb00d05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:26.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.743+0000 7fecae59c640 1 -- 172.21.15.17:0/3747645653 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecb006cb60 con 0x7fecb0154770 2024-09-05T07:29:26.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.745+0000 7fecae59c640 1 --2- 172.21.15.17:0/3747645653 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fecb0154770 0x7fecb015b240 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fecb00c5490 tx=0x7feca002a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a50df87fdc4988d server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:26.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.750+0000 7fecad59a640 1 -- 172.21.15.17:0/3747645653 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca002ae60 con 0x7fecb0154770 2024-09-05T07:29:26.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.750+0000 7fecad59a640 1 -- 172.21.15.17:0/3747645653 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feca0007740 con 0x7fecb0154770 2024-09-05T07:29:26.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.750+0000 7fecad59a640 1 -- 172.21.15.17:0/3747645653 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca0007b10 con 0x7fecb0154770 2024-09-05T07:29:26.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.750+0000 7fecb4e77640 1 -- 172.21.15.17:0/3747645653 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fecb0154770 msgr2=0x7fecb015b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:26.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.750+0000 7fecb4e77640 1 --2- 172.21.15.17:0/3747645653 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fecb0154770 0x7fecb015b240 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fecb00c5490 tx=0x7feca002a640 comp rx=0 tx=0).stop 2024-09-05T07:29:26.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.750+0000 7fecb4e77640 1 -- 172.21.15.17:0/3747645653 shutdown_connections 2024-09-05T07:29:26.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.750+0000 7fecb4e77640 1 --2- 172.21.15.17:0/3747645653 >> v2:172.21.15.26:3300/0 conn(0x7fecb00c5a80 0x7fecb00c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:26.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.750+0000 7fecb4e77640 1 --2- 172.21.15.17:0/3747645653 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fecb0154770 0x7fecb015b240 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:26.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.750+0000 7fecb4e77640 1 -- 172.21.15.17:0/3747645653 >> 172.21.15.17:0/3747645653 conn(0x7fecb0073710 msgr2=0x7fecb0073b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:26.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.750+0000 7fecb4e77640 1 -- 172.21.15.17:0/3747645653 shutdown_connections 2024-09-05T07:29:26.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.750+0000 7fecb4e77640 1 -- 172.21.15.17:0/3747645653 wait complete. 2024-09-05T07:29:26.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.752+0000 7fecb4e77640 1 Processor -- start 2024-09-05T07:29:26.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.752+0000 7fecb4e77640 1 -- start start 2024-09-05T07:29:26.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.752+0000 7fecb4e77640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fecb00c5a80 0x7fecb00b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:26.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.752+0000 7fecb4e77640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecb00cafa0 0x7fecb01f3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:26.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.752+0000 7fecb4e77640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecb0154770 0x7fecb01f41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:26.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.752+0000 7fecb4e77640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fecb00c6450 con 0x7fecb0154770 2024-09-05T07:29:26.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.752+0000 7fecb4e77640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fecb00cbc30 con 0x7fecb00cafa0 2024-09-05T07:29:26.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.752+0000 7fecb4e77640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fecb0154b50 con 0x7fecb00c5a80 2024-09-05T07:29:26.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.753+0000 7fecaed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecb0154770 0x7fecb01f41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:26.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.753+0000 7fecae59c640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fecb00c5a80 0x7fecb00b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:26.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.753+0000 7fecadd9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecb00cafa0 0x7fecb01f3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:26.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.753+0000 7fecae59c640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fecb00c5a80 0x7fecb00b39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:54832/0 (socket says 172.21.15.17:54832) 2024-09-05T07:29:26.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.753+0000 7fecae59c640 1 -- 172.21.15.17:0/3752948885 learned_addr learned my addr 172.21.15.17:0/3752948885 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:26.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.757+0000 7fecae59c640 1 -- 172.21.15.17:0/3752948885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecb00cafa0 msgr2=0x7fecb01f3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:26.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.757+0000 7fecae59c640 1 --2- 172.21.15.17:0/3752948885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecb00cafa0 0x7fecb01f3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:26.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.757+0000 7fecae59c640 1 -- 172.21.15.17:0/3752948885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecb0154770 msgr2=0x7fecb01f41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:26.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.757+0000 7fecae59c640 1 --2- 172.21.15.17:0/3752948885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecb0154770 0x7fecb01f41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:26.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.757+0000 7fecae59c640 1 -- 172.21.15.17:0/3752948885 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecb014e340 con 0x7fecb00c5a80 2024-09-05T07:29:26.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.759+0000 7fecae59c640 1 --2- 172.21.15.17:0/3752948885 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fecb00c5a80 0x7fecb00b39c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7feca0009e80 tx=0x7feca0004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:26.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.763+0000 7feca6ffd640 1 -- 172.21.15.17:0/3752948885 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca003f070 con 0x7fecb00c5a80 2024-09-05T07:29:26.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.763+0000 7feca6ffd640 1 -- 172.21.15.17:0/3752948885 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feca002ae60 con 0x7fecb00c5a80 2024-09-05T07:29:26.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.763+0000 7fecb4e77640 1 -- 172.21.15.17:0/3752948885 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecb01f37c0 con 0x7fecb00c5a80 2024-09-05T07:29:26.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.763+0000 7feca6ffd640 1 -- 172.21.15.17:0/3752948885 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca0007e20 con 0x7fecb00c5a80 2024-09-05T07:29:26.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.763+0000 7fecb4e77640 1 -- 172.21.15.17:0/3752948885 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fecb014a690 con 0x7fecb00c5a80 2024-09-05T07:29:26.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:26.764+0000 7fecb4e77640 1 -- 172.21.15.17:0/3752948885 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecb006bca0 con 0x7fecb00c5a80 2024-09-05T07:29:27.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.036+0000 7feca6ffd640 1 -- 172.21.15.17:0/3752948885 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feca0043410 con 0x7fecb00c5a80 2024-09-05T07:29:27.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.036+0000 7feca6ffd640 1 --2- 172.21.15.17:0/3752948885 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fec9006beb0 0x7fec9006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:27.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.037+0000 7fecadd9b640 1 --2- 172.21.15.17:0/3752948885 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fec9006beb0 0x7fec9006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:27.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.037+0000 7fecadd9b640 1 --2- 172.21.15.17:0/3752948885 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fec9006beb0 0x7fec9006e370 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fecb014a1c0 tx=0x7fec98007e80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:27.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.040+0000 7feca6ffd640 1 -- 172.21.15.17:0/3752948885 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7feca0080ee0 con 0x7fecb00c5a80 2024-09-05T07:29:27.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.054+0000 7feca6ffd640 1 -- 172.21.15.17:0/3752948885 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feca007a6f0 con 0x7fecb00c5a80 2024-09-05T07:29:27.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.231+0000 7fecb4e77640 1 -- 172.21.15.17:0/3752948885 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fecb00ca6c0 con 0x7fecb00c5a80 2024-09-05T07:29:27.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.271+0000 7feca6ffd640 1 -- 172.21.15.17:0/3752948885 <== mon.2 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7feca007e9f0 con 0x7fecb00c5a80 2024-09-05T07:29:27.271 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:29:27.271 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2024-09-05T07:29:27.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-05T07:29:27.271 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2024-09-05T07:29:27.271 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2024-09-05T07:29:27.271 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-05T07:29:27.271 INFO:teuthology.orchestra.run.smithi017.stdout:] 2024-09-05T07:29:27.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.272+0000 7fecb4e77640 1 -- 172.21.15.17:0/3752948885 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fec9006beb0 msgr2=0x7fec9006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:27.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.272+0000 7fecb4e77640 1 --2- 172.21.15.17:0/3752948885 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fec9006beb0 0x7fec9006e370 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fecb014a1c0 tx=0x7fec98007e80 comp rx=0 tx=0).stop 2024-09-05T07:29:27.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.272+0000 7fecb4e77640 1 -- 172.21.15.17:0/3752948885 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fecb00c5a80 msgr2=0x7fecb00b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:27.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.272+0000 7fecb4e77640 1 --2- 172.21.15.17:0/3752948885 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fecb00c5a80 0x7fecb00b39c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7feca0009e80 tx=0x7feca0004a40 comp rx=0 tx=0).stop 2024-09-05T07:29:27.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.272+0000 7fecb4e77640 1 -- 172.21.15.17:0/3752948885 shutdown_connections 2024-09-05T07:29:27.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.272+0000 7fecb4e77640 1 --2- 172.21.15.17:0/3752948885 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fec9006beb0 0x7fec9006e370 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:27.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.272+0000 7fecb4e77640 1 --2- 172.21.15.17:0/3752948885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecb0154770 0x7fecb01f41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:27.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.272+0000 7fecb4e77640 1 --2- 172.21.15.17:0/3752948885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecb00cafa0 0x7fecb01f3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:27.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.272+0000 7fecb4e77640 1 --2- 172.21.15.17:0/3752948885 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fecb00c5a80 0x7fecb00b39c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:27.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.272+0000 7fecb4e77640 1 -- 172.21.15.17:0/3752948885 >> 172.21.15.17:0/3752948885 conn(0x7fecb0073710 msgr2=0x7fecb0159010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:27.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.273+0000 7fecb4e77640 1 -- 172.21.15.17:0/3752948885 shutdown_connections 2024-09-05T07:29:27.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.273+0000 7fecb4e77640 1 -- 172.21.15.17:0/3752948885 wait complete. 2024-09-05T07:29:27.283 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-05T07:29:27.283 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-05T07:29:27.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.387+0000 7f7799c42640 1 Processor -- start 2024-09-05T07:29:27.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.387+0000 7f7799c42640 1 -- start start 2024-09-05T07:29:27.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.388+0000 7f7799c42640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779415c840 0x7f77940ca500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:27.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.388+0000 7f7799c42640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77941590e0 con 0x7f7794152aa0 2024-09-05T07:29:27.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.388+0000 7f7799c42640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77941593c0 con 0x7f7794070130 2024-09-05T07:29:27.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.388+0000 7f7799c42640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f77940caa40 con 0x7f779415c840 2024-09-05T07:29:27.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.388+0000 7f7793fff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779415c840 0x7f77940ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:27.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.388+0000 7f7792ffd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7794070130 0x7f779415c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.17:35948/0 (socket says 172.21.15.17:35948) 2024-09-05T07:29:27.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.388+0000 7f7792ffd640 1 -- 172.21.15.17:0/466225930 learned_addr learned my addr 172.21.15.17:0/466225930 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:29:27.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.390+0000 7f77927fc640 1 -- 172.21.15.17:0/466225930 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 359154898 0 0) 0x7f77941593c0 con 0x7f7794070130 2024-09-05T07:29:27.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.390+0000 7f77927fc640 1 -- 172.21.15.17:0/466225930 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f777c003520 con 0x7f7794070130 2024-09-05T07:29:27.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.391+0000 7f7793fff640 1 -- 172.21.15.17:0/466225930 >> v1:172.21.15.26:6789/0 conn(0x7f7794070130 legacy=0x7f779415c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:27.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.391+0000 7f7793fff640 1 -- 172.21.15.17:0/466225930 >> v1:172.21.15.17:6789/0 conn(0x7f7794152aa0 legacy=0x7f77940cb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:27.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.391+0000 7f7793fff640 1 -- 172.21.15.17:0/466225930 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77940c9550 con 0x7f779415c840 2024-09-05T07:29:27.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.393+0000 7f7793fff640 1 --2- 172.21.15.17:0/466225930 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779415c840 0x7f77940ca500 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f778c009dc0 tx=0x7f778c02a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=445bc6c4393f0d5f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:27.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.396+0000 7f77927fc640 1 -- 172.21.15.17:0/466225930 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c007740 con 0x7f779415c840 2024-09-05T07:29:27.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.396+0000 7f77927fc640 1 -- 172.21.15.17:0/466225930 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f778c0078e0 con 0x7f779415c840 2024-09-05T07:29:27.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.396+0000 7f77927fc640 1 -- 172.21.15.17:0/466225930 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c007cb0 con 0x7f779415c840 2024-09-05T07:29:27.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.397+0000 7f7799c42640 1 -- 172.21.15.17:0/466225930 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779415c840 msgr2=0x7f77940ca500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:27.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.397+0000 7f7799c42640 1 --2- 172.21.15.17:0/466225930 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779415c840 0x7f77940ca500 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f778c009dc0 tx=0x7f778c02a6d0 comp rx=0 tx=0).stop 2024-09-05T07:29:27.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.397+0000 7f7799c42640 1 -- 172.21.15.17:0/466225930 shutdown_connections 2024-09-05T07:29:27.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.397+0000 7f7799c42640 1 --2- 172.21.15.17:0/466225930 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779415c840 0x7f77940ca500 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:27.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.397+0000 7f7799c42640 1 -- 172.21.15.17:0/466225930 >> 172.21.15.17:0/466225930 conn(0x7f7794071670 msgr2=0x7f7794071a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:27.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.397+0000 7f7799c42640 1 -- 172.21.15.17:0/466225930 shutdown_connections 2024-09-05T07:29:27.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.397+0000 7f7799c42640 1 -- 172.21.15.17:0/466225930 wait complete. 2024-09-05T07:29:27.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.398+0000 7f7799c42640 1 Processor -- start 2024-09-05T07:29:27.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.398+0000 7f7799c42640 1 -- start start 2024-09-05T07:29:27.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.399+0000 7f7799c42640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7794070130 0x7f77941e1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:27.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.399+0000 7f7799c42640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7794152aa0 0x7f77941577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:27.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.399+0000 7f7799c42640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779415c840 0x7f7794157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:27.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.399+0000 7f7799c42640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f77940c8d60 con 0x7f7794070130 2024-09-05T07:29:27.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.399+0000 7f7799c42640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f77940c9300 con 0x7f7794152aa0 2024-09-05T07:29:27.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.399+0000 7f7799c42640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f77940c8ee0 con 0x7f779415c840 2024-09-05T07:29:27.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.399+0000 7f7793fff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779415c840 0x7f7794157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:27.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.400+0000 7f7793fff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779415c840 0x7f7794157ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:54842/0 (socket says 172.21.15.17:54842) 2024-09-05T07:29:27.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.400+0000 7f7793fff640 1 -- 172.21.15.17:0/1158386964 learned_addr learned my addr 172.21.15.17:0/1158386964 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:27.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.400+0000 7f7792ffd640 1 --2- 172.21.15.17:0/1158386964 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7794152aa0 0x7f77941577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:27.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.401+0000 7f77937fe640 1 --2- 172.21.15.17:0/1158386964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7794070130 0x7f77941e1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:27.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.404+0000 7f7792ffd640 1 -- 172.21.15.17:0/1158386964 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779415c840 msgr2=0x7f7794157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:27.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.404+0000 7f7792ffd640 1 --2- 172.21.15.17:0/1158386964 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779415c840 0x7f7794157ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:27.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.404+0000 7f7792ffd640 1 -- 172.21.15.17:0/1158386964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7794070130 msgr2=0x7f77941e1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:27.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.404+0000 7f7792ffd640 1 --2- 172.21.15.17:0/1158386964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7794070130 0x7f77941e1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:27.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.404+0000 7f7792ffd640 1 -- 172.21.15.17:0/1158386964 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7794156220 con 0x7f7794152aa0 2024-09-05T07:29:27.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.407+0000 7f7792ffd640 1 --2- 172.21.15.17:0/1158386964 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7794152aa0 0x7f77941577a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f778800c3c0 tx=0x7f7788001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:27.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.414+0000 7f777bfff640 1 -- 172.21.15.17:0/1158386964 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7788017070 con 0x7f7794152aa0 2024-09-05T07:29:27.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.414+0000 7f777bfff640 1 -- 172.21.15.17:0/1158386964 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7788005ce0 con 0x7f7794152aa0 2024-09-05T07:29:27.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.414+0000 7f777bfff640 1 -- 172.21.15.17:0/1158386964 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7788007310 con 0x7f7794152aa0 2024-09-05T07:29:27.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.414+0000 7f7799c42640 1 -- 172.21.15.17:0/1158386964 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77941f1280 con 0x7f7794152aa0 2024-09-05T07:29:27.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.414+0000 7f7799c42640 1 -- 172.21.15.17:0/1158386964 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7794156cc0 con 0x7f7794152aa0 2024-09-05T07:29:27.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.415+0000 7f7799c42640 1 -- 172.21.15.17:0/1158386964 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77940c90e0 con 0x7f7794152aa0 2024-09-05T07:29:27.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.689+0000 7f777bfff640 1 -- 172.21.15.17:0/1158386964 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f778801a070 con 0x7f7794152aa0 2024-09-05T07:29:27.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.690+0000 7f777bfff640 1 --2- 172.21.15.17:0/1158386964 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f778006be60 0x7f778006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:27.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.690+0000 7f77937fe640 1 --2- 172.21.15.17:0/1158386964 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f778006be60 0x7f778006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:27.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.690+0000 7f77937fe640 1 --2- 172.21.15.17:0/1158386964 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f778006be60 0x7f778006e320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7784000f60 tx=0x7f7784009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:27.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.693+0000 7f777bfff640 1 -- 172.21.15.17:0/1158386964 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f778805f040 con 0x7f7794152aa0 2024-09-05T07:29:27.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.712+0000 7f777bfff640 1 -- 172.21.15.17:0/1158386964 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7788021020 con 0x7f7794152aa0 2024-09-05T07:29:27.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:27.890+0000 7f7799c42640 1 -- 172.21.15.17:0/1158386964 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f77940ca500 con 0x7f7794152aa0 2024-09-05T07:29:28.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.403+0000 7f777bfff640 1 -- 172.21.15.17:0/1158386964 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7f7788058850 con 0x7f7794152aa0 2024-09-05T07:29:28.404 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2024-09-05T07:29:28.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.406+0000 7f7799c42640 1 -- 172.21.15.17:0/1158386964 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f778006be60 msgr2=0x7f778006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:28.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.406+0000 7f7799c42640 1 --2- 172.21.15.17:0/1158386964 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f778006be60 0x7f778006e320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7784000f60 tx=0x7f7784009040 comp rx=0 tx=0).stop 2024-09-05T07:29:28.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.406+0000 7f7799c42640 1 -- 172.21.15.17:0/1158386964 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7794152aa0 msgr2=0x7f77941577a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:28.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.406+0000 7f7799c42640 1 --2- 172.21.15.17:0/1158386964 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7794152aa0 0x7f77941577a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f778800c3c0 tx=0x7f7788001e70 comp rx=0 tx=0).stop 2024-09-05T07:29:28.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.406+0000 7f7799c42640 1 -- 172.21.15.17:0/1158386964 shutdown_connections 2024-09-05T07:29:28.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.406+0000 7f7799c42640 1 --2- 172.21.15.17:0/1158386964 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f778006be60 0x7f778006e320 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:28.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.406+0000 7f7799c42640 1 --2- 172.21.15.17:0/1158386964 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f779415c840 0x7f7794157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:28.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.406+0000 7f7799c42640 1 --2- 172.21.15.17:0/1158386964 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7794152aa0 0x7f77941577a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:28.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.406+0000 7f7799c42640 1 --2- 172.21.15.17:0/1158386964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7794070130 0x7f77941e1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:28.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.406+0000 7f7799c42640 1 -- 172.21.15.17:0/1158386964 >> 172.21.15.17:0/1158386964 conn(0x7f7794071670 msgr2=0x7f7794071a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:28.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.407+0000 7f7799c42640 1 -- 172.21.15.17:0/1158386964 shutdown_connections 2024-09-05T07:29:28.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.407+0000 7f7799c42640 1 -- 172.21.15.17:0/1158386964 wait complete. 2024-09-05T07:29:28.418 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-05T07:29:28.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.525+0000 7f31a389b640 1 Processor -- start 2024-09-05T07:29:28.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.526+0000 7f31a389b640 1 -- start start 2024-09-05T07:29:28.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.526+0000 7f31a389b640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f319c0ccef0 0x7f319c0b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:28.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.526+0000 7f31a389b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f319c0b43b0 0x7f319c157800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:28.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.526+0000 7f31a389b640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f319c0b3b20 con 0x7f319c0cd2d0 2024-09-05T07:29:28.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.526+0000 7f31a389b640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f319c15b590 con 0x7f319c0b43b0 2024-09-05T07:29:28.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.526+0000 7f31a389b640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f319c0b2d60 con 0x7f319c0ccef0 2024-09-05T07:29:28.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.527+0000 7f31a0e36640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f319c0b43b0 0x7f319c157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:28.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.527+0000 7f31a1637640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f319c0ccef0 0x7f319c0b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:28.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.527+0000 7f31a0e36640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f319c0b43b0 0x7f319c157800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44108/0 (socket says 172.21.15.17:44108) 2024-09-05T07:29:28.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.527+0000 7f31a0e36640 1 -- 172.21.15.17:0/3317826098 learned_addr learned my addr 172.21.15.17:0/3317826098 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:28.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.530+0000 7f31a1637640 1 -- 172.21.15.17:0/3317826098 >> v2:172.21.15.17:3300/0 conn(0x7f319c0b43b0 msgr2=0x7f319c157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:28.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.530+0000 7f31a1637640 1 --2- 172.21.15.17:0/3317826098 >> v2:172.21.15.17:3300/0 conn(0x7f319c0b43b0 0x7f319c157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:28.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.530+0000 7f31a1637640 1 -- 172.21.15.17:0/3317826098 >> v1:172.21.15.17:6789/0 conn(0x7f319c0cd2d0 legacy=0x7f319c157d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:28.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.530+0000 7f31a1637640 1 -- 172.21.15.17:0/3317826098 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f319c0b3040 con 0x7f319c0ccef0 2024-09-05T07:29:28.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.532+0000 7f31a1637640 1 --2- 172.21.15.17:0/3317826098 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f319c0ccef0 0x7f319c0b3e70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f318c009d90 tx=0x7f318c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f7e55a8805ac0a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:28.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.535+0000 7f319bfff640 1 -- 172.21.15.17:0/3317826098 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318c007740 con 0x7f319c0ccef0 2024-09-05T07:29:28.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.535+0000 7f319bfff640 1 -- 172.21.15.17:0/3317826098 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f318c0078e0 con 0x7f319c0ccef0 2024-09-05T07:29:28.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.535+0000 7f319bfff640 1 -- 172.21.15.17:0/3317826098 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318c007cb0 con 0x7f319c0ccef0 2024-09-05T07:29:28.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.536+0000 7f31a389b640 1 -- 172.21.15.17:0/3317826098 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f319c0ccef0 msgr2=0x7f319c0b3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:28.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.536+0000 7f31a389b640 1 --2- 172.21.15.17:0/3317826098 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f319c0ccef0 0x7f319c0b3e70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f318c009d90 tx=0x7f318c02a660 comp rx=0 tx=0).stop 2024-09-05T07:29:28.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.536+0000 7f31a389b640 1 -- 172.21.15.17:0/3317826098 shutdown_connections 2024-09-05T07:29:28.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.536+0000 7f31a389b640 1 --2- 172.21.15.17:0/3317826098 >> v2:172.21.15.17:3300/0 conn(0x7f319c0b43b0 0x7f319c157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:28.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.536+0000 7f31a389b640 1 --2- 172.21.15.17:0/3317826098 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f319c0ccef0 0x7f319c0b3e70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:28.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.536+0000 7f31a389b640 1 -- 172.21.15.17:0/3317826098 >> 172.21.15.17:0/3317826098 conn(0x7f319c072230 msgr2=0x7f319c072640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:28.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.536+0000 7f31a389b640 1 -- 172.21.15.17:0/3317826098 shutdown_connections 2024-09-05T07:29:28.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.536+0000 7f31a389b640 1 -- 172.21.15.17:0/3317826098 wait complete. 2024-09-05T07:29:28.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.537+0000 7f31a389b640 1 Processor -- start 2024-09-05T07:29:28.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.537+0000 7f31a389b640 1 -- start start 2024-09-05T07:29:28.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.538+0000 7f31a389b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f319c0b43b0 0x7f319c1f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:28.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.538+0000 7f31a389b640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f319c0ccef0 0x7f319c0c4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:28.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.538+0000 7f31a389b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f319c0cd2d0 0x7f319c0c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:28.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.538+0000 7f31a389b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f319c15dee0 con 0x7f319c0cd2d0 2024-09-05T07:29:28.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.538+0000 7f31a389b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f319c0b3600 con 0x7f319c0b43b0 2024-09-05T07:29:28.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.538+0000 7f31a389b640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f319c15e060 con 0x7f319c0ccef0 2024-09-05T07:29:28.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.538+0000 7f31a1e38640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f319c0cd2d0 0x7f319c0c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:28.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.538+0000 7f31a0e36640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f319c0ccef0 0x7f319c0c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:28.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.539+0000 7f31a1637640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f319c0b43b0 0x7f319c1f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:28.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.539+0000 7f31a1e38640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f319c0cd2d0 0x7f319c0c5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44116/0 (socket says 172.21.15.17:44116) 2024-09-05T07:29:28.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.539+0000 7f31a1e38640 1 -- 172.21.15.17:0/1024656001 learned_addr learned my addr 172.21.15.17:0/1024656001 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:28.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.539+0000 7f31a0e36640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f319c0ccef0 0x7f319c0c4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:54852/0 (socket says 172.21.15.17:54852) 2024-09-05T07:29:28.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.542+0000 7f31a1e38640 1 -- 172.21.15.17:0/1024656001 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f319c0ccef0 msgr2=0x7f319c0c4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:28.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.542+0000 7f31a1e38640 1 --2- 172.21.15.17:0/1024656001 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f319c0ccef0 0x7f319c0c4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:28.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.542+0000 7f31a1e38640 1 -- 172.21.15.17:0/1024656001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f319c0b43b0 msgr2=0x7f319c1f3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:28.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.542+0000 7f31a1e38640 1 --2- 172.21.15.17:0/1024656001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f319c0b43b0 0x7f319c1f3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:28.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.542+0000 7f31a1e38640 1 -- 172.21.15.17:0/1024656001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f319c0c98c0 con 0x7f319c0cd2d0 2024-09-05T07:29:28.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.544+0000 7f31a1e38640 1 --2- 172.21.15.17:0/1024656001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f319c0cd2d0 0x7f319c0c5430 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f319400c3c0 tx=0x7f319400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:28.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.546+0000 7f3199ffb640 1 -- 172.21.15.17:0/1024656001 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3194017070 con 0x7f319c0cd2d0 2024-09-05T07:29:28.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.546+0000 7f31a389b640 1 -- 172.21.15.17:0/1024656001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f319c0c9b80 con 0x7f319c0cd2d0 2024-09-05T07:29:28.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.547+0000 7f31a389b640 1 -- 172.21.15.17:0/1024656001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f319c0c4c30 con 0x7f319c0cd2d0 2024-09-05T07:29:28.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.548+0000 7f31a389b640 1 -- 172.21.15.17:0/1024656001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f319c0b3e70 con 0x7f319c0cd2d0 2024-09-05T07:29:28.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.548+0000 7f3199ffb640 1 -- 172.21.15.17:0/1024656001 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31940052d0 con 0x7f319c0cd2d0 2024-09-05T07:29:28.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.548+0000 7f3199ffb640 1 -- 172.21.15.17:0/1024656001 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3194007250 con 0x7f319c0cd2d0 2024-09-05T07:29:28.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.568+0000 7f3199ffb640 1 -- 172.21.15.17:0/1024656001 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f319401a070 con 0x7f319c0cd2d0 2024-09-05T07:29:28.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.568+0000 7f3199ffb640 1 --2- 172.21.15.17:0/1024656001 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f318806be30 0x7f318806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:28.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.569+0000 7f31a1637640 1 --2- 172.21.15.17:0/1024656001 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f318806be30 0x7f318806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:28.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.569+0000 7f31a1637640 1 --2- 172.21.15.17:0/1024656001 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f318806be30 0x7f318806e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f318c034000 tx=0x7f318c02f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:28.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.853+0000 7f3199ffb640 1 -- 172.21.15.17:0/1024656001 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7f3194056910 con 0x7f319c0cd2d0 2024-09-05T07:29:28.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:28.853+0000 7f3199ffb640 1 -- 172.21.15.17:0/1024656001 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3194021020 con 0x7f319c0cd2d0 2024-09-05T07:29:29.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.032+0000 7f31a389b640 1 -- 172.21.15.17:0/1024656001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f319c0c6f40 con 0x7f319c0cd2d0 2024-09-05T07:29:29.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.447+0000 7f3199ffb640 1 -- 172.21.15.17:0/1024656001 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) ==== 170+0+0 (secure 0 0 0) 0x7f3194058870 con 0x7f319c0cd2d0 2024-09-05T07:29:29.448 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2024-09-05T07:29:29.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.449+0000 7f31a389b640 1 -- 172.21.15.17:0/1024656001 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f318806be30 msgr2=0x7f318806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:29.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.449+0000 7f31a389b640 1 --2- 172.21.15.17:0/1024656001 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f318806be30 0x7f318806e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f318c034000 tx=0x7f318c02f000 comp rx=0 tx=0).stop 2024-09-05T07:29:29.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.449+0000 7f31a389b640 1 -- 172.21.15.17:0/1024656001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f319c0cd2d0 msgr2=0x7f319c0c5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:29.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.449+0000 7f31a389b640 1 --2- 172.21.15.17:0/1024656001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f319c0cd2d0 0x7f319c0c5430 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f319400c3c0 tx=0x7f319400c880 comp rx=0 tx=0).stop 2024-09-05T07:29:29.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.449+0000 7f31a389b640 1 -- 172.21.15.17:0/1024656001 shutdown_connections 2024-09-05T07:29:29.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.449+0000 7f31a389b640 1 --2- 172.21.15.17:0/1024656001 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f318806be30 0x7f318806e2f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:29.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.449+0000 7f31a389b640 1 --2- 172.21.15.17:0/1024656001 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f319c0ccef0 0x7f319c0c4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:29.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.449+0000 7f31a389b640 1 --2- 172.21.15.17:0/1024656001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f319c0cd2d0 0x7f319c0c5430 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:29.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.449+0000 7f31a389b640 1 --2- 172.21.15.17:0/1024656001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f319c0b43b0 0x7f319c1f3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:29.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.449+0000 7f31a389b640 1 -- 172.21.15.17:0/1024656001 >> 172.21.15.17:0/1024656001 conn(0x7f319c072230 msgr2=0x7f319c156920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:29.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.449+0000 7f31a389b640 1 -- 172.21.15.17:0/1024656001 shutdown_connections 2024-09-05T07:29:29.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.449+0000 7f31a389b640 1 -- 172.21.15.17:0/1024656001 wait complete. 2024-09-05T07:29:29.461 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-05T07:29:29.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.576+0000 7f0da56ba640 1 Processor -- start 2024-09-05T07:29:29.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.576+0000 7f0da56ba640 1 -- start start 2024-09-05T07:29:29.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.576+0000 7f0da56ba640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0da0151ac0 0x7f0da00c8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:29.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.576+0000 7f0da56ba640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0da00705b0 0x7f0da00c8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:29.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.576+0000 7f0da56ba640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0da015bd10 con 0x7f0da01516e0 2024-09-05T07:29:29.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.576+0000 7f0da56ba640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f0da00c5670 con 0x7f0da00705b0 2024-09-05T07:29:29.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.576+0000 7f0da56ba640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f0da015aeb0 con 0x7f0da0151ac0 2024-09-05T07:29:29.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.588+0000 7f0d9f7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0da00705b0 0x7f0da00c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:29.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.588+0000 7f0d9effd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f0da01516e0 0x7f0da00c3d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54122/0 (socket says 172.21.15.17:54122) 2024-09-05T07:29:29.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.588+0000 7f0d9effd640 1 -- 172.21.15.17:0/1932407456 learned_addr learned my addr 172.21.15.17:0/1932407456 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:29:29.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.594+0000 7f0d9f7fe640 1 -- 172.21.15.17:0/1932407456 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0da0151ac0 msgr2=0x7f0da00c8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:29.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.594+0000 7f0d9f7fe640 1 --2- 172.21.15.17:0/1932407456 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0da0151ac0 0x7f0da00c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:29.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.594+0000 7f0d9f7fe640 1 -- 172.21.15.17:0/1932407456 >> v1:172.21.15.17:6789/0 conn(0x7f0da01516e0 legacy=0x7f0da00c3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:29.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.594+0000 7f0d9f7fe640 1 -- 172.21.15.17:0/1932407456 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0da015b190 con 0x7f0da00705b0 2024-09-05T07:29:29.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.609+0000 7f0d9f7fe640 1 --2- 172.21.15.17:0/1932407456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0da00705b0 0x7f0da00c8880 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0d98009d90 tx=0x7f0d9802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f01f18ef53d0d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:29.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.686+0000 7f0d9dffb640 1 -- 172.21.15.17:0/1932407456 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d98007740 con 0x7f0da00705b0 2024-09-05T07:29:29.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.686+0000 7f0d9dffb640 1 -- 172.21.15.17:0/1932407456 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d980078e0 con 0x7f0da00705b0 2024-09-05T07:29:29.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.686+0000 7f0d9dffb640 1 -- 172.21.15.17:0/1932407456 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d98007cb0 con 0x7f0da00705b0 2024-09-05T07:29:29.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.686+0000 7f0da56ba640 1 -- 172.21.15.17:0/1932407456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0da00705b0 msgr2=0x7f0da00c8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:29.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.686+0000 7f0da56ba640 1 --2- 172.21.15.17:0/1932407456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0da00705b0 0x7f0da00c8880 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0d98009d90 tx=0x7f0d9802a680 comp rx=0 tx=0).stop 2024-09-05T07:29:29.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.686+0000 7f0da56ba640 1 -- 172.21.15.17:0/1932407456 shutdown_connections 2024-09-05T07:29:29.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.686+0000 7f0da56ba640 1 --2- 172.21.15.17:0/1932407456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0da00705b0 0x7f0da00c8880 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:29.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.686+0000 7f0da56ba640 1 --2- 172.21.15.17:0/1932407456 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0da0151ac0 0x7f0da00c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:29.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.686+0000 7f0da56ba640 1 -- 172.21.15.17:0/1932407456 >> 172.21.15.17:0/1932407456 conn(0x7f0da006fac0 msgr2=0x7f0da006fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:29.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.687+0000 7f0da56ba640 1 -- 172.21.15.17:0/1932407456 shutdown_connections 2024-09-05T07:29:29.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.687+0000 7f0da56ba640 1 -- 172.21.15.17:0/1932407456 wait complete. 2024-09-05T07:29:29.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.688+0000 7f0da56ba640 1 Processor -- start 2024-09-05T07:29:29.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.688+0000 7f0da56ba640 1 -- start start 2024-09-05T07:29:29.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.689+0000 7f0da56ba640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0da00705b0 0x7f0da014e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:29.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.689+0000 7f0da56ba640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0da01516e0 0x7f0da01f0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:29.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.689+0000 7f0da56ba640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0da0151ac0 0x7f0da01f13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:29.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.689+0000 7f0da56ba640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0da015ba30 con 0x7f0da00705b0 2024-09-05T07:29:29.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.689+0000 7f0da56ba640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f0da015b750 con 0x7f0da0151ac0 2024-09-05T07:29:29.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.689+0000 7f0da56ba640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f0da006f5f0 con 0x7f0da01516e0 2024-09-05T07:29:29.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.689+0000 7f0d9e7fc640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0da01516e0 0x7f0da01f0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:29.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.689+0000 7f0d9f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0da0151ac0 0x7f0da01f13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:29.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.689+0000 7f0d9e7fc640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0da01516e0 0x7f0da01f0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:58744/0 (socket says 172.21.15.17:58744) 2024-09-05T07:29:29.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.689+0000 7f0d9e7fc640 1 -- 172.21.15.17:0/1818728118 learned_addr learned my addr 172.21.15.17:0/1818728118 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:29.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.693+0000 7f0d9e7fc640 1 -- 172.21.15.17:0/1818728118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0da0151ac0 msgr2=0x7f0da01f13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:29.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.693+0000 7f0d9e7fc640 1 --2- 172.21.15.17:0/1818728118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0da0151ac0 0x7f0da01f13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:29.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.693+0000 7f0d9e7fc640 1 -- 172.21.15.17:0/1818728118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0da00705b0 msgr2=0x7f0da014e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:29.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.693+0000 7f0d9e7fc640 1 --2- 172.21.15.17:0/1818728118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0da00705b0 0x7f0da014e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:29.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.693+0000 7f0d9e7fc640 1 -- 172.21.15.17:0/1818728118 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0da01f4c30 con 0x7f0da01516e0 2024-09-05T07:29:29.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.693+0000 7f0d9f7fe640 1 --2- 172.21.15.17:0/1818728118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0da0151ac0 0x7f0da01f13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:29:29.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.697+0000 7f0d9e7fc640 1 --2- 172.21.15.17:0/1818728118 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0da01516e0 0x7f0da01f0ea0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0d9400b440 tx=0x7f0d94009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:29.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.727+0000 7f0d877fe640 1 -- 172.21.15.17:0/1818728118 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d94015020 con 0x7f0da01516e0 2024-09-05T07:29:29.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.727+0000 7f0d877fe640 1 -- 172.21.15.17:0/1818728118 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d94011830 con 0x7f0da01516e0 2024-09-05T07:29:29.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.727+0000 7f0d877fe640 1 -- 172.21.15.17:0/1818728118 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d94011c20 con 0x7f0da01516e0 2024-09-05T07:29:29.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.727+0000 7f0da56ba640 1 -- 172.21.15.17:0/1818728118 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0da01f40b0 con 0x7f0da01516e0 2024-09-05T07:29:29.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.727+0000 7f0da56ba640 1 -- 172.21.15.17:0/1818728118 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0da01f4670 con 0x7f0da01516e0 2024-09-05T07:29:29.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:29.728+0000 7f0da56ba640 1 -- 172.21.15.17:0/1818728118 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0da014f310 con 0x7f0da01516e0 2024-09-05T07:29:30.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.003+0000 7f0d877fe640 1 -- 172.21.15.17:0/1818728118 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0d94018020 con 0x7f0da01516e0 2024-09-05T07:29:30.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.004+0000 7f0d877fe640 1 --2- 172.21.15.17:0/1818728118 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f0d8c06be80 0x7f0d8c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:30.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.004+0000 7f0d9effd640 1 --2- 172.21.15.17:0/1818728118 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f0d8c06be80 0x7f0d8c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:30.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.004+0000 7f0d9effd640 1 --2- 172.21.15.17:0/1818728118 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f0d8c06be80 0x7f0d8c06e340 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0d90000f60 tx=0x7f0d90007a80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:30.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.006+0000 7f0d877fe640 1 -- 172.21.15.17:0/1818728118 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5609+0+0 (secure 0 0 0) 0x7f0d94057600 con 0x7f0da01516e0 2024-09-05T07:29:30.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.017+0000 7f0d877fe640 1 -- 172.21.15.17:0/1818728118 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0da014f310 con 0x7f0da01516e0 2024-09-05T07:29:30.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.228+0000 7f0da56ba640 1 -- 172.21.15.17:0/1818728118 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f0da00c3d30 con 0x7f0da01516e0 2024-09-05T07:29:30.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.874+0000 7f0d877fe640 1 -- 172.21.15.17:0/1818728118 <== mon.2 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f0d9401f020 con 0x7f0da01516e0 2024-09-05T07:29:30.874 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 2 and data pool 3 2024-09-05T07:29:30.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.876+0000 7f0da56ba640 1 -- 172.21.15.17:0/1818728118 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f0d8c06be80 msgr2=0x7f0d8c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:30.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.876+0000 7f0da56ba640 1 --2- 172.21.15.17:0/1818728118 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f0d8c06be80 0x7f0d8c06e340 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0d90000f60 tx=0x7f0d90007a80 comp rx=0 tx=0).stop 2024-09-05T07:29:30.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.876+0000 7f0da56ba640 1 -- 172.21.15.17:0/1818728118 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0da01516e0 msgr2=0x7f0da01f0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:30.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.876+0000 7f0da56ba640 1 --2- 172.21.15.17:0/1818728118 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0da01516e0 0x7f0da01f0ea0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0d9400b440 tx=0x7f0d94009f90 comp rx=0 tx=0).stop 2024-09-05T07:29:30.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.876+0000 7f0da56ba640 1 -- 172.21.15.17:0/1818728118 shutdown_connections 2024-09-05T07:29:30.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.876+0000 7f0da56ba640 1 --2- 172.21.15.17:0/1818728118 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f0d8c06be80 0x7f0d8c06e340 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:30.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.876+0000 7f0da56ba640 1 --2- 172.21.15.17:0/1818728118 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0da01516e0 0x7f0da01f0ea0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:30.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.876+0000 7f0da56ba640 1 --2- 172.21.15.17:0/1818728118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0da0151ac0 0x7f0da01f13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:30.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.876+0000 7f0da56ba640 1 --2- 172.21.15.17:0/1818728118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0da00705b0 0x7f0da014e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:30.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.876+0000 7f0da56ba640 1 -- 172.21.15.17:0/1818728118 >> 172.21.15.17:0/1818728118 conn(0x7f0da006fac0 msgr2=0x7f0da014f730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:30.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.876+0000 7f0da56ba640 1 -- 172.21.15.17:0/1818728118 shutdown_connections 2024-09-05T07:29:30.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.876+0000 7f0da56ba640 1 -- 172.21.15.17:0/1818728118 wait complete. 2024-09-05T07:29:30.887 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-05T07:29:30.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.989+0000 7f515bc53640 1 Processor -- start 2024-09-05T07:29:30.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.989+0000 7f515bc53640 1 -- start start 2024-09-05T07:29:30.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.990+0000 7f515bc53640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f51540b0df0 0x7f5154070bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:30.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.990+0000 7f515bc53640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f515406fe20 0x7f51540702b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:30.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.990+0000 7f515bc53640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51540c50b0 con 0x7f5154152b10 2024-09-05T07:29:30.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.990+0000 7f515bc53640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f51540c4e60 con 0x7f515406fe20 2024-09-05T07:29:30.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.990+0000 7f515bc53640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f515415cc00 con 0x7f51540b0df0 2024-09-05T07:29:30.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.991+0000 7f51599ef640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5154152b10 0x7f515415c4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.17:35176/0 (socket says 172.21.15.17:35176) 2024-09-05T07:29:30.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.991+0000 7f51599ef640 1 -- 172.21.15.17:0/2426663691 learned_addr learned my addr 172.21.15.17:0/2426663691 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:29:30.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.991+0000 7f51591ee640 1 --2- 172.21.15.17:0/2426663691 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f51540b0df0 0x7f5154070bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:30.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.993+0000 7f51589ed640 1 -- 172.21.15.17:0/2426663691 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 603607382 0 0) 0x7f51540c50b0 con 0x7f5154152b10 2024-09-05T07:29:30.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.993+0000 7f51589ed640 1 -- 172.21.15.17:0/2426663691 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5140003520 con 0x7f5154152b10 2024-09-05T07:29:30.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.994+0000 7f51591ee640 1 -- 172.21.15.17:0/2426663691 >> v2:172.21.15.17:3300/0 conn(0x7f515406fe20 msgr2=0x7f51540702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:30.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.994+0000 7f51591ee640 1 --2- 172.21.15.17:0/2426663691 >> v2:172.21.15.17:3300/0 conn(0x7f515406fe20 0x7f51540702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:30.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.994+0000 7f51591ee640 1 -- 172.21.15.17:0/2426663691 >> v1:172.21.15.26:6789/0 conn(0x7f5154152b10 legacy=0x7f515415c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:30.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.995+0000 7f51591ee640 1 -- 172.21.15.17:0/2426663691 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f515415bd30 con 0x7f51540b0df0 2024-09-05T07:29:30.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:30.997+0000 7f51591ee640 1 --2- 172.21.15.17:0/2426663691 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f51540b0df0 0x7f5154070bd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f51540c4fe0 tx=0x7f514402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88c5431afa5e8ea4 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:31.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.002+0000 7f51589ed640 1 -- 172.21.15.17:0/2426663691 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5144037070 con 0x7f51540b0df0 2024-09-05T07:29:31.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.002+0000 7f51589ed640 1 -- 172.21.15.17:0/2426663691 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5144032440 con 0x7f51540b0df0 2024-09-05T07:29:31.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.002+0000 7f51589ed640 1 -- 172.21.15.17:0/2426663691 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5144032810 con 0x7f51540b0df0 2024-09-05T07:29:31.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.003+0000 7f515bc53640 1 -- 172.21.15.17:0/2426663691 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f51540b0df0 msgr2=0x7f5154070bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:31.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.003+0000 7f515bc53640 1 --2- 172.21.15.17:0/2426663691 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f51540b0df0 0x7f5154070bd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f51540c4fe0 tx=0x7f514402a180 comp rx=0 tx=0).stop 2024-09-05T07:29:31.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.003+0000 7f515bc53640 1 -- 172.21.15.17:0/2426663691 shutdown_connections 2024-09-05T07:29:31.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.003+0000 7f515bc53640 1 --2- 172.21.15.17:0/2426663691 >> v2:172.21.15.17:3300/0 conn(0x7f515406fe20 0x7f51540702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:31.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.003+0000 7f515bc53640 1 --2- 172.21.15.17:0/2426663691 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f51540b0df0 0x7f5154070bd0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:31.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.003+0000 7f515bc53640 1 -- 172.21.15.17:0/2426663691 >> 172.21.15.17:0/2426663691 conn(0x7f5154071550 msgr2=0x7f5154071930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:31.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.003+0000 7f515bc53640 1 -- 172.21.15.17:0/2426663691 shutdown_connections 2024-09-05T07:29:31.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.003+0000 7f515bc53640 1 -- 172.21.15.17:0/2426663691 wait complete. 2024-09-05T07:29:31.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.004+0000 7f515bc53640 1 Processor -- start 2024-09-05T07:29:31.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.004+0000 7f515bc53640 1 -- start start 2024-09-05T07:29:31.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.005+0000 7f515bc53640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f515406fe20 0x7f51541537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:31.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.005+0000 7f515bc53640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51540b0df0 0x7f51540ca750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:31.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.005+0000 7f515bc53640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5154152b10 0x7f51541f1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:31.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.005+0000 7f515bc53640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f51540c3540 con 0x7f51540b0df0 2024-09-05T07:29:31.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.005+0000 7f515bc53640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f51540c3260 con 0x7f515406fe20 2024-09-05T07:29:31.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.005+0000 7f515bc53640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f51540c3820 con 0x7f5154152b10 2024-09-05T07:29:31.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.005+0000 7f51591ee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51540b0df0 0x7f51540ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:31.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.005+0000 7f515a1f0640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5154152b10 0x7f51541f1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:31.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.005+0000 7f51591ee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51540b0df0 0x7f51540ca750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59688/0 (socket says 172.21.15.17:59688) 2024-09-05T07:29:31.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.005+0000 7f51591ee640 1 -- 172.21.15.17:0/1686601464 learned_addr learned my addr 172.21.15.17:0/1686601464 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:31.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.009+0000 7f51591ee640 1 -- 172.21.15.17:0/1686601464 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5154152b10 msgr2=0x7f51541f1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:31.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.009+0000 7f51591ee640 1 --2- 172.21.15.17:0/1686601464 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5154152b10 0x7f51541f1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:31.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.009+0000 7f51591ee640 1 -- 172.21.15.17:0/1686601464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f515406fe20 msgr2=0x7f51541537a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:31.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.009+0000 7f51591ee640 1 --2- 172.21.15.17:0/1686601464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f515406fe20 0x7f51541537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:31.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.009+0000 7f51591ee640 1 -- 172.21.15.17:0/1686601464 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5154153de0 con 0x7f51540b0df0 2024-09-05T07:29:31.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.011+0000 7f51591ee640 1 --2- 172.21.15.17:0/1686601464 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51540b0df0 0x7f51540ca750 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5144000c00 tx=0x7f51440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:31.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.015+0000 7f514a7fc640 1 -- 172.21.15.17:0/1686601464 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5144037040 con 0x7f51540b0df0 2024-09-05T07:29:31.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.015+0000 7f514a7fc640 1 -- 172.21.15.17:0/1686601464 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5144042070 con 0x7f51540b0df0 2024-09-05T07:29:31.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.015+0000 7f515bc53640 1 -- 172.21.15.17:0/1686601464 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5154155410 con 0x7f51540b0df0 2024-09-05T07:29:31.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.015+0000 7f514a7fc640 1 -- 172.21.15.17:0/1686601464 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5144030920 con 0x7f51540b0df0 2024-09-05T07:29:31.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.015+0000 7f515bc53640 1 -- 172.21.15.17:0/1686601464 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51541559d0 con 0x7f51540b0df0 2024-09-05T07:29:31.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.016+0000 7f515bc53640 1 -- 172.21.15.17:0/1686601464 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5154076430 con 0x7f51540b0df0 2024-09-05T07:29:31.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.290+0000 7f514a7fc640 1 -- 172.21.15.17:0/1686601464 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5144030ac0 con 0x7f51540b0df0 2024-09-05T07:29:31.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.290+0000 7f514a7fc640 1 --2- 172.21.15.17:0/1686601464 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f513806beb0 0x7f513806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:31.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.290+0000 7f51599ef640 1 --2- 172.21.15.17:0/1686601464 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f513806beb0 0x7f513806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:31.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.291+0000 7f51599ef640 1 --2- 172.21.15.17:0/1686601464 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f513806beb0 0x7f513806e370 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5150000f60 tx=0x7f51500078f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:31.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.305+0000 7f514a7fc640 1 -- 172.21.15.17:0/1686601464 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5144078740 con 0x7f51540b0df0 2024-09-05T07:29:31.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.305+0000 7f514a7fc640 1 -- 172.21.15.17:0/1686601464 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5154076430 con 0x7f51540b0df0 2024-09-05T07:29:31.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.483+0000 7f515bc53640 1 -- 172.21.15.17:0/1686601464 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f51540cf0b0 con 0x7f51540b0df0 2024-09-05T07:29:31.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.591+0000 7f514a7fc640 1 -- 172.21.15.17:0/1686601464 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16634 (secure 0 0 0) 0x7f514407ada0 con 0x7f51540b0df0 2024-09-05T07:29:31.592 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:29:31.592 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":21,"fsid":"848dac54-74f8-48f3-8686-c6495dcb972b","created":"2024-09-05T07:28:54.070215+0000","modified":"2024-09-05T07:29:30.262436+0000","last_up_change":"2024-09-05T07:29:11.992790+0000","last_in_change":"2024-09-05T07:29:00.001829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T07:29:10.227047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T07:29:27.905154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T07:29:29.039672+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f01a8b4-dc10-4cdf-a65e-b7f96de4e2b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2731314060},{"type":"v1","addr":"172.21.15.17:6825","nonce":2731314060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2731314060},{"type":"v1","addr":"172.21.15.17:6827","nonce":2731314060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2731314060},{"type":"v1","addr":"172.21.15.17:6831","nonce":2731314060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2731314060},{"type":"v1","addr":"172.21.15.17:6829","nonce":2731314060}]},"public_addr":"172.21.15.17:6825/2731314060","cluster_addr":"172.21.15.17:6827/2731314060","heartbeat_back_addr":"172.21.15.17:6831/2731314060","heartbeat_front_addr":"172.21.15.17:6829/2731314060","state":["exists","up"]},{"osd":1,"uuid":"d16867fb-2290-486c-9ac8-327ca54326d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3327408852},{"type":"v1","addr":"172.21.15.17:6817","nonce":3327408852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3327408852},{"type":"v1","addr":"172.21.15.17:6819","nonce":3327408852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3327408852},{"type":"v1","addr":"172.21.15.17:6823","nonce":3327408852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3327408852},{"type":"v1","addr":"172.21.15.17:6821","nonce":3327408852}]},"public_addr":"172.21.15.17:6817/3327408852","cluster_addr":"172.21.15.17:6819/3327408852","heartbeat_back_addr":"172.21.15.17:6823/3327408852","heartbeat_front_addr":"172.21.15.17:6821/3327408852","state":["exists","up"]},{"osd":2,"uuid":"632ad558-bd14-4240-a8f1-5beda951b3b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":363420609},{"type":"v1","addr":"172.21.15.17:6809","nonce":363420609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":363420609},{"type":"v1","addr":"172.21.15.17:6811","nonce":363420609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":363420609},{"type":"v1","addr":"172.21.15.17:6815","nonce":363420609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":363420609},{"type":"v1","addr":"172.21.15.17:6813","nonce":363420609}]},"public_addr":"172.21.15.17:6809/363420609","cluster_addr":"172.21.15.17:6811/363420609","heartbeat_back_addr":"172.21.15.17:6815/363420609","heartbeat_front_addr":"172.21.15.17:6813/363420609","state":["exists","up"]},{"osd":3,"uuid":"9727a970-8f98-45b9-8eca-62da1f28ff17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":3512342499},{"type":"v1","addr":"172.21.15.17:6801","nonce":3512342499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":3512342499},{"type":"v1","addr":"172.21.15.17:6803","nonce":3512342499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":3512342499},{"type":"v1","addr":"172.21.15.17:6807","nonce":3512342499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":3512342499},{"type":"v1","addr":"172.21.15.17:6805","nonce":3512342499}]},"public_addr":"172.21.15.17:6801/3512342499","cluster_addr":"172.21.15.17:6803/3512342499","heartbeat_back_addr":"172.21.15.17:6807/3512342499","heartbeat_front_addr":"172.21.15.17:6805/3512342499","state":["exists","up"]},{"osd":4,"uuid":"0e0141e0-51f1-4229-861f-1992afe70c96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6803","nonce":3740556509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6805","nonce":3740556509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6809","nonce":3740556509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6807","nonce":3740556509}]},"public_addr":"172.21.15.26:6803/3740556509","cluster_addr":"172.21.15.26:6805/3740556509","heartbeat_back_addr":"172.21.15.26:6809/3740556509","heartbeat_front_addr":"172.21.15.26:6807/3740556509","state":["exists","up"]},{"osd":5,"uuid":"5603d79b-fcf8-45aa-a1db-96918af450be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3020770750},{"type":"v1","addr":"172.21.15.26:6819","nonce":3020770750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3020770750},{"type":"v1","addr":"172.21.15.26:6821","nonce":3020770750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3020770750},{"type":"v1","addr":"172.21.15.26:6825","nonce":3020770750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3020770750},{"type":"v1","addr":"172.21.15.26:6823","nonce":3020770750}]},"public_addr":"172.21.15.26:6819/3020770750","cluster_addr":"172.21.15.26:6821/3020770750","heartbeat_back_addr":"172.21.15.26:6825/3020770750","heartbeat_front_addr":"172.21.15.26:6823/3020770750","state":["exists","up"]},{"osd":6,"uuid":"14f3b696-1b3c-4749-8f61-ac10edbb5b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6811","nonce":158775588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6813","nonce":158775588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6817","nonce":158775588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6815","nonce":158775588}]},"public_addr":"172.21.15.26:6811/158775588","cluster_addr":"172.21.15.26:6813/158775588","heartbeat_back_addr":"172.21.15.26:6817/158775588","heartbeat_front_addr":"172.21.15.26:6815/158775588","state":["exists","up"]},{"osd":7,"uuid":"be7b4121-c71b-4908-ba4a-9c4389423201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":4176189153},{"type":"v1","addr":"172.21.15.26:6827","nonce":4176189153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":4176189153},{"type":"v1","addr":"172.21.15.26:6829","nonce":4176189153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":4176189153},{"type":"v1","addr":"172.21.15.26:6833","nonce":4176189153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":4176189153},{"type":"v1","addr":"172.21.15.26:6831","nonce":4176189153}]},"public_addr":"172.21.15.26:6827/4176189153","cluster_addr":"172.21.15.26:6829/4176189153","heartbeat_back_addr":"172.21.15.26:6833/4176189153","heartbeat_front_addr":"172.21.15.26:6831/4176189153","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.923722+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.404043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.275202+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.434925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.159606+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.379036+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.196000+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.387333+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T07:29:31.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.593+0000 7f515bc53640 1 -- 172.21.15.17:0/1686601464 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f513806beb0 msgr2=0x7f513806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:31.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.593+0000 7f515bc53640 1 --2- 172.21.15.17:0/1686601464 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f513806beb0 0x7f513806e370 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5150000f60 tx=0x7f51500078f0 comp rx=0 tx=0).stop 2024-09-05T07:29:31.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.593+0000 7f515bc53640 1 -- 172.21.15.17:0/1686601464 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51540b0df0 msgr2=0x7f51540ca750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:31.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.593+0000 7f515bc53640 1 --2- 172.21.15.17:0/1686601464 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51540b0df0 0x7f51540ca750 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5144000c00 tx=0x7f51440046c0 comp rx=0 tx=0).stop 2024-09-05T07:29:31.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.593+0000 7f515bc53640 1 -- 172.21.15.17:0/1686601464 shutdown_connections 2024-09-05T07:29:31.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.593+0000 7f515bc53640 1 --2- 172.21.15.17:0/1686601464 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f513806beb0 0x7f513806e370 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:31.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.593+0000 7f515bc53640 1 --2- 172.21.15.17:0/1686601464 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5154152b10 0x7f51541f1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:31.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.593+0000 7f515bc53640 1 --2- 172.21.15.17:0/1686601464 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51540b0df0 0x7f51540ca750 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:31.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.593+0000 7f515bc53640 1 --2- 172.21.15.17:0/1686601464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f515406fe20 0x7f51541537a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:31.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.593+0000 7f515bc53640 1 -- 172.21.15.17:0/1686601464 >> 172.21.15.17:0/1686601464 conn(0x7f5154071550 msgr2=0x7f51540ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:31.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.593+0000 7f515bc53640 1 -- 172.21.15.17:0/1686601464 shutdown_connections 2024-09-05T07:29:31.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.593+0000 7f515bc53640 1 -- 172.21.15.17:0/1686601464 wait complete. 2024-09-05T07:29:31.605 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-05T07:29:31.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.705+0000 7fcce1af8640 1 Processor -- start 2024-09-05T07:29:31.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.705+0000 7fcce1af8640 1 -- start start 2024-09-05T07:29:31.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.706+0000 7fcce1af8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fccdc0c6190 0x7fccdc15b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:31.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.706+0000 7fcce1af8640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccdc06c8c0 con 0x7fccdc0cafa0 2024-09-05T07:29:31.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.706+0000 7fcce1af8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccdc0cb950 con 0x7fccdc154770 2024-09-05T07:29:31.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.706+0000 7fcce1af8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fccdc0c5310 con 0x7fccdc0c6190 2024-09-05T07:29:31.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.706+0000 7fccdaffd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fccdc0cafa0 0x7fccdc0c5a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54136/0 (socket says 172.21.15.17:54136) 2024-09-05T07:29:31.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.706+0000 7fccdaffd640 1 -- 172.21.15.17:0/3448089389 learned_addr learned my addr 172.21.15.17:0/3448089389 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:29:31.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.709+0000 7fccda7fc640 1 -- 172.21.15.17:0/3448089389 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1383752415 0 0) 0x7fccdc06c8c0 con 0x7fccdc0cafa0 2024-09-05T07:29:31.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.709+0000 7fccda7fc640 1 -- 172.21.15.17:0/3448089389 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fccc4003520 con 0x7fccdc0cafa0 2024-09-05T07:29:31.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.719+0000 7fccda7fc640 1 -- 172.21.15.17:0/3448089389 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 778543858 0 0) 0x7fccc4003520 con 0x7fccdc0cafa0 2024-09-05T07:29:31.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.719+0000 7fccda7fc640 1 -- 172.21.15.17:0/3448089389 >> v2:172.21.15.26:3300/0 conn(0x7fccdc0c6190 msgr2=0x7fccdc15b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:31.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.719+0000 7fccda7fc640 1 --2- 172.21.15.17:0/3448089389 >> v2:172.21.15.26:3300/0 conn(0x7fccdc0c6190 0x7fccdc15b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:31.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.719+0000 7fccda7fc640 1 -- 172.21.15.17:0/3448089389 >> v1:172.21.15.26:6789/0 conn(0x7fccdc154770 legacy=0x7fccdc0d05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:31.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.719+0000 7fccda7fc640 1 -- 172.21.15.17:0/3448089389 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccdc06cb60 con 0x7fccdc0cafa0 2024-09-05T07:29:31.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.719+0000 7fccda7fc640 1 -- 172.21.15.17:0/3448089389 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1460137602 0 0) 0x7fccd0001670 con 0x7fccdc0cafa0 2024-09-05T07:29:31.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.719+0000 7fccda7fc640 1 -- 172.21.15.17:0/3448089389 >> v1:172.21.15.17:6789/0 conn(0x7fccdc0cafa0 legacy=0x7fccdc0c5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:31.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.719+0000 7fccda7fc640 1 --2- 172.21.15.17:0/3448089389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccc4003a00 0x7fccc4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:31.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.719+0000 7fccda7fc640 1 --2- 172.21.15.17:0/3448089389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccc4004800 0x7fccc4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:31.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.719+0000 7fccda7fc640 1 --2- 172.21.15.17:0/3448089389 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fccc4005370 0x7fccc400b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:31.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.719+0000 7fccda7fc640 1 -- 172.21.15.17:0/3448089389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fccdc0c5310 con 0x7fccc4004800 2024-09-05T07:29:31.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.719+0000 7fccda7fc640 1 -- 172.21.15.17:0/3448089389 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fccc400c2c0 con 0x7fccc4003a00 2024-09-05T07:29:31.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.719+0000 7fccda7fc640 1 -- 172.21.15.17:0/3448089389 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fccc400c4c0 con 0x7fccc4005370 2024-09-05T07:29:31.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.722+0000 7fccdbfff640 1 --2- 172.21.15.17:0/3448089389 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fccc4005370 0x7fccc400b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:31.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.727+0000 7fccdbfff640 1 -- 172.21.15.17:0/3448089389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccc4003a00 msgr2=0x7fccc4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:31.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.727+0000 7fccdbfff640 1 --2- 172.21.15.17:0/3448089389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccc4003a00 0x7fccc4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:31.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.727+0000 7fccdbfff640 1 -- 172.21.15.17:0/3448089389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccc4004800 msgr2=0x7fccc4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:31.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.727+0000 7fccdbfff640 1 --2- 172.21.15.17:0/3448089389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccc4004800 0x7fccc4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:31.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.727+0000 7fccdbfff640 1 -- 172.21.15.17:0/3448089389 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccc4003520 con 0x7fccc4005370 2024-09-05T07:29:31.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.727+0000 7fccdbfff640 1 -- 172.21.15.17:0/3448089389 reap_dead start 2024-09-05T07:29:31.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.730+0000 7fccdbfff640 1 --2- 172.21.15.17:0/3448089389 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fccc4005370 0x7fccc400b9e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fccd4009e40 tx=0x7fccc4005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=538a0d0e4a978dfb server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:31.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.734+0000 7fccda7fc640 1 -- 172.21.15.17:0/3448089389 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd4009a10 con 0x7fccc4005370 2024-09-05T07:29:31.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.734+0000 7fccda7fc640 1 -- 172.21.15.17:0/3448089389 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccd4006e50 con 0x7fccc4005370 2024-09-05T07:29:31.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.734+0000 7fccda7fc640 1 -- 172.21.15.17:0/3448089389 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd4003df0 con 0x7fccc4005370 2024-09-05T07:29:31.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.735+0000 7fcce1af8640 1 -- 172.21.15.17:0/3448089389 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fccc4005370 msgr2=0x7fccc400b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:31.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.735+0000 7fcce1af8640 1 --2- 172.21.15.17:0/3448089389 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fccc4005370 0x7fccc400b9e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fccd4009e40 tx=0x7fccc4005830 comp rx=0 tx=0).stop 2024-09-05T07:29:31.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.735+0000 7fcce1af8640 1 -- 172.21.15.17:0/3448089389 shutdown_connections 2024-09-05T07:29:31.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.735+0000 7fcce1af8640 1 --2- 172.21.15.17:0/3448089389 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fccc4005370 0x7fccc400b9e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:31.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.735+0000 7fcce1af8640 1 -- 172.21.15.17:0/3448089389 >> 172.21.15.17:0/3448089389 conn(0x7fccdc073710 msgr2=0x7fccdc073b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:31.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.735+0000 7fcce1af8640 1 -- 172.21.15.17:0/3448089389 shutdown_connections 2024-09-05T07:29:31.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.735+0000 7fcce1af8640 1 -- 172.21.15.17:0/3448089389 wait complete. 2024-09-05T07:29:31.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.736+0000 7fcce1af8640 1 Processor -- start 2024-09-05T07:29:31.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.736+0000 7fcce1af8640 1 -- start start 2024-09-05T07:29:31.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.737+0000 7fcce1af8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccc4005370 0x7fccdc0cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:31.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.737+0000 7fcce1af8640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fccdc0b53f0 0x7fccdc0cf600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:31.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.737+0000 7fcce1af8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccdc1594a0 0x7fccdc14eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:31.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.737+0000 7fcce1af8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fccdc154b50 con 0x7fccdc1594a0 2024-09-05T07:29:31.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.737+0000 7fcce1af8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fccdc0cbc30 con 0x7fccc4005370 2024-09-05T07:29:31.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.737+0000 7fcce1af8640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fccdc06bca0 con 0x7fccdc0b53f0 2024-09-05T07:29:31.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.737+0000 7fccdaffd640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fccdc0b53f0 0x7fccdc0cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:31.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.738+0000 7fccdaffd640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fccdc0b53f0 0x7fccdc0cf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:58774/0 (socket says 172.21.15.17:58774) 2024-09-05T07:29:31.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.738+0000 7fccdaffd640 1 -- 172.21.15.17:0/855859055 learned_addr learned my addr 172.21.15.17:0/855859055 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:31.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.738+0000 7fccdb7fe640 1 --2- 172.21.15.17:0/855859055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccc4005370 0x7fccdc0cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:31.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.740+0000 7fccdbfff640 1 --2- 172.21.15.17:0/855859055 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccdc1594a0 0x7fccdc14eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:31.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.743+0000 7fccdaffd640 1 -- 172.21.15.17:0/855859055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccc4005370 msgr2=0x7fccdc0cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:31.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.743+0000 7fccdaffd640 1 --2- 172.21.15.17:0/855859055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccc4005370 0x7fccdc0cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:31.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.743+0000 7fccdaffd640 1 -- 172.21.15.17:0/855859055 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccdc1594a0 msgr2=0x7fccdc14eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:31.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.743+0000 7fccdaffd640 1 --2- 172.21.15.17:0/855859055 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccdc1594a0 0x7fccdc14eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:31.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.743+0000 7fccdaffd640 1 -- 172.21.15.17:0/855859055 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccdc0b4e30 con 0x7fccdc0b53f0 2024-09-05T07:29:31.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.746+0000 7fccdaffd640 1 --2- 172.21.15.17:0/855859055 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fccdc0b53f0 0x7fccdc0cf600 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fccd000c770 tx=0x7fccd000cc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:31.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.752+0000 7fccc3fff640 1 -- 172.21.15.17:0/855859055 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd0018070 con 0x7fccdc0b53f0 2024-09-05T07:29:31.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.752+0000 7fccc3fff640 1 -- 172.21.15.17:0/855859055 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccd00074e0 con 0x7fccdc0b53f0 2024-09-05T07:29:31.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.752+0000 7fccc3fff640 1 -- 172.21.15.17:0/855859055 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd0004a20 con 0x7fccdc0b53f0 2024-09-05T07:29:31.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.752+0000 7fcce1af8640 1 -- 172.21.15.17:0/855859055 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccdc1f0be0 con 0x7fccdc0b53f0 2024-09-05T07:29:31.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.752+0000 7fcce1af8640 1 -- 172.21.15.17:0/855859055 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fccdc0b50d0 con 0x7fccdc0b53f0 2024-09-05T07:29:31.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:31.753+0000 7fcce1af8640 1 -- 172.21.15.17:0/855859055 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccdc15b240 con 0x7fccdc0b53f0 2024-09-05T07:29:32.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.057+0000 7fccc3fff640 1 -- 172.21.15.17:0/855859055 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fccd001b070 con 0x7fccdc0b53f0 2024-09-05T07:29:32.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.058+0000 7fccc3fff640 1 --2- 172.21.15.17:0/855859055 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fccc806beb0 0x7fccc806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:32.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.058+0000 7fccdb7fe640 1 --2- 172.21.15.17:0/855859055 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fccc806beb0 0x7fccc806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:32.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.058+0000 7fccdb7fe640 1 --2- 172.21.15.17:0/855859055 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fccc806beb0 0x7fccc806e370 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0017e0 tx=0x7fcccc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:32.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.061+0000 7fccc3fff640 1 -- 172.21.15.17:0/855859055 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fccd0056c00 con 0x7fccdc0b53f0 2024-09-05T07:29:32.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.075+0000 7fccc3fff640 1 -- 172.21.15.17:0/855859055 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fccd0022020 con 0x7fccdc0b53f0 2024-09-05T07:29:32.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.250+0000 7fcce1af8640 1 -- 172.21.15.17:0/855859055 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fccdc0ca6c0 con 0x7fccdc0b53f0 2024-09-05T07:29:32.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.364+0000 7fccc3fff640 1 -- 172.21.15.17:0/855859055 <== mon.2 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16621 (secure 0 0 0) 0x7fccd000ce20 con 0x7fccdc0b53f0 2024-09-05T07:29:32.364 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:29:32.364 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":22,"fsid":"848dac54-74f8-48f3-8686-c6495dcb972b","created":"2024-09-05T07:28:54.070215+0000","modified":"2024-09-05T07:29:31.467668+0000","last_up_change":"2024-09-05T07:29:11.992790+0000","last_in_change":"2024-09-05T07:29:00.001829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T07:29:10.227047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T07:29:27.905154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T07:29:29.039672+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f01a8b4-dc10-4cdf-a65e-b7f96de4e2b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2731314060},{"type":"v1","addr":"172.21.15.17:6825","nonce":2731314060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2731314060},{"type":"v1","addr":"172.21.15.17:6827","nonce":2731314060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2731314060},{"type":"v1","addr":"172.21.15.17:6831","nonce":2731314060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2731314060},{"type":"v1","addr":"172.21.15.17:6829","nonce":2731314060}]},"public_addr":"172.21.15.17:6825/2731314060","cluster_addr":"172.21.15.17:6827/2731314060","heartbeat_back_addr":"172.21.15.17:6831/2731314060","heartbeat_front_addr":"172.21.15.17:6829/2731314060","state":["exists","up"]},{"osd":1,"uuid":"d16867fb-2290-486c-9ac8-327ca54326d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3327408852},{"type":"v1","addr":"172.21.15.17:6817","nonce":3327408852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3327408852},{"type":"v1","addr":"172.21.15.17:6819","nonce":3327408852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3327408852},{"type":"v1","addr":"172.21.15.17:6823","nonce":3327408852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3327408852},{"type":"v1","addr":"172.21.15.17:6821","nonce":3327408852}]},"public_addr":"172.21.15.17:6817/3327408852","cluster_addr":"172.21.15.17:6819/3327408852","heartbeat_back_addr":"172.21.15.17:6823/3327408852","heartbeat_front_addr":"172.21.15.17:6821/3327408852","state":["exists","up"]},{"osd":2,"uuid":"632ad558-bd14-4240-a8f1-5beda951b3b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":363420609},{"type":"v1","addr":"172.21.15.17:6809","nonce":363420609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":363420609},{"type":"v1","addr":"172.21.15.17:6811","nonce":363420609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":363420609},{"type":"v1","addr":"172.21.15.17:6815","nonce":363420609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":363420609},{"type":"v1","addr":"172.21.15.17:6813","nonce":363420609}]},"public_addr":"172.21.15.17:6809/363420609","cluster_addr":"172.21.15.17:6811/363420609","heartbeat_back_addr":"172.21.15.17:6815/363420609","heartbeat_front_addr":"172.21.15.17:6813/363420609","state":["exists","up"]},{"osd":3,"uuid":"9727a970-8f98-45b9-8eca-62da1f28ff17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":3512342499},{"type":"v1","addr":"172.21.15.17:6801","nonce":3512342499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":3512342499},{"type":"v1","addr":"172.21.15.17:6803","nonce":3512342499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":3512342499},{"type":"v1","addr":"172.21.15.17:6807","nonce":3512342499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":3512342499},{"type":"v1","addr":"172.21.15.17:6805","nonce":3512342499}]},"public_addr":"172.21.15.17:6801/3512342499","cluster_addr":"172.21.15.17:6803/3512342499","heartbeat_back_addr":"172.21.15.17:6807/3512342499","heartbeat_front_addr":"172.21.15.17:6805/3512342499","state":["exists","up"]},{"osd":4,"uuid":"0e0141e0-51f1-4229-861f-1992afe70c96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6803","nonce":3740556509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6805","nonce":3740556509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6809","nonce":3740556509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6807","nonce":3740556509}]},"public_addr":"172.21.15.26:6803/3740556509","cluster_addr":"172.21.15.26:6805/3740556509","heartbeat_back_addr":"172.21.15.26:6809/3740556509","heartbeat_front_addr":"172.21.15.26:6807/3740556509","state":["exists","up"]},{"osd":5,"uuid":"5603d79b-fcf8-45aa-a1db-96918af450be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3020770750},{"type":"v1","addr":"172.21.15.26:6819","nonce":3020770750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3020770750},{"type":"v1","addr":"172.21.15.26:6821","nonce":3020770750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3020770750},{"type":"v1","addr":"172.21.15.26:6825","nonce":3020770750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3020770750},{"type":"v1","addr":"172.21.15.26:6823","nonce":3020770750}]},"public_addr":"172.21.15.26:6819/3020770750","cluster_addr":"172.21.15.26:6821/3020770750","heartbeat_back_addr":"172.21.15.26:6825/3020770750","heartbeat_front_addr":"172.21.15.26:6823/3020770750","state":["exists","up"]},{"osd":6,"uuid":"14f3b696-1b3c-4749-8f61-ac10edbb5b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6811","nonce":158775588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6813","nonce":158775588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6817","nonce":158775588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6815","nonce":158775588}]},"public_addr":"172.21.15.26:6811/158775588","cluster_addr":"172.21.15.26:6813/158775588","heartbeat_back_addr":"172.21.15.26:6817/158775588","heartbeat_front_addr":"172.21.15.26:6815/158775588","state":["exists","up"]},{"osd":7,"uuid":"be7b4121-c71b-4908-ba4a-9c4389423201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":4176189153},{"type":"v1","addr":"172.21.15.26:6827","nonce":4176189153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":4176189153},{"type":"v1","addr":"172.21.15.26:6829","nonce":4176189153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":4176189153},{"type":"v1","addr":"172.21.15.26:6833","nonce":4176189153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":4176189153},{"type":"v1","addr":"172.21.15.26:6831","nonce":4176189153}]},"public_addr":"172.21.15.26:6827/4176189153","cluster_addr":"172.21.15.26:6829/4176189153","heartbeat_back_addr":"172.21.15.26:6833/4176189153","heartbeat_front_addr":"172.21.15.26:6831/4176189153","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.923722+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.404043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.275202+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.434925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.159606+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.379036+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.196000+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.387333+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T07:29:32.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.365+0000 7fcce1af8640 1 -- 172.21.15.17:0/855859055 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fccc806beb0 msgr2=0x7fccc806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:32.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.365+0000 7fcce1af8640 1 --2- 172.21.15.17:0/855859055 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fccc806beb0 0x7fccc806e370 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0017e0 tx=0x7fcccc009040 comp rx=0 tx=0).stop 2024-09-05T07:29:32.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.365+0000 7fcce1af8640 1 -- 172.21.15.17:0/855859055 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fccdc0b53f0 msgr2=0x7fccdc0cf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:32.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.365+0000 7fcce1af8640 1 --2- 172.21.15.17:0/855859055 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fccdc0b53f0 0x7fccdc0cf600 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fccd000c770 tx=0x7fccd000cc30 comp rx=0 tx=0).stop 2024-09-05T07:29:32.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.365+0000 7fcce1af8640 1 -- 172.21.15.17:0/855859055 shutdown_connections 2024-09-05T07:29:32.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.365+0000 7fcce1af8640 1 --2- 172.21.15.17:0/855859055 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fccc806beb0 0x7fccc806e370 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:32.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.365+0000 7fcce1af8640 1 --2- 172.21.15.17:0/855859055 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fccdc0b53f0 0x7fccdc0cf600 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:32.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.365+0000 7fcce1af8640 1 --2- 172.21.15.17:0/855859055 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccdc1594a0 0x7fccdc14eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:32.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.365+0000 7fcce1af8640 1 --2- 172.21.15.17:0/855859055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccc4005370 0x7fccdc0cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:32.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.365+0000 7fcce1af8640 1 -- 172.21.15.17:0/855859055 >> 172.21.15.17:0/855859055 conn(0x7fccdc073710 msgr2=0x7fccdc0cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:32.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.366+0000 7fcce1af8640 1 -- 172.21.15.17:0/855859055 shutdown_connections 2024-09-05T07:29:32.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.366+0000 7fcce1af8640 1 -- 172.21.15.17:0/855859055 wait complete. 2024-09-05T07:29:32.378 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-05T07:29:32.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.481+0000 7fe5e6a1e640 1 Processor -- start 2024-09-05T07:29:32.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.482+0000 7fe5e6a1e640 1 -- start start 2024-09-05T07:29:32.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.482+0000 7fe5e6a1e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe5e00d07a0 0x7fe5e00cb870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:32.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.482+0000 7fe5e6a1e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe5e00d0b80 0x7fe5e01546a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:32.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.482+0000 7fe5e6a1e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5e00cbdb0 con 0x7fe5e00cabb0 2024-09-05T07:29:32.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.482+0000 7fe5e6a1e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fe5e00cb160 con 0x7fe5e00d07a0 2024-09-05T07:29:32.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.482+0000 7fe5e6a1e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fe5e015a9a0 con 0x7fe5e00d0b80 2024-09-05T07:29:32.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.483+0000 7fe5df7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe5e00d0b80 0x7fe5e01546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:32.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.483+0000 7fe5dffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe5e00d07a0 0x7fe5e00cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:32.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.483+0000 7fe5df7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe5e00d0b80 0x7fe5e01546a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:51934/0 (socket says 172.21.15.17:51934) 2024-09-05T07:29:32.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.483+0000 7fe5df7fe640 1 -- 172.21.15.17:0/1504036715 learned_addr learned my addr 172.21.15.17:0/1504036715 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:32.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.485+0000 7fe5df7fe640 1 -- 172.21.15.17:0/1504036715 >> v2:172.21.15.17:3300/0 conn(0x7fe5e00d07a0 msgr2=0x7fe5e00cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:32.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.485+0000 7fe5df7fe640 1 --2- 172.21.15.17:0/1504036715 >> v2:172.21.15.17:3300/0 conn(0x7fe5e00d07a0 0x7fe5e00cb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:32.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.485+0000 7fe5df7fe640 1 -- 172.21.15.17:0/1504036715 >> v1:172.21.15.17:6789/0 conn(0x7fe5e00cabb0 legacy=0x7fe5e015de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:32.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.486+0000 7fe5df7fe640 1 -- 172.21.15.17:0/1504036715 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5e015ac80 con 0x7fe5e00d0b80 2024-09-05T07:29:32.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.487+0000 7fe5df7fe640 1 --2- 172.21.15.17:0/1504036715 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5e00d0b80 0x7fe5e01546a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe5e00cb2e0 tx=0x7fe5d402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c731113bb01a19f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:32.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.491+0000 7fe5deffd640 1 -- 172.21.15.17:0/1504036715 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d4037070 con 0x7fe5e00d0b80 2024-09-05T07:29:32.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.491+0000 7fe5deffd640 1 -- 172.21.15.17:0/1504036715 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5d4032440 con 0x7fe5e00d0b80 2024-09-05T07:29:32.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.491+0000 7fe5deffd640 1 -- 172.21.15.17:0/1504036715 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d4032810 con 0x7fe5e00d0b80 2024-09-05T07:29:32.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.492+0000 7fe5e6a1e640 1 -- 172.21.15.17:0/1504036715 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5e00d0b80 msgr2=0x7fe5e01546a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:32.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.492+0000 7fe5e6a1e640 1 --2- 172.21.15.17:0/1504036715 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5e00d0b80 0x7fe5e01546a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe5e00cb2e0 tx=0x7fe5d402a270 comp rx=0 tx=0).stop 2024-09-05T07:29:32.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.492+0000 7fe5e6a1e640 1 -- 172.21.15.17:0/1504036715 shutdown_connections 2024-09-05T07:29:32.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.492+0000 7fe5e6a1e640 1 --2- 172.21.15.17:0/1504036715 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5e00d0b80 0x7fe5e01546a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:32.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.492+0000 7fe5e6a1e640 1 --2- 172.21.15.17:0/1504036715 >> v2:172.21.15.17:3300/0 conn(0x7fe5e00d07a0 0x7fe5e00cb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:32.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.492+0000 7fe5e6a1e640 1 -- 172.21.15.17:0/1504036715 >> 172.21.15.17:0/1504036715 conn(0x7fe5e0073710 msgr2=0x7fe5e0073b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:32.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.492+0000 7fe5e6a1e640 1 -- 172.21.15.17:0/1504036715 shutdown_connections 2024-09-05T07:29:32.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.492+0000 7fe5e6a1e640 1 -- 172.21.15.17:0/1504036715 wait complete. 2024-09-05T07:29:32.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.493+0000 7fe5e6a1e640 1 Processor -- start 2024-09-05T07:29:32.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.493+0000 7fe5e6a1e640 1 -- start start 2024-09-05T07:29:32.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.494+0000 7fe5e6a1e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5e00cabb0 0x7fe5e00b4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:32.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.494+0000 7fe5e6a1e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5e00d07a0 0x7fe5e014f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:32.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.494+0000 7fe5e6a1e640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe5e00d0b80 0x7fe5e0150780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:32.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.494+0000 7fe5e6a1e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e006c9b0 con 0x7fe5e00cabb0 2024-09-05T07:29:32.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.494+0000 7fe5e6a1e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e015b240 con 0x7fe5e00d07a0 2024-09-05T07:29:32.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.494+0000 7fe5e6a1e640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fe5e006cb30 con 0x7fe5e00d0b80 2024-09-05T07:29:32.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.494+0000 7fe5df7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5e00d07a0 0x7fe5e014f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:32.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.494+0000 7fe5dffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5e00cabb0 0x7fe5e00b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:32.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.494+0000 7fe5e4fbb640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe5e00d0b80 0x7fe5e0150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:32.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.495+0000 7fe5df7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5e00d07a0 0x7fe5e014f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:51936/0 (socket says 172.21.15.17:51936) 2024-09-05T07:29:32.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.495+0000 7fe5df7fe640 1 -- 172.21.15.17:0/208525884 learned_addr learned my addr 172.21.15.17:0/208525884 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:32.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.498+0000 7fe5df7fe640 1 -- 172.21.15.17:0/208525884 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe5e00d0b80 msgr2=0x7fe5e0150780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:32.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.498+0000 7fe5df7fe640 1 --2- 172.21.15.17:0/208525884 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe5e00d0b80 0x7fe5e0150780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:32.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.498+0000 7fe5df7fe640 1 -- 172.21.15.17:0/208525884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5e00cabb0 msgr2=0x7fe5e00b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:32.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.498+0000 7fe5df7fe640 1 --2- 172.21.15.17:0/208525884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5e00cabb0 0x7fe5e00b4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:32.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.498+0000 7fe5df7fe640 1 -- 172.21.15.17:0/208525884 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5e014ec50 con 0x7fe5e00d07a0 2024-09-05T07:29:32.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.500+0000 7fe5df7fe640 1 --2- 172.21.15.17:0/208525884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5e00d07a0 0x7fe5e014f960 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe5d4000c00 tx=0x7fe5d40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:32.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.504+0000 7fe5dcff9640 1 -- 172.21.15.17:0/208525884 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d4037040 con 0x7fe5e00d07a0 2024-09-05T07:29:32.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.504+0000 7fe5dcff9640 1 -- 172.21.15.17:0/208525884 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5d4042070 con 0x7fe5e00d07a0 2024-09-05T07:29:32.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.504+0000 7fe5e6a1e640 1 -- 172.21.15.17:0/208525884 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5e00c76d0 con 0x7fe5e00d07a0 2024-09-05T07:29:32.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.504+0000 7fe5dcff9640 1 -- 172.21.15.17:0/208525884 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d4030940 con 0x7fe5e00d07a0 2024-09-05T07:29:32.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.504+0000 7fe5e6a1e640 1 -- 172.21.15.17:0/208525884 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5e00c7c90 con 0x7fe5e00d07a0 2024-09-05T07:29:32.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.505+0000 7fe5e6a1e640 1 -- 172.21.15.17:0/208525884 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5e0154140 con 0x7fe5e00d07a0 2024-09-05T07:29:32.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.782+0000 7fe5dcff9640 1 -- 172.21.15.17:0/208525884 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe5d4030ae0 con 0x7fe5e00d07a0 2024-09-05T07:29:32.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.782+0000 7fe5dcff9640 1 --2- 172.21.15.17:0/208525884 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fe5cc06be80 0x7fe5cc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:32.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.782+0000 7fe5dffff640 1 --2- 172.21.15.17:0/208525884 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fe5cc06be80 0x7fe5cc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:32.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.783+0000 7fe5dffff640 1 --2- 172.21.15.17:0/208525884 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fe5cc06be80 0x7fe5cc06e340 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0009aa0 tx=0x7fe5d0009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:32.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.785+0000 7fe5dcff9640 1 -- 172.21.15.17:0/208525884 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe5d4030dd0 con 0x7fe5e00d07a0 2024-09-05T07:29:32.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:32.797+0000 7fe5dcff9640 1 -- 172.21.15.17:0/208525884 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe5e0154140 con 0x7fe5e00d07a0 2024-09-05T07:29:33.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:33.019+0000 7fe5e6a1e640 1 -- 172.21.15.17:0/208525884 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe5e015dc90 con 0x7fe5e00d07a0 2024-09-05T07:29:34.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.103+0000 7fe5dcff9640 1 -- 172.21.15.17:0/208525884 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7fe5e015dc90 con 0x7fe5e00d07a0 2024-09-05T07:29:34.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.105+0000 7fe5e6a1e640 1 -- 172.21.15.17:0/208525884 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fe5cc06be80 msgr2=0x7fe5cc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:34.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.105+0000 7fe5e6a1e640 1 --2- 172.21.15.17:0/208525884 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fe5cc06be80 0x7fe5cc06e340 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0009aa0 tx=0x7fe5d0009190 comp rx=0 tx=0).stop 2024-09-05T07:29:34.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.105+0000 7fe5e6a1e640 1 -- 172.21.15.17:0/208525884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5e00d07a0 msgr2=0x7fe5e014f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:34.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.105+0000 7fe5e6a1e640 1 --2- 172.21.15.17:0/208525884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5e00d07a0 0x7fe5e014f960 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe5d4000c00 tx=0x7fe5d40046c0 comp rx=0 tx=0).stop 2024-09-05T07:29:34.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.105+0000 7fe5e6a1e640 1 -- 172.21.15.17:0/208525884 shutdown_connections 2024-09-05T07:29:34.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.105+0000 7fe5e6a1e640 1 --2- 172.21.15.17:0/208525884 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fe5cc06be80 0x7fe5cc06e340 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:34.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.105+0000 7fe5e6a1e640 1 --2- 172.21.15.17:0/208525884 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe5e00d0b80 0x7fe5e0150780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:34.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.105+0000 7fe5e6a1e640 1 --2- 172.21.15.17:0/208525884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5e00d07a0 0x7fe5e014f960 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:34.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.105+0000 7fe5e6a1e640 1 --2- 172.21.15.17:0/208525884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5e00cabb0 0x7fe5e00b4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:34.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.105+0000 7fe5e6a1e640 1 -- 172.21.15.17:0/208525884 >> 172.21.15.17:0/208525884 conn(0x7fe5e0073710 msgr2=0x7fe5e0073af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:34.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.105+0000 7fe5e6a1e640 1 -- 172.21.15.17:0/208525884 shutdown_connections 2024-09-05T07:29:34.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.105+0000 7fe5e6a1e640 1 -- 172.21.15.17:0/208525884 wait complete. 2024-09-05T07:29:34.117 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300} 2024-09-05T07:29:34.118 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-09-05T07:29:34.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.229+0000 7f2ce9fd6640 1 Processor -- start 2024-09-05T07:29:34.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.229+0000 7f2ce9fd6640 1 -- start start 2024-09-05T07:29:34.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.230+0000 7f2ce9fd6640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2ce4154bc0 0x7f2ce415de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:34.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.230+0000 7f2ce9fd6640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2ce415b650 0x7f2ce406c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:34.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.230+0000 7f2ce9fd6640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ce415a8f0 con 0x7f2ce40cda50 2024-09-05T07:29:34.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.230+0000 7f2ce9fd6640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f2ce40cae30 con 0x7f2ce415b650 2024-09-05T07:29:34.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.230+0000 7f2ce9fd6640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f2ce40cc710 con 0x7f2ce4154bc0 2024-09-05T07:29:34.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.230+0000 7f2ce2ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2ce415b650 0x7f2ce406c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:34.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.230+0000 7f2ce37fe640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2ce4154bc0 0x7f2ce415de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:34.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.230+0000 7f2ce3fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2ce40cda50 0x7f2ce40d0290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.17:35182/0 (socket says 172.21.15.17:35182) 2024-09-05T07:29:34.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.230+0000 7f2ce3fff640 1 -- 172.21.15.17:0/894879606 learned_addr learned my addr 172.21.15.17:0/894879606 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:29:34.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.233+0000 7f2ce37fe640 1 -- 172.21.15.17:0/894879606 >> v2:172.21.15.17:3300/0 conn(0x7f2ce415b650 msgr2=0x7f2ce406c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:34.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.233+0000 7f2ce37fe640 1 --2- 172.21.15.17:0/894879606 >> v2:172.21.15.17:3300/0 conn(0x7f2ce415b650 0x7f2ce406c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:34.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.233+0000 7f2ce37fe640 1 -- 172.21.15.17:0/894879606 >> v1:172.21.15.26:6789/0 conn(0x7f2ce40cda50 legacy=0x7f2ce40d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:34.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.233+0000 7f2ce37fe640 1 -- 172.21.15.17:0/894879606 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce40cc9f0 con 0x7f2ce4154bc0 2024-09-05T07:29:34.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.235+0000 7f2ce37fe640 1 --2- 172.21.15.17:0/894879606 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2ce4154bc0 0x7f2ce415de60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2cd40097a0 tx=0x7f2cd402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ef4d131d9d2c883 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:34.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.238+0000 7f2ce27fc640 1 -- 172.21.15.17:0/894879606 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4037070 con 0x7f2ce4154bc0 2024-09-05T07:29:34.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.238+0000 7f2ce27fc640 1 -- 172.21.15.17:0/894879606 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cd4032440 con 0x7f2ce4154bc0 2024-09-05T07:29:34.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.238+0000 7f2ce27fc640 1 -- 172.21.15.17:0/894879606 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4032810 con 0x7f2ce4154bc0 2024-09-05T07:29:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.239+0000 7f2ce9fd6640 1 -- 172.21.15.17:0/894879606 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2ce4154bc0 msgr2=0x7f2ce415de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.239+0000 7f2ce9fd6640 1 --2- 172.21.15.17:0/894879606 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2ce4154bc0 0x7f2ce415de60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2cd40097a0 tx=0x7f2cd402a180 comp rx=0 tx=0).stop 2024-09-05T07:29:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.239+0000 7f2ce9fd6640 1 -- 172.21.15.17:0/894879606 shutdown_connections 2024-09-05T07:29:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.239+0000 7f2ce9fd6640 1 --2- 172.21.15.17:0/894879606 >> v2:172.21.15.17:3300/0 conn(0x7f2ce415b650 0x7f2ce406c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.239+0000 7f2ce9fd6640 1 --2- 172.21.15.17:0/894879606 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2ce4154bc0 0x7f2ce415de60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:34.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.239+0000 7f2ce9fd6640 1 -- 172.21.15.17:0/894879606 >> 172.21.15.17:0/894879606 conn(0x7f2ce40738d0 msgr2=0x7f2ce4073ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:34.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.239+0000 7f2ce9fd6640 1 -- 172.21.15.17:0/894879606 shutdown_connections 2024-09-05T07:29:34.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.239+0000 7f2ce9fd6640 1 -- 172.21.15.17:0/894879606 wait complete. 2024-09-05T07:29:34.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.240+0000 7f2ce9fd6640 1 Processor -- start 2024-09-05T07:29:34.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.240+0000 7f2ce9fd6640 1 -- start start 2024-09-05T07:29:34.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.241+0000 7f2ce9fd6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ce40cda50 0x7f2ce4156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:34.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.241+0000 7f2ce9fd6640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2ce4154bc0 0x7f2ce41f0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:34.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.241+0000 7f2ce9fd6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ce415b650 0x7f2ce40c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:34.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.241+0000 7f2ce9fd6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce415b130 con 0x7f2ce40cda50 2024-09-05T07:29:34.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.241+0000 7f2ce9fd6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce415ae50 con 0x7f2ce415b650 2024-09-05T07:29:34.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.241+0000 7f2ce9fd6640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f2ce415e3a0 con 0x7f2ce4154bc0 2024-09-05T07:29:34.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.242+0000 7f2ce37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ce40cda50 0x7f2ce4156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:34.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.242+0000 7f2ce2ffd640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2ce4154bc0 0x7f2ce41f0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:34.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.242+0000 7f2ce3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ce415b650 0x7f2ce40c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:34.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.242+0000 7f2ce2ffd640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2ce4154bc0 0x7f2ce41f0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:58798/0 (socket says 172.21.15.17:58798) 2024-09-05T07:29:34.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.242+0000 7f2ce37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ce40cda50 0x7f2ce4156660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59748/0 (socket says 172.21.15.17:59748) 2024-09-05T07:29:34.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.242+0000 7f2ce2ffd640 1 -- 172.21.15.17:0/2613372692 learned_addr learned my addr 172.21.15.17:0/2613372692 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:34.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.245+0000 7f2ce2ffd640 1 -- 172.21.15.17:0/2613372692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ce415b650 msgr2=0x7f2ce40c9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:34.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.245+0000 7f2ce2ffd640 1 --2- 172.21.15.17:0/2613372692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ce415b650 0x7f2ce40c9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:34.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.245+0000 7f2ce2ffd640 1 -- 172.21.15.17:0/2613372692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ce40cda50 msgr2=0x7f2ce4156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:34.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.245+0000 7f2ce2ffd640 1 --2- 172.21.15.17:0/2613372692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ce40cda50 0x7f2ce4156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:34.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.245+0000 7f2ce2ffd640 1 -- 172.21.15.17:0/2613372692 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce415a320 con 0x7f2ce4154bc0 2024-09-05T07:29:34.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.247+0000 7f2ce2ffd640 1 --2- 172.21.15.17:0/2613372692 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2ce4154bc0 0x7f2ce41f0d30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2cd800e840 tx=0x7f2cd800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:34.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.251+0000 7f2ccbfff640 1 -- 172.21.15.17:0/2613372692 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd8017070 con 0x7f2ce4154bc0 2024-09-05T07:29:34.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.251+0000 7f2ccbfff640 1 -- 172.21.15.17:0/2613372692 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cd800c940 con 0x7f2ce4154bc0 2024-09-05T07:29:34.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.251+0000 7f2ce9fd6640 1 -- 172.21.15.17:0/2613372692 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ce4155680 con 0x7f2ce4154bc0 2024-09-05T07:29:34.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.251+0000 7f2ccbfff640 1 -- 172.21.15.17:0/2613372692 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd800cd10 con 0x7f2ce4154bc0 2024-09-05T07:29:34.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.251+0000 7f2ce9fd6640 1 -- 172.21.15.17:0/2613372692 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ce415a040 con 0x7f2ce4154bc0 2024-09-05T07:29:34.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.252+0000 7f2ce9fd6640 1 -- 172.21.15.17:0/2613372692 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ce4154fa0 con 0x7f2ce4154bc0 2024-09-05T07:29:34.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.274+0000 7f2ccbfff640 1 -- 172.21.15.17:0/2613372692 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2cd801a070 con 0x7f2ce4154bc0 2024-09-05T07:29:34.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.274+0000 7f2ccbfff640 1 --2- 172.21.15.17:0/2613372692 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f2cd006be80 0x7f2cd006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:34.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.275+0000 7f2ce37fe640 1 --2- 172.21.15.17:0/2613372692 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f2cd006be80 0x7f2cd006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:34.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.275+0000 7f2ce37fe640 1 --2- 172.21.15.17:0/2613372692 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f2cd006be80 0x7f2cd006e340 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4034000 tx=0x7f2cd402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:34.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.277+0000 7f2ccbfff640 1 -- 172.21.15.17:0/2613372692 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f2cd8057820 con 0x7f2ce4154bc0 2024-09-05T07:29:34.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.537+0000 7f2ccbfff640 1 -- 172.21.15.17:0/2613372692 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2cd8059780 con 0x7f2ce4154bc0 2024-09-05T07:29:34.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:34.747+0000 7f2ce9fd6640 1 -- 172.21.15.17:0/2613372692 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f2ce4155a30 con 0x7f2ce4154bc0 2024-09-05T07:29:35.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.287+0000 7f2ccbfff640 1 -- 172.21.15.17:0/2613372692 <== mon.2 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v8) ==== 105+0+0 (secure 0 0 0) 0x7f2cd805da80 con 0x7f2ce4154bc0 2024-09-05T07:29:35.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.289+0000 7f2ce9fd6640 1 -- 172.21.15.17:0/2613372692 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f2cd006be80 msgr2=0x7f2cd006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:35.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.289+0000 7f2ce9fd6640 1 --2- 172.21.15.17:0/2613372692 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f2cd006be80 0x7f2cd006e340 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4034000 tx=0x7f2cd402e000 comp rx=0 tx=0).stop 2024-09-05T07:29:35.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.289+0000 7f2ce9fd6640 1 -- 172.21.15.17:0/2613372692 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2ce4154bc0 msgr2=0x7f2ce41f0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:35.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.289+0000 7f2ce9fd6640 1 --2- 172.21.15.17:0/2613372692 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2ce4154bc0 0x7f2ce41f0d30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2cd800e840 tx=0x7f2cd800ed00 comp rx=0 tx=0).stop 2024-09-05T07:29:35.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.289+0000 7f2ce9fd6640 1 -- 172.21.15.17:0/2613372692 shutdown_connections 2024-09-05T07:29:35.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.289+0000 7f2ce9fd6640 1 --2- 172.21.15.17:0/2613372692 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f2cd006be80 0x7f2cd006e340 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:35.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.289+0000 7f2ce9fd6640 1 --2- 172.21.15.17:0/2613372692 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2ce4154bc0 0x7f2ce41f0d30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:35.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.289+0000 7f2ce9fd6640 1 --2- 172.21.15.17:0/2613372692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ce415b650 0x7f2ce40c9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:35.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.289+0000 7f2ce9fd6640 1 --2- 172.21.15.17:0/2613372692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ce40cda50 0x7f2ce4156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:35.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.289+0000 7f2ce9fd6640 1 -- 172.21.15.17:0/2613372692 >> 172.21.15.17:0/2613372692 conn(0x7f2ce40738d0 msgr2=0x7f2ce4158550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:35.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.289+0000 7f2ce9fd6640 1 -- 172.21.15.17:0/2613372692 shutdown_connections 2024-09-05T07:29:35.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.289+0000 7f2ce9fd6640 1 -- 172.21.15.17:0/2613372692 wait complete. 2024-09-05T07:29:35.303 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-05T07:29:35.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.407+0000 7fde011f6640 1 Processor -- start 2024-09-05T07:29:35.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.407+0000 7fde011f6640 1 -- start start 2024-09-05T07:29:35.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.408+0000 7fde011f6640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fddfc14f420 0x7fddfc0c3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:35.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.408+0000 7fde011f6640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddfc0c82d0 0x7fddfc0c35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:35.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.408+0000 7fde011f6640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddfc14f800 con 0x7fddfc0c4f90 2024-09-05T07:29:35.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.408+0000 7fde011f6640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fddfc0c9410 con 0x7fddfc14f420 2024-09-05T07:29:35.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.408+0000 7fde011f6640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fddfc0c9660 con 0x7fddfc0c82d0 2024-09-05T07:29:35.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.409+0000 7fddfad9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fddfc14f420 0x7fddfc0c3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:35.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.409+0000 7fddfad9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fddfc14f420 0x7fddfc0c3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59756/0 (socket says 172.21.15.17:59756) 2024-09-05T07:29:35.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.409+0000 7fddfad9d640 1 -- 172.21.15.17:0/1763191456 learned_addr learned my addr 172.21.15.17:0/1763191456 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:35.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.411+0000 7fddfad9d640 1 -- 172.21.15.17:0/1763191456 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddfc0c82d0 msgr2=0x7fddfc0c35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:35.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.411+0000 7fddfad9d640 1 --2- 172.21.15.17:0/1763191456 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddfc0c82d0 0x7fddfc0c35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:35.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.411+0000 7fddfad9d640 1 -- 172.21.15.17:0/1763191456 >> v1:172.21.15.26:6789/0 conn(0x7fddfc0c4f90 legacy=0x7fddfc158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:35.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.411+0000 7fddfad9d640 1 -- 172.21.15.17:0/1763191456 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddfc0c9940 con 0x7fddfc14f420 2024-09-05T07:29:35.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.413+0000 7fddfad9d640 1 --2- 172.21.15.17:0/1763191456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddfc14f420 0x7fddfc0c3080 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fddf40098a0 tx=0x7fddf402a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb2af31034ced383 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:35.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.421+0000 7fddf9d9b640 1 -- 172.21.15.17:0/1763191456 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf4037070 con 0x7fddfc14f420 2024-09-05T07:29:35.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.422+0000 7fddf9d9b640 1 -- 172.21.15.17:0/1763191456 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddf4032440 con 0x7fddfc14f420 2024-09-05T07:29:35.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.422+0000 7fddf9d9b640 1 -- 172.21.15.17:0/1763191456 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf4032810 con 0x7fddfc14f420 2024-09-05T07:29:35.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.422+0000 7fde011f6640 1 -- 172.21.15.17:0/1763191456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddfc14f420 msgr2=0x7fddfc0c3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:35.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.422+0000 7fde011f6640 1 --2- 172.21.15.17:0/1763191456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddfc14f420 0x7fddfc0c3080 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fddf40098a0 tx=0x7fddf402a290 comp rx=0 tx=0).stop 2024-09-05T07:29:35.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.422+0000 7fde011f6640 1 -- 172.21.15.17:0/1763191456 shutdown_connections 2024-09-05T07:29:35.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.422+0000 7fde011f6640 1 --2- 172.21.15.17:0/1763191456 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddfc0c82d0 0x7fddfc0c35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:35.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.422+0000 7fde011f6640 1 --2- 172.21.15.17:0/1763191456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddfc14f420 0x7fddfc0c3080 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:35.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.422+0000 7fde011f6640 1 -- 172.21.15.17:0/1763191456 >> 172.21.15.17:0/1763191456 conn(0x7fddfc071450 msgr2=0x7fddfc071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:35.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.422+0000 7fde011f6640 1 -- 172.21.15.17:0/1763191456 shutdown_connections 2024-09-05T07:29:35.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.422+0000 7fde011f6640 1 -- 172.21.15.17:0/1763191456 wait complete. 2024-09-05T07:29:35.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.424+0000 7fde011f6640 1 Processor -- start 2024-09-05T07:29:35.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.424+0000 7fde011f6640 1 -- start start 2024-09-05T07:29:35.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.425+0000 7fde011f6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddfc0c4f90 0x7fddfc1f4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:35.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.425+0000 7fde011f6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddfc0c82d0 0x7fddfc0c5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:35.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.425+0000 7fde011f6640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddfc14f420 0x7fddfc0c5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:35.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.425+0000 7fde011f6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fddfc0701b0 con 0x7fddfc0c82d0 2024-09-05T07:29:35.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.425+0000 7fde011f6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fddfc0c9f00 con 0x7fddfc0c4f90 2024-09-05T07:29:35.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.425+0000 7fde011f6640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fddfc070330 con 0x7fddfc14f420 2024-09-05T07:29:35.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.427+0000 7fddfad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddfc0c4f90 0x7fddfc1f4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:35.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.427+0000 7fddfad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddfc0c4f90 0x7fddfc1f4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:51962/0 (socket says 172.21.15.17:51962) 2024-09-05T07:29:35.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.427+0000 7fddfad9d640 1 -- 172.21.15.17:0/4058174671 learned_addr learned my addr 172.21.15.17:0/4058174671 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:35.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.427+0000 7fddfb59e640 1 --2- 172.21.15.17:0/4058174671 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddfc14f420 0x7fddfc0c5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:35.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.429+0000 7fddfa59c640 1 --2- 172.21.15.17:0/4058174671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddfc0c82d0 0x7fddfc0c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:35.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.431+0000 7fddfad9d640 1 -- 172.21.15.17:0/4058174671 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddfc14f420 msgr2=0x7fddfc0c5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:35.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.431+0000 7fddfad9d640 1 --2- 172.21.15.17:0/4058174671 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddfc14f420 0x7fddfc0c5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:35.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.431+0000 7fddfad9d640 1 -- 172.21.15.17:0/4058174671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddfc0c82d0 msgr2=0x7fddfc0c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:35.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.431+0000 7fddfad9d640 1 --2- 172.21.15.17:0/4058174671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddfc0c82d0 0x7fddfc0c5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:35.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.431+0000 7fddfad9d640 1 -- 172.21.15.17:0/4058174671 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddfc1f03e0 con 0x7fddfc0c4f90 2024-09-05T07:29:35.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.433+0000 7fddfad9d640 1 --2- 172.21.15.17:0/4058174671 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddfc0c4f90 0x7fddfc1f4300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fddf4000c00 tx=0x7fddf40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:35.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.437+0000 7fddf37fe640 1 -- 172.21.15.17:0/4058174671 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf4041070 con 0x7fddfc0c4f90 2024-09-05T07:29:35.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.437+0000 7fddf37fe640 1 -- 172.21.15.17:0/4058174671 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddf403c870 con 0x7fddfc0c4f90 2024-09-05T07:29:35.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.437+0000 7fde011f6640 1 -- 172.21.15.17:0/4058174671 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddfc1f4840 con 0x7fddfc0c4f90 2024-09-05T07:29:35.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.437+0000 7fddf37fe640 1 -- 172.21.15.17:0/4058174671 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf4037040 con 0x7fddfc0c4f90 2024-09-05T07:29:35.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.437+0000 7fde011f6640 1 -- 172.21.15.17:0/4058174671 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddfc1f3ad0 con 0x7fddfc0c4f90 2024-09-05T07:29:35.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.438+0000 7fde011f6640 1 -- 172.21.15.17:0/4058174671 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddfc0c8a60 con 0x7fddfc0c4f90 2024-09-05T07:29:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.456+0000 7fddf37fe640 1 -- 172.21.15.17:0/4058174671 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fddf4044070 con 0x7fddfc0c4f90 2024-09-05T07:29:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.457+0000 7fddf37fe640 1 --2- 172.21.15.17:0/4058174671 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fdddc06be80 0x7fdddc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.457+0000 7fddfa59c640 1 --2- 172.21.15.17:0/4058174671 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fdddc06be80 0x7fdddc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:35.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.458+0000 7fddfa59c640 1 --2- 172.21.15.17:0/4058174671 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fdddc06be80 0x7fdddc06e340 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fddfc152f10 tx=0x7fdde4009060 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:35.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.459+0000 7fddf37fe640 1 -- 172.21.15.17:0/4058174671 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fddf40780f0 con 0x7fddfc0c4f90 2024-09-05T07:29:35.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.737+0000 7fddf37fe640 1 -- 172.21.15.17:0/4058174671 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fddfc1f03e0 con 0x7fddfc0c4f90 2024-09-05T07:29:35.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:35.947+0000 7fde011f6640 1 -- 172.21.15.17:0/4058174671 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fddfc156a30 con 0x7fddfc0c4f90 2024-09-05T07:29:36.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.550+0000 7fddf37fe640 1 -- 172.21.15.17:0/4058174671 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fddf407a050 con 0x7fddfc0c4f90 2024-09-05T07:29:36.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.552+0000 7fde011f6640 1 -- 172.21.15.17:0/4058174671 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fdddc06be80 msgr2=0x7fdddc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:36.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.552+0000 7fde011f6640 1 --2- 172.21.15.17:0/4058174671 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fdddc06be80 0x7fdddc06e340 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fddfc152f10 tx=0x7fdde4009060 comp rx=0 tx=0).stop 2024-09-05T07:29:36.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.552+0000 7fde011f6640 1 -- 172.21.15.17:0/4058174671 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddfc0c4f90 msgr2=0x7fddfc1f4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:36.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.552+0000 7fde011f6640 1 --2- 172.21.15.17:0/4058174671 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddfc0c4f90 0x7fddfc1f4300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fddf4000c00 tx=0x7fddf40046c0 comp rx=0 tx=0).stop 2024-09-05T07:29:36.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.552+0000 7fde011f6640 1 -- 172.21.15.17:0/4058174671 shutdown_connections 2024-09-05T07:29:36.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.552+0000 7fde011f6640 1 --2- 172.21.15.17:0/4058174671 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fdddc06be80 0x7fdddc06e340 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:36.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.552+0000 7fde011f6640 1 --2- 172.21.15.17:0/4058174671 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddfc14f420 0x7fddfc0c5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:36.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.552+0000 7fde011f6640 1 --2- 172.21.15.17:0/4058174671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddfc0c82d0 0x7fddfc0c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:36.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.552+0000 7fde011f6640 1 --2- 172.21.15.17:0/4058174671 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddfc0c4f90 0x7fddfc1f4300 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:36.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.552+0000 7fde011f6640 1 -- 172.21.15.17:0/4058174671 >> 172.21.15.17:0/4058174671 conn(0x7fddfc071450 msgr2=0x7fddfc158c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:36.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.552+0000 7fde011f6640 1 -- 172.21.15.17:0/4058174671 shutdown_connections 2024-09-05T07:29:36.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.552+0000 7fde011f6640 1 -- 172.21.15.17:0/4058174671 wait complete. 2024-09-05T07:29:36.563 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-09-05T07:29:36.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.667+0000 7f52f5331640 1 Processor -- start 2024-09-05T07:29:36.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.667+0000 7f52f5331640 1 -- start start 2024-09-05T07:29:36.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.668+0000 7f52f5331640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f52f00cd2d0 0x7f52f0157800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:36.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.668+0000 7f52f5331640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52f00b3b20 con 0x7f52f0157d40 2024-09-05T07:29:36.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.668+0000 7f52f5331640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52f015b590 con 0x7f52f00ccef0 2024-09-05T07:29:36.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.668+0000 7f52f5331640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f52f00b2d60 con 0x7f52f00cd2d0 2024-09-05T07:29:36.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.668+0000 7f52ef7fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f52f0157d40 0x7f52f015a820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54142/0 (socket says 172.21.15.17:54142) 2024-09-05T07:29:36.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.668+0000 7f52ef7fe640 1 -- 172.21.15.17:0/2730577393 learned_addr learned my addr 172.21.15.17:0/2730577393 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:29:36.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.669+0000 7f52e7fff640 1 --2- 172.21.15.17:0/2730577393 >> v2:172.21.15.26:3300/0 conn(0x7f52f00cd2d0 0x7f52f0157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:36.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.671+0000 7f52ee7fc640 1 -- 172.21.15.17:0/2730577393 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3220361365 0 0) 0x7f52f00b3b20 con 0x7f52f0157d40 2024-09-05T07:29:36.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.671+0000 7f52ee7fc640 1 -- 172.21.15.17:0/2730577393 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52dc003520 con 0x7f52f0157d40 2024-09-05T07:29:36.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.672+0000 7f52e7fff640 1 -- 172.21.15.17:0/2730577393 >> v1:172.21.15.26:6789/0 conn(0x7f52f00ccef0 legacy=0x7f52f00b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:36.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.672+0000 7f52e7fff640 1 -- 172.21.15.17:0/2730577393 >> v1:172.21.15.17:6789/0 conn(0x7f52f0157d40 legacy=0x7f52f015a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:36.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.672+0000 7f52e7fff640 1 -- 172.21.15.17:0/2730577393 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52f00b3040 con 0x7f52f00cd2d0 2024-09-05T07:29:36.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.676+0000 7f52e7fff640 1 --2- 172.21.15.17:0/2730577393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52f00cd2d0 0x7f52f0157800 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f52d80097d0 tx=0x7f52d802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91219a7da5c74130 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:36.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.680+0000 7f52ee7fc640 1 -- 172.21.15.17:0/2730577393 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d8037070 con 0x7f52f00cd2d0 2024-09-05T07:29:36.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.680+0000 7f52ee7fc640 1 -- 172.21.15.17:0/2730577393 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d8032440 con 0x7f52f00cd2d0 2024-09-05T07:29:36.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.680+0000 7f52ee7fc640 1 -- 172.21.15.17:0/2730577393 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d8032810 con 0x7f52f00cd2d0 2024-09-05T07:29:36.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.681+0000 7f52f5331640 1 -- 172.21.15.17:0/2730577393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52f00cd2d0 msgr2=0x7f52f0157800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:36.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.681+0000 7f52f5331640 1 --2- 172.21.15.17:0/2730577393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52f00cd2d0 0x7f52f0157800 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f52d80097d0 tx=0x7f52d802a270 comp rx=0 tx=0).stop 2024-09-05T07:29:36.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.681+0000 7f52f5331640 1 -- 172.21.15.17:0/2730577393 shutdown_connections 2024-09-05T07:29:36.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.681+0000 7f52f5331640 1 --2- 172.21.15.17:0/2730577393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52f00cd2d0 0x7f52f0157800 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:36.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.681+0000 7f52f5331640 1 -- 172.21.15.17:0/2730577393 >> 172.21.15.17:0/2730577393 conn(0x7f52f0072230 msgr2=0x7f52f0072640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:36.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.681+0000 7f52f5331640 1 -- 172.21.15.17:0/2730577393 shutdown_connections 2024-09-05T07:29:36.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.681+0000 7f52f5331640 1 -- 172.21.15.17:0/2730577393 wait complete. 2024-09-05T07:29:36.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.682+0000 7f52f5331640 1 Processor -- start 2024-09-05T07:29:36.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.682+0000 7f52f5331640 1 -- start start 2024-09-05T07:29:36.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.683+0000 7f52f5331640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52f00ccef0 0x7f52f01f3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:36.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.683+0000 7f52f5331640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f52f00cd2d0 0x7f52f0155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:36.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.683+0000 7f52f5331640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52f0157d40 0x7f52f01e7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:36.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.683+0000 7f52f5331640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f52f00b4580 con 0x7f52f00ccef0 2024-09-05T07:29:36.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.683+0000 7f52f5331640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f52f00b3600 con 0x7f52f0157d40 2024-09-05T07:29:36.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.683+0000 7f52f5331640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f52f01581d0 con 0x7f52f00cd2d0 2024-09-05T07:29:36.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.683+0000 7f52eeffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52f00ccef0 0x7f52f01f3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:36.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.683+0000 7f52ef7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52f0157d40 0x7f52f01e7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:36.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.683+0000 7f52e7fff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f52f00cd2d0 0x7f52f0155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:36.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.683+0000 7f52eeffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52f00ccef0 0x7f52f01f3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59780/0 (socket says 172.21.15.17:59780) 2024-09-05T07:29:36.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.683+0000 7f52eeffd640 1 -- 172.21.15.17:0/2032797713 learned_addr learned my addr 172.21.15.17:0/2032797713 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:36.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.687+0000 7f52ef7fe640 1 -- 172.21.15.17:0/2032797713 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f52f00cd2d0 msgr2=0x7f52f0155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:36.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.687+0000 7f52ef7fe640 1 --2- 172.21.15.17:0/2032797713 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f52f00cd2d0 0x7f52f0155080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:36.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.687+0000 7f52ef7fe640 1 -- 172.21.15.17:0/2032797713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52f00ccef0 msgr2=0x7f52f01f3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:36.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.687+0000 7f52ef7fe640 1 --2- 172.21.15.17:0/2032797713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52f00ccef0 0x7f52f01f3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:36.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.687+0000 7f52ef7fe640 1 -- 172.21.15.17:0/2032797713 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52f01e6af0 con 0x7f52f0157d40 2024-09-05T07:29:36.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.689+0000 7f52ef7fe640 1 --2- 172.21.15.17:0/2032797713 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52f0157d40 0x7f52f01e7250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f52e800cab0 tx=0x7f52e800cf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:36.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.693+0000 7f52e77fe640 1 -- 172.21.15.17:0/2032797713 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e8017070 con 0x7f52f0157d40 2024-09-05T07:29:36.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.693+0000 7f52e77fe640 1 -- 172.21.15.17:0/2032797713 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52e800ac30 con 0x7f52f0157d40 2024-09-05T07:29:36.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.693+0000 7f52e77fe640 1 -- 172.21.15.17:0/2032797713 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e8012600 con 0x7f52f0157d40 2024-09-05T07:29:36.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.693+0000 7f52f5331640 1 -- 172.21.15.17:0/2032797713 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52f01f12e0 con 0x7f52f0157d40 2024-09-05T07:29:36.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.693+0000 7f52f5331640 1 -- 172.21.15.17:0/2032797713 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52f01e6020 con 0x7f52f0157d40 2024-09-05T07:29:36.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.694+0000 7f52f5331640 1 -- 172.21.15.17:0/2032797713 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52f01f14b0 con 0x7f52f0157d40 2024-09-05T07:29:36.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.969+0000 7f52e77fe640 1 -- 172.21.15.17:0/2032797713 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f52e801a070 con 0x7f52f0157d40 2024-09-05T07:29:36.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.969+0000 7f52e77fe640 1 --2- 172.21.15.17:0/2032797713 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f52d006be80 0x7f52d006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:36.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.970+0000 7f52eeffd640 1 --2- 172.21.15.17:0/2032797713 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f52d006be80 0x7f52d006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:36.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.970+0000 7f52eeffd640 1 --2- 172.21.15.17:0/2032797713 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f52d006be80 0x7f52d006e340 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f52e00017a0 tx=0x7f52e0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:36.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.973+0000 7f52e77fe640 1 -- 172.21.15.17:0/2032797713 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f52e8057450 con 0x7f52f0157d40 2024-09-05T07:29:36.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:36.985+0000 7f52e77fe640 1 -- 172.21.15.17:0/2032797713 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f52e800ae20 con 0x7f52f0157d40 2024-09-05T07:29:37.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:37.201+0000 7f52f5331640 1 -- 172.21.15.17:0/2032797713 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f52f015dee0 con 0x7f52f0157d40 2024-09-05T07:29:37.302 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:29:37.305 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:29:38.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.303+0000 7f52e77fe640 1 -- 172.21.15.17:0/2032797713 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v11) ==== 115+0+0 (secure 0 0 0) 0x7f52e80593b0 con 0x7f52f0157d40 2024-09-05T07:29:38.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.304+0000 7f52f5331640 1 -- 172.21.15.17:0/2032797713 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f52d006be80 msgr2=0x7f52d006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:38.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.304+0000 7f52f5331640 1 --2- 172.21.15.17:0/2032797713 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f52d006be80 0x7f52d006e340 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f52e00017a0 tx=0x7f52e0009040 comp rx=0 tx=0).stop 2024-09-05T07:29:38.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.304+0000 7f52f5331640 1 -- 172.21.15.17:0/2032797713 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52f0157d40 msgr2=0x7f52f01e7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:38.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.304+0000 7f52f5331640 1 --2- 172.21.15.17:0/2032797713 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52f0157d40 0x7f52f01e7250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f52e800cab0 tx=0x7f52e800cf70 comp rx=0 tx=0).stop 2024-09-05T07:29:38.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.304+0000 7f52f5331640 1 -- 172.21.15.17:0/2032797713 shutdown_connections 2024-09-05T07:29:38.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.304+0000 7f52f5331640 1 --2- 172.21.15.17:0/2032797713 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f52d006be80 0x7f52d006e340 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:38.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.304+0000 7f52f5331640 1 --2- 172.21.15.17:0/2032797713 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f52f00cd2d0 0x7f52f0155080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:38.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.304+0000 7f52f5331640 1 --2- 172.21.15.17:0/2032797713 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52f0157d40 0x7f52f01e7250 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:38.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.304+0000 7f52f5331640 1 --2- 172.21.15.17:0/2032797713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52f00ccef0 0x7f52f01f3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:38.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.305+0000 7f52f5331640 1 -- 172.21.15.17:0/2032797713 >> 172.21.15.17:0/2032797713 conn(0x7f52f0072230 msgr2=0x7f52f00b3d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:38.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.305+0000 7f52f5331640 1 -- 172.21.15.17:0/2032797713 shutdown_connections 2024-09-05T07:29:38.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.305+0000 7f52f5331640 1 -- 172.21.15.17:0/2032797713 wait complete. 2024-09-05T07:29:38.319 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-05T07:29:38.319 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-05T07:29:38.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.422+0000 7f29e189b640 1 Processor -- start 2024-09-05T07:29:38.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.422+0000 7f29e189b640 1 -- start start 2024-09-05T07:29:38.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.423+0000 7f29e189b640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29dc0ce7e0 0x7f29dc0705d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:38.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.423+0000 7f29e189b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f29dc0b0c00 0x7f29dc157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:38.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.423+0000 7f29e189b640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29dc0c9ce0 con 0x7f29dc0ce400 2024-09-05T07:29:38.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.423+0000 7f29e189b640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f29dc15df70 con 0x7f29dc0b0c00 2024-09-05T07:29:38.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.423+0000 7f29e189b640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f29dc070140 con 0x7f29dc0ce7e0 2024-09-05T07:29:38.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.425+0000 7f29da7fc640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29dc0ce7e0 0x7f29dc0705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:38.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.425+0000 7f29da7fc640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29dc0ce7e0 0x7f29dc0705d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:58830/0 (socket says 172.21.15.17:58830) 2024-09-05T07:29:38.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.425+0000 7f29da7fc640 1 -- 172.21.15.17:0/1305517529 learned_addr learned my addr 172.21.15.17:0/1305517529 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:38.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.428+0000 7f29db7fe640 1 --2- 172.21.15.17:0/1305517529 >> v2:172.21.15.26:3300/0 conn(0x7f29dc0b0c00 0x7f29dc157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:38.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.428+0000 7f29da7fc640 1 -- 172.21.15.17:0/1305517529 >> v2:172.21.15.26:3300/0 conn(0x7f29dc0b0c00 msgr2=0x7f29dc157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:38.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.428+0000 7f29da7fc640 1 --2- 172.21.15.17:0/1305517529 >> v2:172.21.15.26:3300/0 conn(0x7f29dc0b0c00 0x7f29dc157ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:38.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.428+0000 7f29da7fc640 1 -- 172.21.15.17:0/1305517529 >> v1:172.21.15.26:6789/0 conn(0x7f29dc0ce400 legacy=0x7f29dc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:38.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.428+0000 7f29da7fc640 1 -- 172.21.15.17:0/1305517529 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29dc0c9440 con 0x7f29dc0ce7e0 2024-09-05T07:29:38.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.431+0000 7f29da7fc640 1 --2- 172.21.15.17:0/1305517529 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29dc0ce7e0 0x7f29dc0705d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f29d0009870 tx=0x7f29d002a2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54f11ac3ee656662 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:38.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.433+0000 7f29d9ffb640 1 -- 172.21.15.17:0/1305517529 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d0037070 con 0x7f29dc0ce7e0 2024-09-05T07:29:38.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.434+0000 7f29d9ffb640 1 -- 172.21.15.17:0/1305517529 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d0032440 con 0x7f29dc0ce7e0 2024-09-05T07:29:38.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.434+0000 7f29d9ffb640 1 -- 172.21.15.17:0/1305517529 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d0032810 con 0x7f29dc0ce7e0 2024-09-05T07:29:38.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.435+0000 7f29e189b640 1 -- 172.21.15.17:0/1305517529 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29dc0ce7e0 msgr2=0x7f29dc0705d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:38.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.435+0000 7f29e189b640 1 --2- 172.21.15.17:0/1305517529 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29dc0ce7e0 0x7f29dc0705d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f29d0009870 tx=0x7f29d002a2a0 comp rx=0 tx=0).stop 2024-09-05T07:29:38.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.435+0000 7f29e189b640 1 -- 172.21.15.17:0/1305517529 shutdown_connections 2024-09-05T07:29:38.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.435+0000 7f29e189b640 1 --2- 172.21.15.17:0/1305517529 >> v2:172.21.15.26:3300/0 conn(0x7f29dc0b0c00 0x7f29dc157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:38.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.435+0000 7f29e189b640 1 --2- 172.21.15.17:0/1305517529 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29dc0ce7e0 0x7f29dc0705d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:38.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.435+0000 7f29e189b640 1 -- 172.21.15.17:0/1305517529 >> 172.21.15.17:0/1305517529 conn(0x7f29dc06de20 msgr2=0x7f29dc06e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:38.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.435+0000 7f29e189b640 1 -- 172.21.15.17:0/1305517529 shutdown_connections 2024-09-05T07:29:38.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.435+0000 7f29e189b640 1 -- 172.21.15.17:0/1305517529 wait complete. 2024-09-05T07:29:38.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.436+0000 7f29e189b640 1 Processor -- start 2024-09-05T07:29:38.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.436+0000 7f29e189b640 1 -- start start 2024-09-05T07:29:38.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.437+0000 7f29e189b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29dc0b0c00 0x7f29dc0c4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:38.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.437+0000 7f29e189b640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29dc0ce400 0x7f29dc1e6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:38.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.437+0000 7f29e189b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29dc0ce7e0 0x7f29dc1f4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:38.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.437+0000 7f29e189b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc06d940 con 0x7f29dc0b0c00 2024-09-05T07:29:38.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.437+0000 7f29e189b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc0c9a00 con 0x7f29dc0ce7e0 2024-09-05T07:29:38.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.437+0000 7f29e189b640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f29dc06dac0 con 0x7f29dc0ce400 2024-09-05T07:29:38.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.437+0000 7f29daffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29dc0b0c00 0x7f29dc0c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:38.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.437+0000 7f29db7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29dc0ce7e0 0x7f29dc1f4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:38.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.438+0000 7f29da7fc640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29dc0ce400 0x7f29dc1e6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:38.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.438+0000 7f29db7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29dc0ce7e0 0x7f29dc1f4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:51994/0 (socket says 172.21.15.17:51994) 2024-09-05T07:29:38.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.438+0000 7f29db7fe640 1 -- 172.21.15.17:0/1331650305 learned_addr learned my addr 172.21.15.17:0/1331650305 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:38.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.441+0000 7f29da7fc640 1 -- 172.21.15.17:0/1331650305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29dc0ce7e0 msgr2=0x7f29dc1f4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:38.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.441+0000 7f29da7fc640 1 --2- 172.21.15.17:0/1331650305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29dc0ce7e0 0x7f29dc1f4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:38.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.441+0000 7f29da7fc640 1 -- 172.21.15.17:0/1331650305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29dc0b0c00 msgr2=0x7f29dc0c4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:38.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.441+0000 7f29da7fc640 1 --2- 172.21.15.17:0/1331650305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29dc0b0c00 0x7f29dc0c4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:38.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.441+0000 7f29da7fc640 1 -- 172.21.15.17:0/1331650305 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29dc1f3c80 con 0x7f29dc0ce400 2024-09-05T07:29:38.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.444+0000 7f29da7fc640 1 --2- 172.21.15.17:0/1331650305 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29dc0ce400 0x7f29dc1e6220 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f29d0031000 tx=0x7f29d00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:38.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.447+0000 7f29c3fff640 1 -- 172.21.15.17:0/1331650305 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d0041020 con 0x7f29dc0ce400 2024-09-05T07:29:38.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.447+0000 7f29c3fff640 1 -- 172.21.15.17:0/1331650305 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d0030780 con 0x7f29dc0ce400 2024-09-05T07:29:38.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.447+0000 7f29c3fff640 1 -- 172.21.15.17:0/1331650305 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d0037040 con 0x7f29dc0ce400 2024-09-05T07:29:38.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.447+0000 7f29e189b640 1 -- 172.21.15.17:0/1331650305 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29dc0c5d30 con 0x7f29dc0ce400 2024-09-05T07:29:38.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.448+0000 7f29e189b640 1 -- 172.21.15.17:0/1331650305 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f29dc0c62f0 con 0x7f29dc0ce400 2024-09-05T07:29:38.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.448+0000 7f29e189b640 1 -- 172.21.15.17:0/1331650305 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29dc1f3e50 con 0x7f29dc0ce400 2024-09-05T07:29:38.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.468+0000 7f29c3fff640 1 -- 172.21.15.17:0/1331650305 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f29d0044020 con 0x7f29dc0ce400 2024-09-05T07:29:38.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.469+0000 7f29c3fff640 1 --2- 172.21.15.17:0/1331650305 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f29c806be80 0x7f29c806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:38.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.469+0000 7f29daffd640 1 --2- 172.21.15.17:0/1331650305 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f29c806be80 0x7f29c806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:38.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.469+0000 7f29daffd640 1 --2- 172.21.15.17:0/1331650305 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f29c806be80 0x7f29c806e340 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f29cc004f60 tx=0x7f29cc007e30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:38.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.726+0000 7f29c3fff640 1 -- 172.21.15.17:0/1331650305 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f29d0077c80 con 0x7f29dc0ce400 2024-09-05T07:29:38.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.737+0000 7f29c3fff640 1 -- 172.21.15.17:0/1331650305 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f29d004b030 con 0x7f29dc0ce400 2024-09-05T07:29:38.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.948+0000 7f29e189b640 1 -- 172.21.15.17:0/1331650305 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f29dc06bc10 con 0x7f29dc0ce400 2024-09-05T07:29:38.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.975+0000 7f29c3fff640 1 -- 172.21.15.17:0/1331650305 <== mon.2 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6875 (secure 0 0 0) 0x7f29d0079be0 con 0x7f29dc0ce400 2024-09-05T07:29:38.976 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:29:38.976 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":11,"btime":"2024-09-05T07:29:38:138784+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4221,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/1677649004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1677649004},{"type":"v1","addr":"172.21.15.17:6833","nonce":1677649004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/840343339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":840343339},{"type":"v1","addr":"172.21.15.26:6837","nonce":840343339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4233,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6839/914231229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":914231229},{"type":"v1","addr":"172.21.15.26:6839","nonce":914231229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/4100397916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":4100397916},{"type":"v1","addr":"172.21.15.17:6837","nonce":4100397916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-05T07:29:30.282161+0000","modified":"2024-09-05T07:29:37.221919+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1],"up":{"mds_0":4261,"mds_1":4258},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4258":{"gid":4258,"name":"e","rank":1,"incarnation":9,"state":"up:creating","state_seq":1,"addr":"172.21.15.17:6835/2818017162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2818017162},{"type":"v1","addr":"172.21.15.17:6835","nonce":2818017162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4261":{"gid":4261,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/656329439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":656329439},{"type":"v1","addr":"172.21.15.26:6835","nonce":656329439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4261,"qdb_cluster":[4261]},"id":1}]} 2024-09-05T07:29:38.976 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 11 2024-09-05T07:29:38.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.976+0000 7f29e189b640 1 -- 172.21.15.17:0/1331650305 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f29c806be80 msgr2=0x7f29c806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:38.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.976+0000 7f29e189b640 1 --2- 172.21.15.17:0/1331650305 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f29c806be80 0x7f29c806e340 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f29cc004f60 tx=0x7f29cc007e30 comp rx=0 tx=0).stop 2024-09-05T07:29:38.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.976+0000 7f29e189b640 1 -- 172.21.15.17:0/1331650305 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29dc0ce400 msgr2=0x7f29dc1e6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:38.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.976+0000 7f29e189b640 1 --2- 172.21.15.17:0/1331650305 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29dc0ce400 0x7f29dc1e6220 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f29d0031000 tx=0x7f29d00046c0 comp rx=0 tx=0).stop 2024-09-05T07:29:38.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.976+0000 7f29e189b640 1 -- 172.21.15.17:0/1331650305 shutdown_connections 2024-09-05T07:29:38.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.976+0000 7f29e189b640 1 --2- 172.21.15.17:0/1331650305 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f29c806be80 0x7f29c806e340 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:38.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.976+0000 7f29e189b640 1 --2- 172.21.15.17:0/1331650305 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29dc0ce400 0x7f29dc1e6220 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:38.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.977+0000 7f29e189b640 1 --2- 172.21.15.17:0/1331650305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29dc0ce7e0 0x7f29dc1f4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:38.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.977+0000 7f29e189b640 1 --2- 172.21.15.17:0/1331650305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29dc0b0c00 0x7f29dc0c4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:38.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.977+0000 7f29e189b640 1 -- 172.21.15.17:0/1331650305 >> 172.21.15.17:0/1331650305 conn(0x7f29dc06de20 msgr2=0x7f29dc0705d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:38.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.977+0000 7f29e189b640 1 -- 172.21.15.17:0/1331650305 shutdown_connections 2024-09-05T07:29:38.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:38.977+0000 7f29e189b640 1 -- 172.21.15.17:0/1331650305 wait complete. 2024-09-05T07:29:38.988 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-05T07:29:39.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.086+0000 7fa77f08d640 1 Processor -- start 2024-09-05T07:29:39.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.086+0000 7fa77f08d640 1 -- start start 2024-09-05T07:29:39.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.087+0000 7fa77f08d640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa778159480 0x7fa7780c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:39.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.087+0000 7fa77f08d640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7780c9630 con 0x7fa7780ca780 2024-09-05T07:29:39.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.087+0000 7fa77f08d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7780c9910 con 0x7fa7780ca3a0 2024-09-05T07:29:39.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.087+0000 7fa77f08d640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fa7780c93e0 con 0x7fa778159480 2024-09-05T07:29:39.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.088+0000 7fa777fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fa7780ca780 0x7fa778158d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54158/0 (socket says 172.21.15.17:54158) 2024-09-05T07:29:39.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.088+0000 7fa777fff640 1 -- 172.21.15.17:0/1092674148 learned_addr learned my addr 172.21.15.17:0/1092674148 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:29:39.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.088+0000 7fa77d62a640 1 --2- 172.21.15.17:0/1092674148 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa778159480 0x7fa7780c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:39.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.090+0000 7fa7777fe640 1 -- 172.21.15.17:0/1092674148 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1688371355 0 0) 0x7fa7780c9630 con 0x7fa7780ca780 2024-09-05T07:29:39.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.090+0000 7fa7777fe640 1 -- 172.21.15.17:0/1092674148 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa764003520 con 0x7fa7780ca780 2024-09-05T07:29:39.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.091+0000 7fa77d62a640 1 -- 172.21.15.17:0/1092674148 >> v1:172.21.15.26:6789/0 conn(0x7fa7780ca3a0 legacy=0x7fa7780c3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:39.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.091+0000 7fa77d62a640 1 -- 172.21.15.17:0/1092674148 >> v1:172.21.15.17:6789/0 conn(0x7fa7780ca780 legacy=0x7fa778158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:39.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.091+0000 7fa77d62a640 1 -- 172.21.15.17:0/1092674148 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7780c9bf0 con 0x7fa778159480 2024-09-05T07:29:39.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.093+0000 7fa77d62a640 1 --2- 172.21.15.17:0/1092674148 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa778159480 0x7fa7780c8c40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa7600097d0 tx=0x7fa76002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5a4d9783cf1fbc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:39.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.097+0000 7fa7777fe640 1 -- 172.21.15.17:0/1092674148 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa760037070 con 0x7fa778159480 2024-09-05T07:29:39.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.097+0000 7fa7777fe640 1 -- 172.21.15.17:0/1092674148 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa760032440 con 0x7fa778159480 2024-09-05T07:29:39.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.097+0000 7fa7777fe640 1 -- 172.21.15.17:0/1092674148 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa760032810 con 0x7fa778159480 2024-09-05T07:29:39.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.097+0000 7fa77f08d640 1 -- 172.21.15.17:0/1092674148 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa778159480 msgr2=0x7fa7780c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:39.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.097+0000 7fa77f08d640 1 --2- 172.21.15.17:0/1092674148 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa778159480 0x7fa7780c8c40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa7600097d0 tx=0x7fa76002a180 comp rx=0 tx=0).stop 2024-09-05T07:29:39.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.097+0000 7fa77f08d640 1 -- 172.21.15.17:0/1092674148 shutdown_connections 2024-09-05T07:29:39.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.097+0000 7fa77f08d640 1 --2- 172.21.15.17:0/1092674148 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa778159480 0x7fa7780c8c40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:39.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.097+0000 7fa77f08d640 1 -- 172.21.15.17:0/1092674148 >> 172.21.15.17:0/1092674148 conn(0x7fa77806de20 msgr2=0x7fa77806e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:39.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.098+0000 7fa77f08d640 1 -- 172.21.15.17:0/1092674148 shutdown_connections 2024-09-05T07:29:39.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.098+0000 7fa77f08d640 1 -- 172.21.15.17:0/1092674148 wait complete. 2024-09-05T07:29:39.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.099+0000 7fa77f08d640 1 Processor -- start 2024-09-05T07:29:39.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.099+0000 7fa77f08d640 1 -- start start 2024-09-05T07:29:39.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.099+0000 7fa77f08d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7780ca3a0 0x7fa7780cd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:39.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.099+0000 7fa77f08d640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa7780ca780 0x7fa778153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:39.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.100+0000 7fa77f08d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa778159480 0x7fa778154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:39.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.100+0000 7fa77f08d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa7780c5260 con 0x7fa778159480 2024-09-05T07:29:39.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.100+0000 7fa77f08d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa778158850 con 0x7fa7780ca3a0 2024-09-05T07:29:39.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.100+0000 7fa77f08d640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fa778152550 con 0x7fa7780ca780 2024-09-05T07:29:39.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.100+0000 7fa77d62a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa778159480 0x7fa778154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:39.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.100+0000 7fa777fff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa7780ca780 0x7fa778153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:39.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.100+0000 7fa77ce29640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7780ca3a0 0x7fa7780cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:39.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.100+0000 7fa777fff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa7780ca780 0x7fa778153c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:58854/0 (socket says 172.21.15.17:58854) 2024-09-05T07:29:39.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.100+0000 7fa777fff640 1 -- 172.21.15.17:0/830877446 learned_addr learned my addr 172.21.15.17:0/830877446 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:39.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.104+0000 7fa77d62a640 1 -- 172.21.15.17:0/830877446 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa7780ca780 msgr2=0x7fa778153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:39.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.104+0000 7fa77d62a640 1 --2- 172.21.15.17:0/830877446 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa7780ca780 0x7fa778153c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:39.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.104+0000 7fa77d62a640 1 -- 172.21.15.17:0/830877446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7780ca3a0 msgr2=0x7fa7780cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:39.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.104+0000 7fa77d62a640 1 --2- 172.21.15.17:0/830877446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7780ca3a0 0x7fa7780cd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:39.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.104+0000 7fa77d62a640 1 -- 172.21.15.17:0/830877446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7780b1c60 con 0x7fa778159480 2024-09-05T07:29:39.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.106+0000 7fa77d62a640 1 --2- 172.21.15.17:0/830877446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa778159480 0x7fa778154180 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa760031000 tx=0x7fa7600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:39.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.110+0000 7fa7757fa640 1 -- 172.21.15.17:0/830877446 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa760037050 con 0x7fa778159480 2024-09-05T07:29:39.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.110+0000 7fa7757fa640 1 -- 172.21.15.17:0/830877446 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa760043070 con 0x7fa778159480 2024-09-05T07:29:39.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.110+0000 7fa7757fa640 1 -- 172.21.15.17:0/830877446 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa760030b90 con 0x7fa778159480 2024-09-05T07:29:39.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.110+0000 7fa77f08d640 1 -- 172.21.15.17:0/830877446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7780b1f00 con 0x7fa778159480 2024-09-05T07:29:39.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.110+0000 7fa77f08d640 1 -- 172.21.15.17:0/830877446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7780b2810 con 0x7fa778159480 2024-09-05T07:29:39.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.111+0000 7fa77f08d640 1 -- 172.21.15.17:0/830877446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7780c8c40 con 0x7fa778159480 2024-09-05T07:29:39.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.386+0000 7fa7757fa640 1 -- 172.21.15.17:0/830877446 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa760048460 con 0x7fa778159480 2024-09-05T07:29:39.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.387+0000 7fa7757fa640 1 --2- 172.21.15.17:0/830877446 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fa75806be80 0x7fa75806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:39.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.387+0000 7fa77ce29640 1 --2- 172.21.15.17:0/830877446 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fa75806be80 0x7fa75806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:39.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.388+0000 7fa77ce29640 1 --2- 172.21.15.17:0/830877446 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fa75806be80 0x7fa75806e340 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa770001f10 tx=0x7fa770009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:39.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.403+0000 7fa7757fa640 1 -- 172.21.15.17:0/830877446 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fa7600788f0 con 0x7fa778159480 2024-09-05T07:29:39.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.403+0000 7fa7757fa640 1 -- 172.21.15.17:0/830877446 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa76007a850 con 0x7fa778159480 2024-09-05T07:29:39.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.583+0000 7fa77f08d640 1 -- 172.21.15.17:0/830877446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa77806e550 con 0x7fa778159480 2024-09-05T07:29:39.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.623+0000 7fa7757fa640 1 -- 172.21.15.17:0/830877446 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16621 (secure 0 0 0) 0x7fa76007eb50 con 0x7fa778159480 2024-09-05T07:29:39.624 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:29:39.624 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":22,"fsid":"848dac54-74f8-48f3-8686-c6495dcb972b","created":"2024-09-05T07:28:54.070215+0000","modified":"2024-09-05T07:29:31.467668+0000","last_up_change":"2024-09-05T07:29:11.992790+0000","last_in_change":"2024-09-05T07:29:00.001829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T07:29:10.227047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T07:29:27.905154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T07:29:29.039672+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f01a8b4-dc10-4cdf-a65e-b7f96de4e2b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2731314060},{"type":"v1","addr":"172.21.15.17:6825","nonce":2731314060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2731314060},{"type":"v1","addr":"172.21.15.17:6827","nonce":2731314060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2731314060},{"type":"v1","addr":"172.21.15.17:6831","nonce":2731314060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2731314060},{"type":"v1","addr":"172.21.15.17:6829","nonce":2731314060}]},"public_addr":"172.21.15.17:6825/2731314060","cluster_addr":"172.21.15.17:6827/2731314060","heartbeat_back_addr":"172.21.15.17:6831/2731314060","heartbeat_front_addr":"172.21.15.17:6829/2731314060","state":["exists","up"]},{"osd":1,"uuid":"d16867fb-2290-486c-9ac8-327ca54326d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3327408852},{"type":"v1","addr":"172.21.15.17:6817","nonce":3327408852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3327408852},{"type":"v1","addr":"172.21.15.17:6819","nonce":3327408852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3327408852},{"type":"v1","addr":"172.21.15.17:6823","nonce":3327408852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3327408852},{"type":"v1","addr":"172.21.15.17:6821","nonce":3327408852}]},"public_addr":"172.21.15.17:6817/3327408852","cluster_addr":"172.21.15.17:6819/3327408852","heartbeat_back_addr":"172.21.15.17:6823/3327408852","heartbeat_front_addr":"172.21.15.17:6821/3327408852","state":["exists","up"]},{"osd":2,"uuid":"632ad558-bd14-4240-a8f1-5beda951b3b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":363420609},{"type":"v1","addr":"172.21.15.17:6809","nonce":363420609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":363420609},{"type":"v1","addr":"172.21.15.17:6811","nonce":363420609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":363420609},{"type":"v1","addr":"172.21.15.17:6815","nonce":363420609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":363420609},{"type":"v1","addr":"172.21.15.17:6813","nonce":363420609}]},"public_addr":"172.21.15.17:6809/363420609","cluster_addr":"172.21.15.17:6811/363420609","heartbeat_back_addr":"172.21.15.17:6815/363420609","heartbeat_front_addr":"172.21.15.17:6813/363420609","state":["exists","up"]},{"osd":3,"uuid":"9727a970-8f98-45b9-8eca-62da1f28ff17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":3512342499},{"type":"v1","addr":"172.21.15.17:6801","nonce":3512342499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":3512342499},{"type":"v1","addr":"172.21.15.17:6803","nonce":3512342499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":3512342499},{"type":"v1","addr":"172.21.15.17:6807","nonce":3512342499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":3512342499},{"type":"v1","addr":"172.21.15.17:6805","nonce":3512342499}]},"public_addr":"172.21.15.17:6801/3512342499","cluster_addr":"172.21.15.17:6803/3512342499","heartbeat_back_addr":"172.21.15.17:6807/3512342499","heartbeat_front_addr":"172.21.15.17:6805/3512342499","state":["exists","up"]},{"osd":4,"uuid":"0e0141e0-51f1-4229-861f-1992afe70c96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6803","nonce":3740556509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6805","nonce":3740556509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6809","nonce":3740556509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6807","nonce":3740556509}]},"public_addr":"172.21.15.26:6803/3740556509","cluster_addr":"172.21.15.26:6805/3740556509","heartbeat_back_addr":"172.21.15.26:6809/3740556509","heartbeat_front_addr":"172.21.15.26:6807/3740556509","state":["exists","up"]},{"osd":5,"uuid":"5603d79b-fcf8-45aa-a1db-96918af450be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3020770750},{"type":"v1","addr":"172.21.15.26:6819","nonce":3020770750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3020770750},{"type":"v1","addr":"172.21.15.26:6821","nonce":3020770750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3020770750},{"type":"v1","addr":"172.21.15.26:6825","nonce":3020770750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3020770750},{"type":"v1","addr":"172.21.15.26:6823","nonce":3020770750}]},"public_addr":"172.21.15.26:6819/3020770750","cluster_addr":"172.21.15.26:6821/3020770750","heartbeat_back_addr":"172.21.15.26:6825/3020770750","heartbeat_front_addr":"172.21.15.26:6823/3020770750","state":["exists","up"]},{"osd":6,"uuid":"14f3b696-1b3c-4749-8f61-ac10edbb5b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6811","nonce":158775588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6813","nonce":158775588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6817","nonce":158775588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6815","nonce":158775588}]},"public_addr":"172.21.15.26:6811/158775588","cluster_addr":"172.21.15.26:6813/158775588","heartbeat_back_addr":"172.21.15.26:6817/158775588","heartbeat_front_addr":"172.21.15.26:6815/158775588","state":["exists","up"]},{"osd":7,"uuid":"be7b4121-c71b-4908-ba4a-9c4389423201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":4176189153},{"type":"v1","addr":"172.21.15.26:6827","nonce":4176189153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":4176189153},{"type":"v1","addr":"172.21.15.26:6829","nonce":4176189153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":4176189153},{"type":"v1","addr":"172.21.15.26:6833","nonce":4176189153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":4176189153},{"type":"v1","addr":"172.21.15.26:6831","nonce":4176189153}]},"public_addr":"172.21.15.26:6827/4176189153","cluster_addr":"172.21.15.26:6829/4176189153","heartbeat_back_addr":"172.21.15.26:6833/4176189153","heartbeat_front_addr":"172.21.15.26:6831/4176189153","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.923722+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.404043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.275202+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.434925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.159606+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.379036+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.196000+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.387333+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T07:29:39.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.625+0000 7fa77f08d640 1 -- 172.21.15.17:0/830877446 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fa75806be80 msgr2=0x7fa75806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:39.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.626+0000 7fa77f08d640 1 --2- 172.21.15.17:0/830877446 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fa75806be80 0x7fa75806e340 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa770001f10 tx=0x7fa770009040 comp rx=0 tx=0).stop 2024-09-05T07:29:39.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.626+0000 7fa77f08d640 1 -- 172.21.15.17:0/830877446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa778159480 msgr2=0x7fa778154180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:39.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.626+0000 7fa77f08d640 1 --2- 172.21.15.17:0/830877446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa778159480 0x7fa778154180 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa760031000 tx=0x7fa7600046c0 comp rx=0 tx=0).stop 2024-09-05T07:29:39.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.626+0000 7fa77f08d640 1 -- 172.21.15.17:0/830877446 shutdown_connections 2024-09-05T07:29:39.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.626+0000 7fa77f08d640 1 --2- 172.21.15.17:0/830877446 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fa75806be80 0x7fa75806e340 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:39.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.626+0000 7fa77f08d640 1 --2- 172.21.15.17:0/830877446 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa7780ca780 0x7fa778153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:39.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.626+0000 7fa77f08d640 1 --2- 172.21.15.17:0/830877446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa778159480 0x7fa778154180 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:39.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.626+0000 7fa77f08d640 1 --2- 172.21.15.17:0/830877446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7780ca3a0 0x7fa7780cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:39.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.626+0000 7fa77f08d640 1 -- 172.21.15.17:0/830877446 >> 172.21.15.17:0/830877446 conn(0x7fa77806de20 msgr2=0x7fa7780712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:39.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.626+0000 7fa77f08d640 1 -- 172.21.15.17:0/830877446 shutdown_connections 2024-09-05T07:29:39.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.626+0000 7fa77f08d640 1 -- 172.21.15.17:0/830877446 wait complete. 2024-09-05T07:29:39.637 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-05T07:29:39.637 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T07:29:39.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.737+0000 7fd97cbbd640 1 Processor -- start 2024-09-05T07:29:39.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.737+0000 7fd97cbbd640 1 -- start start 2024-09-05T07:29:39.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.738+0000 7fd97cbbd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd9780c4fd0 0x7fd97815bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:39.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.738+0000 7fd97cbbd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd9780c8ad0 0x7fd9780ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:39.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.738+0000 7fd97cbbd640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd97815cb90 con 0x7fd9781529a0 2024-09-05T07:29:39.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.738+0000 7fd97cbbd640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fd978158c50 con 0x7fd9780c8ad0 2024-09-05T07:29:39.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.738+0000 7fd97cbbd640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fd9780c8f40 con 0x7fd9780c4fd0 2024-09-05T07:29:39.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.738+0000 7fd976d9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd9780c8ad0 0x7fd9780ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:39.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.738+0000 7fd975d9b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd9780c4fd0 0x7fd97815bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:39.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.739+0000 7fd97659c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fd9781529a0 0x7fd9781590e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42080/0 (socket says 172.21.15.17:42080) 2024-09-05T07:29:39.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.739+0000 7fd97659c640 1 -- 172.21.15.17:0/1989125591 learned_addr learned my addr 172.21.15.17:0/1989125591 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:29:39.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.741+0000 7fd975d9b640 1 -- 172.21.15.17:0/1989125591 >> v2:172.21.15.17:3300/0 conn(0x7fd9780c8ad0 msgr2=0x7fd9780ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:39.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.741+0000 7fd975d9b640 1 --2- 172.21.15.17:0/1989125591 >> v2:172.21.15.17:3300/0 conn(0x7fd9780c8ad0 0x7fd9780ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:39.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.741+0000 7fd975d9b640 1 -- 172.21.15.17:0/1989125591 >> v1:172.21.15.17:6789/0 conn(0x7fd9781529a0 legacy=0x7fd9781590e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:39.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.741+0000 7fd975d9b640 1 -- 172.21.15.17:0/1989125591 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd97815c2f0 con 0x7fd9780c4fd0 2024-09-05T07:29:39.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.743+0000 7fd975d9b640 1 --2- 172.21.15.17:0/1989125591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9780c4fd0 0x7fd97815bcb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd9780c4050 tx=0x7fd96002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=454f8b10bd28f1f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:39.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.747+0000 7fd97559a640 1 -- 172.21.15.17:0/1989125591 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd960037070 con 0x7fd9780c4fd0 2024-09-05T07:29:39.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.747+0000 7fd97559a640 1 -- 172.21.15.17:0/1989125591 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd960032440 con 0x7fd9780c4fd0 2024-09-05T07:29:39.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.747+0000 7fd97559a640 1 -- 172.21.15.17:0/1989125591 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd960032810 con 0x7fd9780c4fd0 2024-09-05T07:29:39.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.748+0000 7fd97cbbd640 1 -- 172.21.15.17:0/1989125591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9780c4fd0 msgr2=0x7fd97815bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:39.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.748+0000 7fd97cbbd640 1 --2- 172.21.15.17:0/1989125591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9780c4fd0 0x7fd97815bcb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd9780c4050 tx=0x7fd96002a230 comp rx=0 tx=0).stop 2024-09-05T07:29:39.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.748+0000 7fd97cbbd640 1 -- 172.21.15.17:0/1989125591 shutdown_connections 2024-09-05T07:29:39.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.748+0000 7fd97cbbd640 1 --2- 172.21.15.17:0/1989125591 >> v2:172.21.15.17:3300/0 conn(0x7fd9780c8ad0 0x7fd9780ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:39.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.748+0000 7fd97cbbd640 1 --2- 172.21.15.17:0/1989125591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9780c4fd0 0x7fd97815bcb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:39.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.748+0000 7fd97cbbd640 1 -- 172.21.15.17:0/1989125591 >> 172.21.15.17:0/1989125591 conn(0x7fd978067950 msgr2=0x7fd978067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:39.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.748+0000 7fd97cbbd640 1 -- 172.21.15.17:0/1989125591 shutdown_connections 2024-09-05T07:29:39.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.748+0000 7fd97cbbd640 1 -- 172.21.15.17:0/1989125591 wait complete. 2024-09-05T07:29:39.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.749+0000 7fd97cbbd640 1 Processor -- start 2024-09-05T07:29:39.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.749+0000 7fd97cbbd640 1 -- start start 2024-09-05T07:29:39.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.750+0000 7fd97cbbd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9780c4fd0 0x7fd97806bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:39.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.750+0000 7fd97cbbd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9780c8ad0 0x7fd9780cd730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:39.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.750+0000 7fd97cbbd640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9781529a0 0x7fd9781f0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:39.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.750+0000 7fd97cbbd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd9781588e0 con 0x7fd9780c8ad0 2024-09-05T07:29:39.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.750+0000 7fd97cbbd640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd97815c8b0 con 0x7fd9780c4fd0 2024-09-05T07:29:39.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.750+0000 7fd97cbbd640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fd978152d80 con 0x7fd9781529a0 2024-09-05T07:29:39.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.750+0000 7fd97659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9780c4fd0 0x7fd97806bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:39.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.750+0000 7fd976d9d640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9781529a0 0x7fd9781f0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:39.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.750+0000 7fd975d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9780c8ad0 0x7fd9780cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:39.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.751+0000 7fd97659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9780c4fd0 0x7fd97806bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:35990/0 (socket says 172.21.15.17:35990) 2024-09-05T07:29:39.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.751+0000 7fd97659c640 1 -- 172.21.15.17:0/3880771223 learned_addr learned my addr 172.21.15.17:0/3880771223 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:39.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.754+0000 7fd97659c640 1 -- 172.21.15.17:0/3880771223 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9781529a0 msgr2=0x7fd9781f0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:39.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.754+0000 7fd97659c640 1 --2- 172.21.15.17:0/3880771223 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9781529a0 0x7fd9781f0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:39.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.754+0000 7fd97659c640 1 -- 172.21.15.17:0/3880771223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9780c8ad0 msgr2=0x7fd9780cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:39.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.754+0000 7fd97659c640 1 --2- 172.21.15.17:0/3880771223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9780c8ad0 0x7fd9780cd730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:39.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.754+0000 7fd97659c640 1 -- 172.21.15.17:0/3880771223 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9780cabf0 con 0x7fd9780c4fd0 2024-09-05T07:29:39.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.757+0000 7fd97659c640 1 --2- 172.21.15.17:0/3880771223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9780c4fd0 0x7fd97806bda0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd96800caa0 tx=0x7fd96800cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:39.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.761+0000 7fd96effd640 1 -- 172.21.15.17:0/3880771223 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd968017070 con 0x7fd9780c4fd0 2024-09-05T07:29:39.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.761+0000 7fd96effd640 1 -- 172.21.15.17:0/3880771223 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd96800ac00 con 0x7fd9780c4fd0 2024-09-05T07:29:39.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.761+0000 7fd96effd640 1 -- 172.21.15.17:0/3880771223 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd968012400 con 0x7fd9780c4fd0 2024-09-05T07:29:39.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.761+0000 7fd97cbbd640 1 -- 172.21.15.17:0/3880771223 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9780caed0 con 0x7fd9780c4fd0 2024-09-05T07:29:39.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.761+0000 7fd97cbbd640 1 -- 172.21.15.17:0/3880771223 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9781f3c90 con 0x7fd9780c4fd0 2024-09-05T07:29:39.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:39.762+0000 7fd97cbbd640 1 -- 172.21.15.17:0/3880771223 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd97815ad30 con 0x7fd9780c4fd0 2024-09-05T07:29:40.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.035+0000 7fd96effd640 1 -- 172.21.15.17:0/3880771223 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd96801a070 con 0x7fd9780c4fd0 2024-09-05T07:29:40.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.035+0000 7fd96effd640 1 --2- 172.21.15.17:0/3880771223 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd95806be80 0x7fd95806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:40.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.036+0000 7fd975d9b640 1 --2- 172.21.15.17:0/3880771223 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd95806be80 0x7fd95806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:40.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.036+0000 7fd975d9b640 1 --2- 172.21.15.17:0/3880771223 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd95806be80 0x7fd95806e340 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd960034000 tx=0x7fd96002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:40.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.039+0000 7fd96effd640 1 -- 172.21.15.17:0/3880771223 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd9680573a0 con 0x7fd9780c4fd0 2024-09-05T07:29:40.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.049+0000 7fd96effd640 1 -- 172.21.15.17:0/3880771223 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd968021020 con 0x7fd9780c4fd0 2024-09-05T07:29:40.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.222+0000 7fd97cbbd640 1 -- 172.21.15.17:0/3880771223 --> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd97806f540 con 0x7fd95806be80 2024-09-05T07:29:40.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.229+0000 7fd96effd640 1 -- 172.21.15.17:0/3880771223 <== mgr.4099 v2:172.21.15.26:6800/2736912541 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251887 (secure 0 0 0) 0x7fd97806f540 con 0x7fd95806be80 2024-09-05T07:29:40.233 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:29:40.234 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-05T07:29:40.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.231+0000 7fd97cbbd640 1 -- 172.21.15.17:0/3880771223 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd95806be80 msgr2=0x7fd95806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:40.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.231+0000 7fd97cbbd640 1 --2- 172.21.15.17:0/3880771223 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd95806be80 0x7fd95806e340 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd960034000 tx=0x7fd96002e000 comp rx=0 tx=0).stop 2024-09-05T07:29:40.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.231+0000 7fd97cbbd640 1 -- 172.21.15.17:0/3880771223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9780c4fd0 msgr2=0x7fd97806bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:40.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.231+0000 7fd97cbbd640 1 --2- 172.21.15.17:0/3880771223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9780c4fd0 0x7fd97806bda0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd96800caa0 tx=0x7fd96800cf60 comp rx=0 tx=0).stop 2024-09-05T07:29:40.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.231+0000 7fd97cbbd640 1 -- 172.21.15.17:0/3880771223 shutdown_connections 2024-09-05T07:29:40.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.231+0000 7fd97cbbd640 1 --2- 172.21.15.17:0/3880771223 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd95806be80 0x7fd95806e340 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:40.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.231+0000 7fd97cbbd640 1 --2- 172.21.15.17:0/3880771223 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9781529a0 0x7fd9781f0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:40.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.231+0000 7fd97cbbd640 1 --2- 172.21.15.17:0/3880771223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9780c8ad0 0x7fd9780cd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:40.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.231+0000 7fd97cbbd640 1 --2- 172.21.15.17:0/3880771223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9780c4fd0 0x7fd97806bda0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:40.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.231+0000 7fd97cbbd640 1 -- 172.21.15.17:0/3880771223 >> 172.21.15.17:0/3880771223 conn(0x7fd978067950 msgr2=0x7fd9780c5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:40.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.231+0000 7fd97cbbd640 1 -- 172.21.15.17:0/3880771223 shutdown_connections 2024-09-05T07:29:40.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.231+0000 7fd97cbbd640 1 -- 172.21.15.17:0/3880771223 wait complete. 2024-09-05T07:29:40.242 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-09-05T07:29:39.874390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594094,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":230,"num_write_kb":2441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":181,"ondisk_log_size":181,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":269140,"kb_used_data":2960,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754705580,"statfs":{"total":773094113280,"available":772818513920,"internally_reserved":0,"allocated":3031040,"data_stored":1800194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":272354865},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3726,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.339489"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.880921+0000","last_change":"2024-09-05T07:29:30.556803+0000","last_active":"2024-09-05T07:29:31.880921+0000","last_peered":"2024-09-05T07:29:31.880921+0000","last_clean":"2024-09-05T07:29:31.880921+0000","last_became_active":"2024-09-05T07:29:30.556513+0000","last_became_peered":"2024-09-05T07:29:30.556513+0000","last_unstale":"2024-09-05T07:29:31.880921+0000","last_undegraded":"2024-09-05T07:29:31.880921+0000","last_fullsized":"2024-09-05T07:29:31.880921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:38:11.961137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.631582+0000","last_change":"2024-09-05T07:29:30.658489+0000","last_active":"2024-09-05T07:29:31.631582+0000","last_peered":"2024-09-05T07:29:31.631582+0000","last_clean":"2024-09-05T07:29:31.631582+0000","last_became_active":"2024-09-05T07:29:30.658225+0000","last_became_peered":"2024-09-05T07:29:30.658225+0000","last_unstale":"2024-09-05T07:29:31.631582+0000","last_undegraded":"2024-09-05T07:29:31.631582+0000","last_fullsized":"2024-09-05T07:29:31.631582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:03:07.788844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.631512+0000","last_change":"2024-09-05T07:29:30.659535+0000","last_active":"2024-09-05T07:29:31.631512+0000","last_peered":"2024-09-05T07:29:31.631512+0000","last_clean":"2024-09-05T07:29:31.631512+0000","last_became_active":"2024-09-05T07:29:30.659042+0000","last_became_peered":"2024-09-05T07:29:30.659042+0000","last_unstale":"2024-09-05T07:29:31.631512+0000","last_undegraded":"2024-09-05T07:29:31.631512+0000","last_fullsized":"2024-09-05T07:29:31.631512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:08:39.718764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.882099+0000","last_change":"2024-09-05T07:29:30.640489+0000","last_active":"2024-09-05T07:29:31.882099+0000","last_peered":"2024-09-05T07:29:31.882099+0000","last_clean":"2024-09-05T07:29:31.882099+0000","last_became_active":"2024-09-05T07:29:30.640141+0000","last_became_peered":"2024-09-05T07:29:30.640141+0000","last_unstale":"2024-09-05T07:29:31.882099+0000","last_undegraded":"2024-09-05T07:29:31.882099+0000","last_fullsized":"2024-09-05T07:29:31.882099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:53:14.516901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881415+0000","last_change":"2024-09-05T07:29:30.659266+0000","last_active":"2024-09-05T07:29:31.881415+0000","last_peered":"2024-09-05T07:29:31.881415+0000","last_clean":"2024-09-05T07:29:31.881415+0000","last_became_active":"2024-09-05T07:29:30.658981+0000","last_became_peered":"2024-09-05T07:29:30.658981+0000","last_unstale":"2024-09-05T07:29:31.881415+0000","last_undegraded":"2024-09-05T07:29:31.881415+0000","last_fullsized":"2024-09-05T07:29:31.881415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:34:49.879681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881926+0000","last_change":"2024-09-05T07:29:30.641512+0000","last_active":"2024-09-05T07:29:31.881926+0000","last_peered":"2024-09-05T07:29:31.881926+0000","last_clean":"2024-09-05T07:29:31.881926+0000","last_became_active":"2024-09-05T07:29:30.641255+0000","last_became_peered":"2024-09-05T07:29:30.641255+0000","last_unstale":"2024-09-05T07:29:31.881926+0000","last_undegraded":"2024-09-05T07:29:31.881926+0000","last_fullsized":"2024-09-05T07:29:31.881926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:42.938157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881721+0000","last_change":"2024-09-05T07:29:30.556064+0000","last_active":"2024-09-05T07:29:31.881721+0000","last_peered":"2024-09-05T07:29:31.881721+0000","last_clean":"2024-09-05T07:29:31.881721+0000","last_became_active":"2024-09-05T07:29:30.555796+0000","last_became_peered":"2024-09-05T07:29:30.555796+0000","last_unstale":"2024-09-05T07:29:31.881721+0000","last_undegraded":"2024-09-05T07:29:31.881721+0000","last_fullsized":"2024-09-05T07:29:31.881721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:37:28.088603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.631334+0000","last_change":"2024-09-05T07:29:30.659561+0000","last_active":"2024-09-05T07:29:31.631334+0000","last_peered":"2024-09-05T07:29:31.631334+0000","last_clean":"2024-09-05T07:29:31.631334+0000","last_became_active":"2024-09-05T07:29:30.659070+0000","last_became_peered":"2024-09-05T07:29:30.659070+0000","last_unstale":"2024-09-05T07:29:31.631334+0000","last_undegraded":"2024-09-05T07:29:31.631334+0000","last_fullsized":"2024-09-05T07:29:31.631334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:13:33.902479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.907890+0000","last_change":"2024-09-05T07:29:30.565653+0000","last_active":"2024-09-05T07:29:31.907890+0000","last_peered":"2024-09-05T07:29:31.907890+0000","last_clean":"2024-09-05T07:29:31.907890+0000","last_became_active":"2024-09-05T07:29:30.565408+0000","last_became_peered":"2024-09-05T07:29:30.565408+0000","last_unstale":"2024-09-05T07:29:31.907890+0000","last_undegraded":"2024-09-05T07:29:31.907890+0000","last_fullsized":"2024-09-05T07:29:31.907890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:42.938157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881571+0000","last_change":"2024-09-05T07:29:30.643865+0000","last_active":"2024-09-05T07:29:31.881571+0000","last_peered":"2024-09-05T07:29:31.881571+0000","last_clean":"2024-09-05T07:29:31.881571+0000","last_became_active":"2024-09-05T07:29:30.643587+0000","last_became_peered":"2024-09-05T07:29:30.643587+0000","last_unstale":"2024-09-05T07:29:31.881571+0000","last_undegraded":"2024-09-05T07:29:31.881571+0000","last_fullsized":"2024-09-05T07:29:31.881571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:37:46.507371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.880939+0000","last_change":"2024-09-05T07:29:30.557314+0000","last_active":"2024-09-05T07:29:31.880939+0000","last_peered":"2024-09-05T07:29:31.880939+0000","last_clean":"2024-09-05T07:29:31.880939+0000","last_became_active":"2024-09-05T07:29:30.557039+0000","last_became_peered":"2024-09-05T07:29:30.557039+0000","last_unstale":"2024-09-05T07:29:31.880939+0000","last_undegraded":"2024-09-05T07:29:31.880939+0000","last_fullsized":"2024-09-05T07:29:31.880939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:08:39.718764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881426+0000","last_change":"2024-09-05T07:29:30.564518+0000","last_active":"2024-09-05T07:29:31.881426+0000","last_peered":"2024-09-05T07:29:31.881426+0000","last_clean":"2024-09-05T07:29:31.881426+0000","last_became_active":"2024-09-05T07:29:30.564271+0000","last_became_peered":"2024-09-05T07:29:30.564271+0000","last_unstale":"2024-09-05T07:29:31.881426+0000","last_undegraded":"2024-09-05T07:29:31.881426+0000","last_fullsized":"2024-09-05T07:29:31.881426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:09:22.026287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908103+0000","last_change":"2024-09-05T07:29:30.631857+0000","last_active":"2024-09-05T07:29:31.908103+0000","last_peered":"2024-09-05T07:29:31.908103+0000","last_clean":"2024-09-05T07:29:31.908103+0000","last_became_active":"2024-09-05T07:29:30.631588+0000","last_became_peered":"2024-09-05T07:29:30.631588+0000","last_unstale":"2024-09-05T07:29:31.908103+0000","last_undegraded":"2024-09-05T07:29:31.908103+0000","last_fullsized":"2024-09-05T07:29:31.908103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:41:25.696697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908490+0000","last_change":"2024-09-05T07:29:30.632829+0000","last_active":"2024-09-05T07:29:31.908490+0000","last_peered":"2024-09-05T07:29:31.908490+0000","last_clean":"2024-09-05T07:29:31.908490+0000","last_became_active":"2024-09-05T07:29:30.632528+0000","last_became_peered":"2024-09-05T07:29:30.632528+0000","last_unstale":"2024-09-05T07:29:31.908490+0000","last_undegraded":"2024-09-05T07:29:31.908490+0000","last_fullsized":"2024-09-05T07:29:31.908490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:22:35.613478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.631381+0000","last_change":"2024-09-05T07:29:30.657306+0000","last_active":"2024-09-05T07:29:31.631381+0000","last_peered":"2024-09-05T07:29:31.631381+0000","last_clean":"2024-09-05T07:29:31.631381+0000","last_became_active":"2024-09-05T07:29:30.656997+0000","last_became_peered":"2024-09-05T07:29:30.656997+0000","last_unstale":"2024-09-05T07:29:31.631381+0000","last_undegraded":"2024-09-05T07:29:31.631381+0000","last_fullsized":"2024-09-05T07:29:31.631381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:15:28.381136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.625605+0000","last_change":"2024-09-05T07:29:30.641543+0000","last_active":"2024-09-05T07:29:31.625605+0000","last_peered":"2024-09-05T07:29:31.625605+0000","last_clean":"2024-09-05T07:29:31.625605+0000","last_became_active":"2024-09-05T07:29:30.641283+0000","last_became_peered":"2024-09-05T07:29:30.641283+0000","last_unstale":"2024-09-05T07:29:31.625605+0000","last_undegraded":"2024-09-05T07:29:31.625605+0000","last_fullsized":"2024-09-05T07:29:31.625605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:36:59.967135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.626113+0000","last_change":"2024-09-05T07:29:30.558414+0000","last_active":"2024-09-05T07:29:31.626113+0000","last_peered":"2024-09-05T07:29:31.626113+0000","last_clean":"2024-09-05T07:29:31.626113+0000","last_became_active":"2024-09-05T07:29:30.558105+0000","last_became_peered":"2024-09-05T07:29:30.558105+0000","last_unstale":"2024-09-05T07:29:31.626113+0000","last_undegraded":"2024-09-05T07:29:31.626113+0000","last_fullsized":"2024-09-05T07:29:31.626113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:55:31.494616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908249+0000","last_change":"2024-09-05T07:29:30.643169+0000","last_active":"2024-09-05T07:29:31.908249+0000","last_peered":"2024-09-05T07:29:31.908249+0000","last_clean":"2024-09-05T07:29:31.908249+0000","last_became_active":"2024-09-05T07:29:30.642876+0000","last_became_peered":"2024-09-05T07:29:30.642876+0000","last_unstale":"2024-09-05T07:29:31.908249+0000","last_undegraded":"2024-09-05T07:29:31.908249+0000","last_fullsized":"2024-09-05T07:29:31.908249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:40.101513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.626245+0000","last_change":"2024-09-05T07:29:30.557239+0000","last_active":"2024-09-05T07:29:31.626245+0000","last_peered":"2024-09-05T07:29:31.626245+0000","last_clean":"2024-09-05T07:29:31.626245+0000","last_became_active":"2024-09-05T07:29:30.556969+0000","last_became_peered":"2024-09-05T07:29:30.556969+0000","last_unstale":"2024-09-05T07:29:31.626245+0000","last_undegraded":"2024-09-05T07:29:31.626245+0000","last_fullsized":"2024-09-05T07:29:31.626245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:47:29.801348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881573+0000","last_change":"2024-09-05T07:29:30.564077+0000","last_active":"2024-09-05T07:29:31.881573+0000","last_peered":"2024-09-05T07:29:31.881573+0000","last_clean":"2024-09-05T07:29:31.881573+0000","last_became_active":"2024-09-05T07:29:30.563808+0000","last_became_peered":"2024-09-05T07:29:30.563808+0000","last_unstale":"2024-09-05T07:29:31.881573+0000","last_undegraded":"2024-09-05T07:29:31.881573+0000","last_fullsized":"2024-09-05T07:29:31.881573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:00:35.625571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.668993+0000","last_change":"2024-09-05T07:29:30.643879+0000","last_active":"2024-09-05T07:29:31.668993+0000","last_peered":"2024-09-05T07:29:31.668993+0000","last_clean":"2024-09-05T07:29:31.668993+0000","last_became_active":"2024-09-05T07:29:30.643559+0000","last_became_peered":"2024-09-05T07:29:30.643559+0000","last_unstale":"2024-09-05T07:29:31.668993+0000","last_undegraded":"2024-09-05T07:29:31.668993+0000","last_fullsized":"2024-09-05T07:29:31.668993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:52:56.756904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.907631+0000","last_change":"2024-09-05T07:29:30.564954+0000","last_active":"2024-09-05T07:29:31.907631+0000","last_peered":"2024-09-05T07:29:31.907631+0000","last_clean":"2024-09-05T07:29:31.907631+0000","last_became_active":"2024-09-05T07:29:30.564669+0000","last_became_peered":"2024-09-05T07:29:30.564669+0000","last_unstale":"2024-09-05T07:29:31.907631+0000","last_undegraded":"2024-09-05T07:29:31.907631+0000","last_fullsized":"2024-09-05T07:29:31.907631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:53:40.150507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.631446+0000","last_change":"2024-09-05T07:29:30.656718+0000","last_active":"2024-09-05T07:29:31.631446+0000","last_peered":"2024-09-05T07:29:31.631446+0000","last_clean":"2024-09-05T07:29:31.631446+0000","last_became_active":"2024-09-05T07:29:30.656451+0000","last_became_peered":"2024-09-05T07:29:30.656451+0000","last_unstale":"2024-09-05T07:29:31.631446+0000","last_undegraded":"2024-09-05T07:29:31.631446+0000","last_fullsized":"2024-09-05T07:29:31.631446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:38:11.961137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.625602+0000","last_change":"2024-09-05T07:29:30.658481+0000","last_active":"2024-09-05T07:29:31.625602+0000","last_peered":"2024-09-05T07:29:31.625602+0000","last_clean":"2024-09-05T07:29:31.625602+0000","last_became_active":"2024-09-05T07:29:30.658207+0000","last_became_peered":"2024-09-05T07:29:30.658207+0000","last_unstale":"2024-09-05T07:29:31.625602+0000","last_undegraded":"2024-09-05T07:29:31.625602+0000","last_fullsized":"2024-09-05T07:29:31.625602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:23:04.483495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.631597+0000","last_change":"2024-09-05T07:29:30.657936+0000","last_active":"2024-09-05T07:29:31.631597+0000","last_peered":"2024-09-05T07:29:31.631597+0000","last_clean":"2024-09-05T07:29:31.631597+0000","last_became_active":"2024-09-05T07:29:30.657177+0000","last_became_peered":"2024-09-05T07:29:30.657177+0000","last_unstale":"2024-09-05T07:29:31.631597+0000","last_undegraded":"2024-09-05T07:29:31.631597+0000","last_fullsized":"2024-09-05T07:29:31.631597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:01:34.217228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.882231+0000","last_change":"2024-09-05T07:29:30.642790+0000","last_active":"2024-09-05T07:29:31.882231+0000","last_peered":"2024-09-05T07:29:31.882231+0000","last_clean":"2024-09-05T07:29:31.882231+0000","last_became_active":"2024-09-05T07:29:30.641834+0000","last_became_peered":"2024-09-05T07:29:30.641834+0000","last_unstale":"2024-09-05T07:29:31.882231+0000","last_undegraded":"2024-09-05T07:29:31.882231+0000","last_fullsized":"2024-09-05T07:29:31.882231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:34:17.448981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908717+0000","last_change":"2024-09-05T07:29:30.633776+0000","last_active":"2024-09-05T07:29:31.908717+0000","last_peered":"2024-09-05T07:29:31.908717+0000","last_clean":"2024-09-05T07:29:31.908717+0000","last_became_active":"2024-09-05T07:29:30.633507+0000","last_became_peered":"2024-09-05T07:29:30.633507+0000","last_unstale":"2024-09-05T07:29:31.908717+0000","last_undegraded":"2024-09-05T07:29:31.908717+0000","last_fullsized":"2024-09-05T07:29:31.908717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:34:54.335152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908515+0000","last_change":"2024-09-05T07:29:30.632558+0000","last_active":"2024-09-05T07:29:31.908515+0000","last_peered":"2024-09-05T07:29:31.908515+0000","last_clean":"2024-09-05T07:29:31.908515+0000","last_became_active":"2024-09-05T07:29:30.632269+0000","last_became_peered":"2024-09-05T07:29:30.632269+0000","last_unstale":"2024-09-05T07:29:31.908515+0000","last_undegraded":"2024-09-05T07:29:31.908515+0000","last_fullsized":"2024-09-05T07:29:31.908515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:35:18.927192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.631730+0000","last_change":"2024-09-05T07:29:30.656638+0000","last_active":"2024-09-05T07:29:31.631730+0000","last_peered":"2024-09-05T07:29:31.631730+0000","last_clean":"2024-09-05T07:29:31.631730+0000","last_became_active":"2024-09-05T07:29:30.656382+0000","last_became_peered":"2024-09-05T07:29:30.656382+0000","last_unstale":"2024-09-05T07:29:31.631730+0000","last_undegraded":"2024-09-05T07:29:31.631730+0000","last_fullsized":"2024-09-05T07:29:31.631730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:34:49.879681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.625711+0000","last_change":"2024-09-05T07:29:30.657421+0000","last_active":"2024-09-05T07:29:31.625711+0000","last_peered":"2024-09-05T07:29:31.625711+0000","last_clean":"2024-09-05T07:29:31.625711+0000","last_became_active":"2024-09-05T07:29:30.657159+0000","last_became_peered":"2024-09-05T07:29:30.657159+0000","last_unstale":"2024-09-05T07:29:31.625711+0000","last_undegraded":"2024-09-05T07:29:31.625711+0000","last_fullsized":"2024-09-05T07:29:31.625711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:13:05.334750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908422+0000","last_change":"2024-09-05T07:29:30.624866+0000","last_active":"2024-09-05T07:29:31.908422+0000","last_peered":"2024-09-05T07:29:31.908422+0000","last_clean":"2024-09-05T07:29:31.908422+0000","last_became_active":"2024-09-05T07:29:30.624605+0000","last_became_peered":"2024-09-05T07:29:30.624605+0000","last_unstale":"2024-09-05T07:29:31.908422+0000","last_undegraded":"2024-09-05T07:29:31.908422+0000","last_fullsized":"2024-09-05T07:29:31.908422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:42.938157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881624+0000","last_change":"2024-09-05T07:29:30.642514+0000","last_active":"2024-09-05T07:29:31.881624+0000","last_peered":"2024-09-05T07:29:31.881624+0000","last_clean":"2024-09-05T07:29:31.881624+0000","last_became_active":"2024-09-05T07:29:30.642084+0000","last_became_peered":"2024-09-05T07:29:30.642084+0000","last_unstale":"2024-09-05T07:29:31.881624+0000","last_undegraded":"2024-09-05T07:29:31.881624+0000","last_fullsized":"2024-09-05T07:29:31.881624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:40.101513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.907656+0000","last_change":"2024-09-05T07:29:30.657456+0000","last_active":"2024-09-05T07:29:31.907656+0000","last_peered":"2024-09-05T07:29:31.907656+0000","last_clean":"2024-09-05T07:29:31.907656+0000","last_became_active":"2024-09-05T07:29:30.657117+0000","last_became_peered":"2024-09-05T07:29:30.657117+0000","last_unstale":"2024-09-05T07:29:31.907656+0000","last_undegraded":"2024-09-05T07:29:31.907656+0000","last_fullsized":"2024-09-05T07:29:31.907656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:40.101513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'5","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.497941+0000","last_change":"2024-09-05T07:29:29.568126+0000","last_active":"2024-09-05T07:29:36.497941+0000","last_peered":"2024-09-05T07:29:36.497941+0000","last_clean":"2024-09-05T07:29:36.497941+0000","last_became_active":"2024-09-05T07:29:29.567846+0000","last_became_peered":"2024-09-05T07:29:29.567846+0000","last_unstale":"2024-09-05T07:29:36.497941+0000","last_undegraded":"2024-09-05T07:29:36.497941+0000","last_fullsized":"2024-09-05T07:29:36.497941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:48:25.900221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.669165+0000","last_change":"2024-09-05T07:29:30.557504+0000","last_active":"2024-09-05T07:29:31.669165+0000","last_peered":"2024-09-05T07:29:31.669165+0000","last_clean":"2024-09-05T07:29:31.669165+0000","last_became_active":"2024-09-05T07:29:30.557203+0000","last_became_peered":"2024-09-05T07:29:30.557203+0000","last_unstale":"2024-09-05T07:29:31.669165+0000","last_undegraded":"2024-09-05T07:29:31.669165+0000","last_fullsized":"2024-09-05T07:29:31.669165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:55:13.742728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.626198+0000","last_change":"2024-09-05T07:29:29.524587+0000","last_active":"2024-09-05T07:29:31.626198+0000","last_peered":"2024-09-05T07:29:31.626198+0000","last_clean":"2024-09-05T07:29:31.626198+0000","last_became_active":"2024-09-05T07:29:29.524321+0000","last_became_peered":"2024-09-05T07:29:29.524321+0000","last_unstale":"2024-09-05T07:29:31.626198+0000","last_undegraded":"2024-09-05T07:29:31.626198+0000","last_fullsized":"2024-09-05T07:29:31.626198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:53:13.376716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908122+0000","last_change":"2024-09-05T07:29:29.570879+0000","last_active":"2024-09-05T07:29:31.908122+0000","last_peered":"2024-09-05T07:29:31.908122+0000","last_clean":"2024-09-05T07:29:31.908122+0000","last_became_active":"2024-09-05T07:29:29.570456+0000","last_became_peered":"2024-09-05T07:29:29.570456+0000","last_unstale":"2024-09-05T07:29:31.908122+0000","last_undegraded":"2024-09-05T07:29:31.908122+0000","last_fullsized":"2024-09-05T07:29:31.908122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:52:54.638586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.632417+0000","last_change":"2024-09-05T07:29:30.657364+0000","last_active":"2024-09-05T07:29:31.632417+0000","last_peered":"2024-09-05T07:29:31.632417+0000","last_clean":"2024-09-05T07:29:31.632417+0000","last_became_active":"2024-09-05T07:29:30.657008+0000","last_became_peered":"2024-09-05T07:29:30.657008+0000","last_unstale":"2024-09-05T07:29:31.632417+0000","last_undegraded":"2024-09-05T07:29:31.632417+0000","last_fullsized":"2024-09-05T07:29:31.632417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:36:59.967135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.626059+0000","last_change":"2024-09-05T07:29:29.562802+0000","last_active":"2024-09-05T07:29:31.626059+0000","last_peered":"2024-09-05T07:29:31.626059+0000","last_clean":"2024-09-05T07:29:31.626059+0000","last_became_active":"2024-09-05T07:29:29.562520+0000","last_became_peered":"2024-09-05T07:29:29.562520+0000","last_unstale":"2024-09-05T07:29:31.626059+0000","last_undegraded":"2024-09-05T07:29:31.626059+0000","last_fullsized":"2024-09-05T07:29:31.626059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:34:16.308797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.669116+0000","last_change":"2024-09-05T07:29:30.563197+0000","last_active":"2024-09-05T07:29:31.669116+0000","last_peered":"2024-09-05T07:29:31.669116+0000","last_clean":"2024-09-05T07:29:31.669116+0000","last_became_active":"2024-09-05T07:29:30.562945+0000","last_became_peered":"2024-09-05T07:29:30.562945+0000","last_unstale":"2024-09-05T07:29:31.669116+0000","last_undegraded":"2024-09-05T07:29:31.669116+0000","last_fullsized":"2024-09-05T07:29:31.669116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:31:37.754325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.489982+0000","last_change":"2024-09-05T07:29:29.559012+0000","last_active":"2024-09-05T07:29:36.489982+0000","last_peered":"2024-09-05T07:29:36.489982+0000","last_clean":"2024-09-05T07:29:36.489982+0000","last_became_active":"2024-09-05T07:29:29.558744+0000","last_became_peered":"2024-09-05T07:29:29.558744+0000","last_unstale":"2024-09-05T07:29:36.489982+0000","last_undegraded":"2024-09-05T07:29:36.489982+0000","last_fullsized":"2024-09-05T07:29:36.489982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:28:41.630593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.882278+0000","last_change":"2024-09-05T07:29:30.641594+0000","last_active":"2024-09-05T07:29:31.882278+0000","last_peered":"2024-09-05T07:29:31.882278+0000","last_clean":"2024-09-05T07:29:31.882278+0000","last_became_active":"2024-09-05T07:29:30.641360+0000","last_became_peered":"2024-09-05T07:29:30.641360+0000","last_unstale":"2024-09-05T07:29:31.882278+0000","last_undegraded":"2024-09-05T07:29:31.882278+0000","last_fullsized":"2024-09-05T07:29:31.882278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:49:40.327718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881205+0000","last_change":"2024-09-05T07:29:29.559998+0000","last_active":"2024-09-05T07:29:31.881205+0000","last_peered":"2024-09-05T07:29:31.881205+0000","last_clean":"2024-09-05T07:29:31.881205+0000","last_became_active":"2024-09-05T07:29:29.559717+0000","last_became_peered":"2024-09-05T07:29:29.559717+0000","last_unstale":"2024-09-05T07:29:31.881205+0000","last_undegraded":"2024-09-05T07:29:31.881205+0000","last_fullsized":"2024-09-05T07:29:31.881205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:58.513308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.632185+0000","last_change":"2024-09-05T07:29:30.657727+0000","last_active":"2024-09-05T07:29:31.632185+0000","last_peered":"2024-09-05T07:29:31.632185+0000","last_clean":"2024-09-05T07:29:31.632185+0000","last_became_active":"2024-09-05T07:29:30.657038+0000","last_became_peered":"2024-09-05T07:29:30.657038+0000","last_unstale":"2024-09-05T07:29:31.632185+0000","last_undegraded":"2024-09-05T07:29:31.632185+0000","last_fullsized":"2024-09-05T07:29:31.632185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:00:35.625571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.962311+0000","last_change":"2024-09-05T07:29:29.566840+0000","last_active":"2024-09-05T07:29:31.962311+0000","last_peered":"2024-09-05T07:29:31.962311+0000","last_clean":"2024-09-05T07:29:31.962311+0000","last_became_active":"2024-09-05T07:29:29.566501+0000","last_became_peered":"2024-09-05T07:29:29.566501+0000","last_unstale":"2024-09-05T07:29:31.962311+0000","last_undegraded":"2024-09-05T07:29:31.962311+0000","last_fullsized":"2024-09-05T07:29:31.962311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:47:57.187710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.625755+0000","last_change":"2024-09-05T07:29:30.642252+0000","last_active":"2024-09-05T07:29:31.625755+0000","last_peered":"2024-09-05T07:29:31.625755+0000","last_clean":"2024-09-05T07:29:31.625755+0000","last_became_active":"2024-09-05T07:29:30.641991+0000","last_became_peered":"2024-09-05T07:29:30.641991+0000","last_unstale":"2024-09-05T07:29:31.625755+0000","last_undegraded":"2024-09-05T07:29:31.625755+0000","last_fullsized":"2024-09-05T07:29:31.625755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:42:04.216273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.495388+0000","last_change":"2024-09-05T07:29:29.562441+0000","last_active":"2024-09-05T07:29:36.495388+0000","last_peered":"2024-09-05T07:29:36.495388+0000","last_clean":"2024-09-05T07:29:36.495388+0000","last_became_active":"2024-09-05T07:29:29.562136+0000","last_became_peered":"2024-09-05T07:29:29.562136+0000","last_unstale":"2024-09-05T07:29:36.495388+0000","last_undegraded":"2024-09-05T07:29:36.495388+0000","last_fullsized":"2024-09-05T07:29:36.495388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:06:20.633881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881213+0000","last_change":"2024-09-05T07:29:30.633033+0000","last_active":"2024-09-05T07:29:31.881213+0000","last_peered":"2024-09-05T07:29:31.881213+0000","last_clean":"2024-09-05T07:29:31.881213+0000","last_became_active":"2024-09-05T07:29:30.632784+0000","last_became_peered":"2024-09-05T07:29:30.632784+0000","last_unstale":"2024-09-05T07:29:31.881213+0000","last_undegraded":"2024-09-05T07:29:31.881213+0000","last_fullsized":"2024-09-05T07:29:31.881213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:03:07.788844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.411896+0000","last_change":"2024-09-05T07:29:29.567195+0000","last_active":"2024-09-05T07:29:36.411896+0000","last_peered":"2024-09-05T07:29:36.411896+0000","last_clean":"2024-09-05T07:29:36.411896+0000","last_became_active":"2024-09-05T07:29:29.566934+0000","last_became_peered":"2024-09-05T07:29:29.566934+0000","last_unstale":"2024-09-05T07:29:36.411896+0000","last_undegraded":"2024-09-05T07:29:36.411896+0000","last_fullsized":"2024-09-05T07:29:36.411896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:10:28.438071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908548+0000","last_change":"2024-09-05T07:29:30.632260+0000","last_active":"2024-09-05T07:29:31.908548+0000","last_peered":"2024-09-05T07:29:31.908548+0000","last_clean":"2024-09-05T07:29:31.908548+0000","last_became_active":"2024-09-05T07:29:30.631974+0000","last_became_peered":"2024-09-05T07:29:30.631974+0000","last_unstale":"2024-09-05T07:29:31.908548+0000","last_undegraded":"2024-09-05T07:29:31.908548+0000","last_fullsized":"2024-09-05T07:29:31.908548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:45:00.967978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.418310+0000","last_change":"2024-09-05T07:29:29.567028+0000","last_active":"2024-09-05T07:29:36.418310+0000","last_peered":"2024-09-05T07:29:36.418310+0000","last_clean":"2024-09-05T07:29:36.418310+0000","last_became_active":"2024-09-05T07:29:29.566754+0000","last_became_peered":"2024-09-05T07:29:29.566754+0000","last_unstale":"2024-09-05T07:29:36.418310+0000","last_undegraded":"2024-09-05T07:29:36.418310+0000","last_fullsized":"2024-09-05T07:29:36.418310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:49:13.565181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.626093+0000","last_change":"2024-09-05T07:29:30.558658+0000","last_active":"2024-09-05T07:29:31.626093+0000","last_peered":"2024-09-05T07:29:31.626093+0000","last_clean":"2024-09-05T07:29:31.626093+0000","last_became_active":"2024-09-05T07:29:30.558179+0000","last_became_peered":"2024-09-05T07:29:30.558179+0000","last_unstale":"2024-09-05T07:29:31.626093+0000","last_undegraded":"2024-09-05T07:29:31.626093+0000","last_fullsized":"2024-09-05T07:29:31.626093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:44:13.003367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.880926+0000","last_change":"2024-09-05T07:29:29.525420+0000","last_active":"2024-09-05T07:29:31.880926+0000","last_peered":"2024-09-05T07:29:31.880926+0000","last_clean":"2024-09-05T07:29:31.880926+0000","last_became_active":"2024-09-05T07:29:29.525139+0000","last_became_peered":"2024-09-05T07:29:29.525139+0000","last_unstale":"2024-09-05T07:29:31.880926+0000","last_undegraded":"2024-09-05T07:29:31.880926+0000","last_fullsized":"2024-09-05T07:29:31.880926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:54:00.339029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.907555+0000","last_change":"2024-09-05T07:29:30.659606+0000","last_active":"2024-09-05T07:29:31.907555+0000","last_peered":"2024-09-05T07:29:31.907555+0000","last_clean":"2024-09-05T07:29:31.907555+0000","last_became_active":"2024-09-05T07:29:30.659311+0000","last_became_peered":"2024-09-05T07:29:30.659311+0000","last_unstale":"2024-09-05T07:29:31.907555+0000","last_undegraded":"2024-09-05T07:29:31.907555+0000","last_fullsized":"2024-09-05T07:29:31.907555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:54:01.479214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:32.039691+0000","last_change":"2024-09-05T07:29:29.566784+0000","last_active":"2024-09-05T07:29:32.039691+0000","last_peered":"2024-09-05T07:29:32.039691+0000","last_clean":"2024-09-05T07:29:32.039691+0000","last_became_active":"2024-09-05T07:29:29.566503+0000","last_became_peered":"2024-09-05T07:29:29.566503+0000","last_unstale":"2024-09-05T07:29:32.039691+0000","last_undegraded":"2024-09-05T07:29:32.039691+0000","last_fullsized":"2024-09-05T07:29:32.039691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:35:54.465221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.625644+0000","last_change":"2024-09-05T07:29:30.641565+0000","last_active":"2024-09-05T07:29:31.625644+0000","last_peered":"2024-09-05T07:29:31.625644+0000","last_clean":"2024-09-05T07:29:31.625644+0000","last_became_active":"2024-09-05T07:29:30.641309+0000","last_became_peered":"2024-09-05T07:29:30.641309+0000","last_unstale":"2024-09-05T07:29:31.625644+0000","last_undegraded":"2024-09-05T07:29:31.625644+0000","last_fullsized":"2024-09-05T07:29:31.625644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:37:28.088603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881203+0000","last_change":"2024-09-05T07:29:29.524793+0000","last_active":"2024-09-05T07:29:31.881203+0000","last_peered":"2024-09-05T07:29:31.881203+0000","last_clean":"2024-09-05T07:29:31.881203+0000","last_became_active":"2024-09-05T07:29:29.524522+0000","last_became_peered":"2024-09-05T07:29:29.524522+0000","last_unstale":"2024-09-05T07:29:31.881203+0000","last_undegraded":"2024-09-05T07:29:31.881203+0000","last_fullsized":"2024-09-05T07:29:31.881203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:41.797972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.882353+0000","last_change":"2024-09-05T07:29:30.642565+0000","last_active":"2024-09-05T07:29:31.882353+0000","last_peered":"2024-09-05T07:29:31.882353+0000","last_clean":"2024-09-05T07:29:31.882353+0000","last_became_active":"2024-09-05T07:29:30.641774+0000","last_became_peered":"2024-09-05T07:29:30.641774+0000","last_unstale":"2024-09-05T07:29:31.882353+0000","last_undegraded":"2024-09-05T07:29:31.882353+0000","last_fullsized":"2024-09-05T07:29:31.882353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:09:36.911425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:32.036409+0000","last_change":"2024-09-05T07:29:29.525374+0000","last_active":"2024-09-05T07:29:32.036409+0000","last_peered":"2024-09-05T07:29:32.036409+0000","last_clean":"2024-09-05T07:29:32.036409+0000","last_became_active":"2024-09-05T07:29:29.525044+0000","last_became_peered":"2024-09-05T07:29:29.525044+0000","last_unstale":"2024-09-05T07:29:32.036409+0000","last_undegraded":"2024-09-05T07:29:32.036409+0000","last_fullsized":"2024-09-05T07:29:32.036409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:25:35.862773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881625+0000","last_change":"2024-09-05T07:29:30.563669+0000","last_active":"2024-09-05T07:29:31.881625+0000","last_peered":"2024-09-05T07:29:31.881625+0000","last_clean":"2024-09-05T07:29:31.881625+0000","last_became_active":"2024-09-05T07:29:30.563408+0000","last_became_peered":"2024-09-05T07:29:30.563408+0000","last_unstale":"2024-09-05T07:29:31.881625+0000","last_undegraded":"2024-09-05T07:29:31.881625+0000","last_fullsized":"2024-09-05T07:29:31.881625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:42:04.216273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:32.041498+0000","last_change":"2024-09-05T07:29:29.559111+0000","last_active":"2024-09-05T07:29:32.041498+0000","last_peered":"2024-09-05T07:29:32.041498+0000","last_clean":"2024-09-05T07:29:32.041498+0000","last_became_active":"2024-09-05T07:29:29.558856+0000","last_became_peered":"2024-09-05T07:29:29.558856+0000","last_unstale":"2024-09-05T07:29:32.041498+0000","last_undegraded":"2024-09-05T07:29:32.041498+0000","last_fullsized":"2024-09-05T07:29:32.041498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:47:57.187710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881728+0000","last_change":"2024-09-05T07:29:30.624401+0000","last_active":"2024-09-05T07:29:31.881728+0000","last_peered":"2024-09-05T07:29:31.881728+0000","last_clean":"2024-09-05T07:29:31.881728+0000","last_became_active":"2024-09-05T07:29:30.624057+0000","last_became_peered":"2024-09-05T07:29:30.624057+0000","last_unstale":"2024-09-05T07:29:31.881728+0000","last_undegraded":"2024-09-05T07:29:31.881728+0000","last_fullsized":"2024-09-05T07:29:31.881728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:36:59.967135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908780+0000","last_change":"2024-09-05T07:29:29.570940+0000","last_active":"2024-09-05T07:29:31.908780+0000","last_peered":"2024-09-05T07:29:31.908780+0000","last_clean":"2024-09-05T07:29:31.908780+0000","last_became_active":"2024-09-05T07:29:29.570478+0000","last_became_peered":"2024-09-05T07:29:29.570478+0000","last_unstale":"2024-09-05T07:29:31.908780+0000","last_undegraded":"2024-09-05T07:29:31.908780+0000","last_fullsized":"2024-09-05T07:29:31.908780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:35:54.465221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.625978+0000","last_change":"2024-09-05T07:29:30.563109+0000","last_active":"2024-09-05T07:29:31.625978+0000","last_peered":"2024-09-05T07:29:31.625978+0000","last_clean":"2024-09-05T07:29:31.625978+0000","last_became_active":"2024-09-05T07:29:30.562824+0000","last_became_peered":"2024-09-05T07:29:30.562824+0000","last_unstale":"2024-09-05T07:29:31.625978+0000","last_undegraded":"2024-09-05T07:29:31.625978+0000","last_fullsized":"2024-09-05T07:29:31.625978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:42:02.212868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":171,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.907582+0000","last_change":"2024-09-05T07:29:13.366600+0000","last_active":"2024-09-05T07:29:31.907582+0000","last_peered":"2024-09-05T07:29:31.907582+0000","last_clean":"2024-09-05T07:29:31.907582+0000","last_became_active":"2024-09-05T07:29:13.365841+0000","last_became_peered":"2024-09-05T07:29:13.365841+0000","last_unstale":"2024-09-05T07:29:31.907582+0000","last_undegraded":"2024-09-05T07:29:31.907582+0000","last_fullsized":"2024-09-05T07:29:31.907582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:10.874807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:10.874807+0000","last_clean_scrub_stamp":"2024-09-05T07:29:10.874807+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:21:17.673107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.418148+0000","last_change":"2024-09-05T07:29:29.563604+0000","last_active":"2024-09-05T07:29:36.418148+0000","last_peered":"2024-09-05T07:29:36.418148+0000","last_clean":"2024-09-05T07:29:36.418148+0000","last_became_active":"2024-09-05T07:29:29.562956+0000","last_became_peered":"2024-09-05T07:29:29.562956+0000","last_unstale":"2024-09-05T07:29:36.418148+0000","last_undegraded":"2024-09-05T07:29:36.418148+0000","last_fullsized":"2024-09-05T07:29:36.418148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:41.797972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.669026+0000","last_change":"2024-09-05T07:29:30.641543+0000","last_active":"2024-09-05T07:29:31.669026+0000","last_peered":"2024-09-05T07:29:31.669026+0000","last_clean":"2024-09-05T07:29:31.669026+0000","last_became_active":"2024-09-05T07:29:30.641243+0000","last_became_peered":"2024-09-05T07:29:30.641243+0000","last_unstale":"2024-09-05T07:29:31.669026+0000","last_undegraded":"2024-09-05T07:29:31.669026+0000","last_fullsized":"2024-09-05T07:29:31.669026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:34:54.335152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.625958+0000","last_change":"2024-09-05T07:29:29.479329+0000","last_active":"2024-09-05T07:29:31.625958+0000","last_peered":"2024-09-05T07:29:31.625958+0000","last_clean":"2024-09-05T07:29:31.625958+0000","last_became_active":"2024-09-05T07:29:29.479005+0000","last_became_peered":"2024-09-05T07:29:29.479005+0000","last_unstale":"2024-09-05T07:29:31.625958+0000","last_undegraded":"2024-09-05T07:29:31.625958+0000","last_fullsized":"2024-09-05T07:29:31.625958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:49:39.187534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908022+0000","last_change":"2024-09-05T07:29:30.641557+0000","last_active":"2024-09-05T07:29:31.908022+0000","last_peered":"2024-09-05T07:29:31.908022+0000","last_clean":"2024-09-05T07:29:31.908022+0000","last_became_active":"2024-09-05T07:29:30.641269+0000","last_became_peered":"2024-09-05T07:29:30.641269+0000","last_unstale":"2024-09-05T07:29:31.908022+0000","last_undegraded":"2024-09-05T07:29:31.908022+0000","last_fullsized":"2024-09-05T07:29:31.908022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:32:30.263430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908555+0000","last_change":"2024-09-05T07:29:29.568835+0000","last_active":"2024-09-05T07:29:31.908555+0000","last_peered":"2024-09-05T07:29:31.908555+0000","last_clean":"2024-09-05T07:29:31.908555+0000","last_became_active":"2024-09-05T07:29:29.568576+0000","last_became_peered":"2024-09-05T07:29:29.568576+0000","last_unstale":"2024-09-05T07:29:31.908555+0000","last_undegraded":"2024-09-05T07:29:31.908555+0000","last_fullsized":"2024-09-05T07:29:31.908555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:05:05.417016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.632195+0000","last_change":"2024-09-05T07:29:30.660008+0000","last_active":"2024-09-05T07:29:31.632195+0000","last_peered":"2024-09-05T07:29:31.632195+0000","last_clean":"2024-09-05T07:29:31.632195+0000","last_became_active":"2024-09-05T07:29:30.659720+0000","last_became_peered":"2024-09-05T07:29:30.659720+0000","last_unstale":"2024-09-05T07:29:31.632195+0000","last_undegraded":"2024-09-05T07:29:31.632195+0000","last_fullsized":"2024-09-05T07:29:31.632195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:42:04.216273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.626314+0000","last_change":"2024-09-05T07:29:29.568569+0000","last_active":"2024-09-05T07:29:31.626314+0000","last_peered":"2024-09-05T07:29:31.626314+0000","last_clean":"2024-09-05T07:29:31.626314+0000","last_became_active":"2024-09-05T07:29:29.568307+0000","last_became_peered":"2024-09-05T07:29:29.568307+0000","last_unstale":"2024-09-05T07:29:31.626314+0000","last_undegraded":"2024-09-05T07:29:31.626314+0000","last_fullsized":"2024-09-05T07:29:31.626314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:12:38.814463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881267+0000","last_change":"2024-09-05T07:29:30.642687+0000","last_active":"2024-09-05T07:29:31.881267+0000","last_peered":"2024-09-05T07:29:31.881267+0000","last_clean":"2024-09-05T07:29:31.881267+0000","last_became_active":"2024-09-05T07:29:30.642414+0000","last_became_peered":"2024-09-05T07:29:30.642414+0000","last_unstale":"2024-09-05T07:29:31.881267+0000","last_undegraded":"2024-09-05T07:29:31.881267+0000","last_fullsized":"2024-09-05T07:29:31.881267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:01:34.217228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.631634+0000","last_change":"2024-09-05T07:29:29.568739+0000","last_active":"2024-09-05T07:29:31.631634+0000","last_peered":"2024-09-05T07:29:31.631634+0000","last_clean":"2024-09-05T07:29:31.631634+0000","last_became_active":"2024-09-05T07:29:29.568499+0000","last_became_peered":"2024-09-05T07:29:29.568499+0000","last_unstale":"2024-09-05T07:29:31.631634+0000","last_undegraded":"2024-09-05T07:29:31.631634+0000","last_fullsized":"2024-09-05T07:29:31.631634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:05:05.417016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881813+0000","last_change":"2024-09-05T07:29:30.641340+0000","last_active":"2024-09-05T07:29:31.881813+0000","last_peered":"2024-09-05T07:29:31.881813+0000","last_clean":"2024-09-05T07:29:31.881813+0000","last_became_active":"2024-09-05T07:29:30.640805+0000","last_became_peered":"2024-09-05T07:29:30.640805+0000","last_unstale":"2024-09-05T07:29:31.881813+0000","last_undegraded":"2024-09-05T07:29:31.881813+0000","last_fullsized":"2024-09-05T07:29:31.881813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:59.653492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.626381+0000","last_change":"2024-09-05T07:29:29.525212+0000","last_active":"2024-09-05T07:29:31.626381+0000","last_peered":"2024-09-05T07:29:31.626381+0000","last_clean":"2024-09-05T07:29:31.626381+0000","last_became_active":"2024-09-05T07:29:29.524918+0000","last_became_peered":"2024-09-05T07:29:29.524918+0000","last_unstale":"2024-09-05T07:29:31.626381+0000","last_undegraded":"2024-09-05T07:29:31.626381+0000","last_fullsized":"2024-09-05T07:29:31.626381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:09:35.771241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908661+0000","last_change":"2024-09-05T07:29:30.658407+0000","last_active":"2024-09-05T07:29:31.908661+0000","last_peered":"2024-09-05T07:29:31.908661+0000","last_clean":"2024-09-05T07:29:31.908661+0000","last_became_active":"2024-09-05T07:29:30.658155+0000","last_became_peered":"2024-09-05T07:29:30.658155+0000","last_unstale":"2024-09-05T07:29:31.908661+0000","last_undegraded":"2024-09-05T07:29:31.908661+0000","last_fullsized":"2024-09-05T07:29:31.908661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:52:56.756904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.669406+0000","last_change":"2024-09-05T07:29:29.526674+0000","last_active":"2024-09-05T07:29:31.669406+0000","last_peered":"2024-09-05T07:29:31.669406+0000","last_clean":"2024-09-05T07:29:31.669406+0000","last_became_active":"2024-09-05T07:29:29.526421+0000","last_became_peered":"2024-09-05T07:29:29.526421+0000","last_unstale":"2024-09-05T07:29:31.669406+0000","last_undegraded":"2024-09-05T07:29:31.669406+0000","last_fullsized":"2024-09-05T07:29:31.669406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:52:13.496606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.669439+0000","last_change":"2024-09-05T07:29:30.633806+0000","last_active":"2024-09-05T07:29:31.669439+0000","last_peered":"2024-09-05T07:29:31.669439+0000","last_clean":"2024-09-05T07:29:31.669439+0000","last_became_active":"2024-09-05T07:29:30.633535+0000","last_became_peered":"2024-09-05T07:29:30.633535+0000","last_unstale":"2024-09-05T07:29:31.669439+0000","last_undegraded":"2024-09-05T07:29:31.669439+0000","last_fullsized":"2024-09-05T07:29:31.669439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:40:35.334862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.417663+0000","last_change":"2024-09-05T07:29:29.524532+0000","last_active":"2024-09-05T07:29:36.417663+0000","last_peered":"2024-09-05T07:29:36.417663+0000","last_clean":"2024-09-05T07:29:36.417663+0000","last_became_active":"2024-09-05T07:29:29.524268+0000","last_became_peered":"2024-09-05T07:29:29.524268+0000","last_unstale":"2024-09-05T07:29:36.417663+0000","last_undegraded":"2024-09-05T07:29:36.417663+0000","last_fullsized":"2024-09-05T07:29:36.417663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:58.513308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.669296+0000","last_change":"2024-09-05T07:29:30.624431+0000","last_active":"2024-09-05T07:29:31.669296+0000","last_peered":"2024-09-05T07:29:31.669296+0000","last_clean":"2024-09-05T07:29:31.669296+0000","last_became_active":"2024-09-05T07:29:30.624117+0000","last_became_peered":"2024-09-05T07:29:30.624117+0000","last_unstale":"2024-09-05T07:29:31.669296+0000","last_undegraded":"2024-09-05T07:29:31.669296+0000","last_fullsized":"2024-09-05T07:29:31.669296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:10:00.845713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.880568+0000","last_change":"2024-09-05T07:29:29.561285+0000","last_active":"2024-09-05T07:29:31.880568+0000","last_peered":"2024-09-05T07:29:31.880568+0000","last_clean":"2024-09-05T07:29:31.880568+0000","last_became_active":"2024-09-05T07:29:29.561026+0000","last_became_peered":"2024-09-05T07:29:29.561026+0000","last_unstale":"2024-09-05T07:29:31.880568+0000","last_undegraded":"2024-09-05T07:29:31.880568+0000","last_fullsized":"2024-09-05T07:29:31.880568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:48:25.900221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.626031+0000","last_change":"2024-09-05T07:29:30.556889+0000","last_active":"2024-09-05T07:29:31.626031+0000","last_peered":"2024-09-05T07:29:31.626031+0000","last_clean":"2024-09-05T07:29:31.626031+0000","last_became_active":"2024-09-05T07:29:30.556627+0000","last_became_peered":"2024-09-05T07:29:30.556627+0000","last_unstale":"2024-09-05T07:29:31.626031+0000","last_undegraded":"2024-09-05T07:29:31.626031+0000","last_fullsized":"2024-09-05T07:29:31.626031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:20:01.152157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.669180+0000","last_change":"2024-09-05T07:29:29.526873+0000","last_active":"2024-09-05T07:29:31.669180+0000","last_peered":"2024-09-05T07:29:31.669180+0000","last_clean":"2024-09-05T07:29:31.669180+0000","last_became_active":"2024-09-05T07:29:29.526572+0000","last_became_peered":"2024-09-05T07:29:29.526572+0000","last_unstale":"2024-09-05T07:29:31.669180+0000","last_undegraded":"2024-09-05T07:29:31.669180+0000","last_fullsized":"2024-09-05T07:29:31.669180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:33:14.122911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.668972+0000","last_change":"2024-09-05T07:29:30.624592+0000","last_active":"2024-09-05T07:29:31.668972+0000","last_peered":"2024-09-05T07:29:31.668972+0000","last_clean":"2024-09-05T07:29:31.668972+0000","last_became_active":"2024-09-05T07:29:30.624109+0000","last_became_peered":"2024-09-05T07:29:30.624109+0000","last_unstale":"2024-09-05T07:29:31.668972+0000","last_undegraded":"2024-09-05T07:29:31.668972+0000","last_fullsized":"2024-09-05T07:29:31.668972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:22:35.613478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908688+0000","last_change":"2024-09-05T07:29:29.569816+0000","last_active":"2024-09-05T07:29:31.908688+0000","last_peered":"2024-09-05T07:29:31.908688+0000","last_clean":"2024-09-05T07:29:31.908688+0000","last_became_active":"2024-09-05T07:29:29.569536+0000","last_became_peered":"2024-09-05T07:29:29.569536+0000","last_unstale":"2024-09-05T07:29:31.908688+0000","last_undegraded":"2024-09-05T07:29:31.908688+0000","last_fullsized":"2024-09-05T07:29:31.908688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:59:18.418220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908389+0000","last_change":"2024-09-05T07:29:30.632805+0000","last_active":"2024-09-05T07:29:31.908389+0000","last_peered":"2024-09-05T07:29:31.908389+0000","last_clean":"2024-09-05T07:29:31.908389+0000","last_became_active":"2024-09-05T07:29:30.632502+0000","last_became_peered":"2024-09-05T07:29:30.632502+0000","last_unstale":"2024-09-05T07:29:31.908389+0000","last_undegraded":"2024-09-05T07:29:31.908389+0000","last_fullsized":"2024-09-05T07:29:31.908389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:59.653492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.417932+0000","last_change":"2024-09-05T07:29:29.563821+0000","last_active":"2024-09-05T07:29:36.417932+0000","last_peered":"2024-09-05T07:29:36.417932+0000","last_clean":"2024-09-05T07:29:36.417932+0000","last_became_active":"2024-09-05T07:29:29.563316+0000","last_became_peered":"2024-09-05T07:29:29.563316+0000","last_unstale":"2024-09-05T07:29:36.417932+0000","last_undegraded":"2024-09-05T07:29:36.417932+0000","last_fullsized":"2024-09-05T07:29:36.417932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:38.961328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.626045+0000","last_change":"2024-09-05T07:29:30.563106+0000","last_active":"2024-09-05T07:29:31.626045+0000","last_peered":"2024-09-05T07:29:31.626045+0000","last_clean":"2024-09-05T07:29:31.626045+0000","last_became_active":"2024-09-05T07:29:30.562776+0000","last_became_peered":"2024-09-05T07:29:30.562776+0000","last_unstale":"2024-09-05T07:29:31.626045+0000","last_undegraded":"2024-09-05T07:29:31.626045+0000","last_fullsized":"2024-09-05T07:29:31.626045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:37:16.174244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.625848+0000","last_change":"2024-09-05T07:29:30.558029+0000","last_active":"2024-09-05T07:29:31.625848+0000","last_peered":"2024-09-05T07:29:31.625848+0000","last_clean":"2024-09-05T07:29:31.625848+0000","last_became_active":"2024-09-05T07:29:30.557747+0000","last_became_peered":"2024-09-05T07:29:30.557747+0000","last_unstale":"2024-09-05T07:29:31.625848+0000","last_undegraded":"2024-09-05T07:29:31.625848+0000","last_fullsized":"2024-09-05T07:29:31.625848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:55:28.983976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.975672+0000","last_change":"2024-09-05T07:29:29.561333+0000","last_active":"2024-09-05T07:29:31.975672+0000","last_peered":"2024-09-05T07:29:31.975672+0000","last_clean":"2024-09-05T07:29:31.975672+0000","last_became_active":"2024-09-05T07:29:29.561065+0000","last_became_peered":"2024-09-05T07:29:29.561065+0000","last_unstale":"2024-09-05T07:29:31.975672+0000","last_undegraded":"2024-09-05T07:29:31.975672+0000","last_fullsized":"2024-09-05T07:29:31.975672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:38.961328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.907784+0000","last_change":"2024-09-05T07:29:30.566028+0000","last_active":"2024-09-05T07:29:31.907784+0000","last_peered":"2024-09-05T07:29:31.907784+0000","last_clean":"2024-09-05T07:29:31.907784+0000","last_became_active":"2024-09-05T07:29:30.565787+0000","last_became_peered":"2024-09-05T07:29:30.565787+0000","last_unstale":"2024-09-05T07:29:31.907784+0000","last_undegraded":"2024-09-05T07:29:31.907784+0000","last_fullsized":"2024-09-05T07:29:31.907784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:59.653492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.975500+0000","last_change":"2024-09-05T07:29:29.559969+0000","last_active":"2024-09-05T07:29:31.975500+0000","last_peered":"2024-09-05T07:29:31.975500+0000","last_clean":"2024-09-05T07:29:31.975500+0000","last_became_active":"2024-09-05T07:29:29.559675+0000","last_became_peered":"2024-09-05T07:29:29.559675+0000","last_unstale":"2024-09-05T07:29:31.975500+0000","last_undegraded":"2024-09-05T07:29:31.975500+0000","last_fullsized":"2024-09-05T07:29:31.975500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:53:39.010323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.631741+0000","last_change":"2024-09-05T07:29:30.657369+0000","last_active":"2024-09-05T07:29:31.631741+0000","last_peered":"2024-09-05T07:29:31.631741+0000","last_clean":"2024-09-05T07:29:31.631741+0000","last_became_active":"2024-09-05T07:29:30.656876+0000","last_became_peered":"2024-09-05T07:29:30.656876+0000","last_unstale":"2024-09-05T07:29:31.631741+0000","last_undegraded":"2024-09-05T07:29:31.631741+0000","last_fullsized":"2024-09-05T07:29:31.631741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:09:22.026287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:32.040857+0000","last_change":"2024-09-05T07:29:29.567440+0000","last_active":"2024-09-05T07:29:32.040857+0000","last_peered":"2024-09-05T07:29:32.040857+0000","last_clean":"2024-09-05T07:29:32.040857+0000","last_became_active":"2024-09-05T07:29:29.567129+0000","last_became_peered":"2024-09-05T07:29:29.567129+0000","last_unstale":"2024-09-05T07:29:32.040857+0000","last_undegraded":"2024-09-05T07:29:32.040857+0000","last_fullsized":"2024-09-05T07:29:32.040857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:54:00.339029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.632072+0000","last_change":"2024-09-05T07:29:30.657929+0000","last_active":"2024-09-05T07:29:31.632072+0000","last_peered":"2024-09-05T07:29:31.632072+0000","last_clean":"2024-09-05T07:29:31.632072+0000","last_became_active":"2024-09-05T07:29:30.657625+0000","last_became_peered":"2024-09-05T07:29:30.657625+0000","last_unstale":"2024-09-05T07:29:31.632072+0000","last_undegraded":"2024-09-05T07:29:31.632072+0000","last_fullsized":"2024-09-05T07:29:31.632072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:37:46.507371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:32.037358+0000","last_change":"2024-09-05T07:29:29.526099+0000","last_active":"2024-09-05T07:29:32.037358+0000","last_peered":"2024-09-05T07:29:32.037358+0000","last_clean":"2024-09-05T07:29:32.037358+0000","last_became_active":"2024-09-05T07:29:29.525832+0000","last_became_peered":"2024-09-05T07:29:29.525832+0000","last_unstale":"2024-09-05T07:29:32.037358+0000","last_undegraded":"2024-09-05T07:29:32.037358+0000","last_fullsized":"2024-09-05T07:29:32.037358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:44:32.741898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3726,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":6226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476746,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36156,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335684,"statfs":{"total":96636764160,"available":96599740416,"internally_reserved":0,"allocated":831488,"data_stored":667834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35576,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336264,"statfs":{"total":96636764160,"available":96600334336,"internally_reserved":0,"allocated":229376,"data_stored":76876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":225280,"data_stored":77334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":233472,"data_stored":78364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":819200,"data_stored":667190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":229376,"data_stored":76808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35572,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336268,"statfs":{"total":96636764160,"available":96600338432,"internally_reserved":0,"allocated":221184,"data_stored":76752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35592,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336248,"statfs":{"total":96636764160,"available":96600317952,"internally_reserved":0,"allocated":241664,"data_stored":79036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T07:29:40.247 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T07:29:40.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.381+0000 7fd784a74640 1 Processor -- start 2024-09-05T07:29:40.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.381+0000 7fd784a74640 1 -- start start 2024-09-05T07:29:40.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.382+0000 7fd784a74640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd780154b30 0x7fd78006c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:40.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.382+0000 7fd784a74640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd78015b250 0x7fd7800d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:40.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.382+0000 7fd784a74640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd78015b740 con 0x7fd7800cafc0 2024-09-05T07:29:40.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.382+0000 7fd784a74640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fd78015ea70 con 0x7fd78015b250 2024-09-05T07:29:40.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.382+0000 7fd784a74640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fd780154f10 con 0x7fd780154b30 2024-09-05T07:29:40.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.382+0000 7fd77e59c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd780154b30 0x7fd78006c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:40.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.382+0000 7fd77dd9b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd78015b250 0x7fd7800d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:40.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.383+0000 7fd77e59c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd780154b30 0x7fd78006c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:35992/0 (socket says 172.21.15.17:35992) 2024-09-05T07:29:40.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.383+0000 7fd77e59c640 1 -- 172.21.15.17:0/524848672 learned_addr learned my addr 172.21.15.17:0/524848672 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:40.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.385+0000 7fd77e59c640 1 -- 172.21.15.17:0/524848672 >> v2:172.21.15.17:3300/0 conn(0x7fd78015b250 msgr2=0x7fd7800d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:40.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.385+0000 7fd77e59c640 1 --2- 172.21.15.17:0/524848672 >> v2:172.21.15.17:3300/0 conn(0x7fd78015b250 0x7fd7800d05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:40.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.385+0000 7fd77e59c640 1 -- 172.21.15.17:0/524848672 >> v1:172.21.15.17:6789/0 conn(0x7fd7800cafc0 legacy=0x7fd7800c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:40.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.385+0000 7fd77e59c640 1 -- 172.21.15.17:0/524848672 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd78015de60 con 0x7fd780154b30 2024-09-05T07:29:40.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.387+0000 7fd77e59c640 1 --2- 172.21.15.17:0/524848672 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd780154b30 0x7fd78006c900 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd780068570 tx=0x7fd77002a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af0af5dd34fd666 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:40.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.391+0000 7fd77d59a640 1 -- 172.21.15.17:0/524848672 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd770037070 con 0x7fd780154b30 2024-09-05T07:29:40.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.391+0000 7fd77d59a640 1 -- 172.21.15.17:0/524848672 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd770032440 con 0x7fd780154b30 2024-09-05T07:29:40.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.391+0000 7fd77d59a640 1 -- 172.21.15.17:0/524848672 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd770032810 con 0x7fd780154b30 2024-09-05T07:29:40.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.391+0000 7fd784a74640 1 -- 172.21.15.17:0/524848672 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd780154b30 msgr2=0x7fd78006c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:40.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.391+0000 7fd784a74640 1 --2- 172.21.15.17:0/524848672 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd780154b30 0x7fd78006c900 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd780068570 tx=0x7fd77002a1e0 comp rx=0 tx=0).stop 2024-09-05T07:29:40.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.391+0000 7fd784a74640 1 -- 172.21.15.17:0/524848672 shutdown_connections 2024-09-05T07:29:40.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.391+0000 7fd784a74640 1 --2- 172.21.15.17:0/524848672 >> v2:172.21.15.17:3300/0 conn(0x7fd78015b250 0x7fd7800d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:40.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.391+0000 7fd784a74640 1 --2- 172.21.15.17:0/524848672 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd780154b30 0x7fd78006c900 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:40.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.391+0000 7fd784a74640 1 -- 172.21.15.17:0/524848672 >> 172.21.15.17:0/524848672 conn(0x7fd780073750 msgr2=0x7fd780073b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:40.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.391+0000 7fd784a74640 1 -- 172.21.15.17:0/524848672 shutdown_connections 2024-09-05T07:29:40.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.392+0000 7fd784a74640 1 -- 172.21.15.17:0/524848672 wait complete. 2024-09-05T07:29:40.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.393+0000 7fd784a74640 1 Processor -- start 2024-09-05T07:29:40.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.393+0000 7fd784a74640 1 -- start start 2024-09-05T07:29:40.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.393+0000 7fd784a74640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7800cafc0 0x7fd7801f06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:40.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.394+0000 7fd784a74640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd780154b30 0x7fd7800c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:40.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.394+0000 7fd784a74640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd78015b250 0x7fd7800c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:40.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.394+0000 7fd784a74640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd78015e700 con 0x7fd78015b250 2024-09-05T07:29:40.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.394+0000 7fd784a74640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd78015e420 con 0x7fd7800cafc0 2024-09-05T07:29:40.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.394+0000 7fd784a74640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fd7800c59b0 con 0x7fd780154b30 2024-09-05T07:29:40.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.394+0000 7fd77e59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7800cafc0 0x7fd7801f06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:40.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.394+0000 7fd77ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd78015b250 0x7fd7800c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:40.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.394+0000 7fd77dd9b640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd780154b30 0x7fd7800c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:40.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.394+0000 7fd77e59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7800cafc0 0x7fd7801f06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:36002/0 (socket says 172.21.15.17:36002) 2024-09-05T07:29:40.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.394+0000 7fd77e59c640 1 -- 172.21.15.17:0/331979482 learned_addr learned my addr 172.21.15.17:0/331979482 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:40.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.398+0000 7fd77dd9b640 1 -- 172.21.15.17:0/331979482 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7800cafc0 msgr2=0x7fd7801f06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:40.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.398+0000 7fd77dd9b640 1 --2- 172.21.15.17:0/331979482 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7800cafc0 0x7fd7801f06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:40.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.398+0000 7fd77dd9b640 1 -- 172.21.15.17:0/331979482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd78015b250 msgr2=0x7fd7800c9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:40.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.398+0000 7fd77dd9b640 1 --2- 172.21.15.17:0/331979482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd78015b250 0x7fd7800c9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:40.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.398+0000 7fd77dd9b640 1 -- 172.21.15.17:0/331979482 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd780151ed0 con 0x7fd780154b30 2024-09-05T07:29:40.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.400+0000 7fd77dd9b640 1 --2- 172.21.15.17:0/331979482 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd780154b30 0x7fd7800c7e80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd77400e870 tx=0x7fd77400ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:40.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.404+0000 7fd76effd640 1 -- 172.21.15.17:0/331979482 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd774017070 con 0x7fd780154b30 2024-09-05T07:29:40.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.404+0000 7fd76effd640 1 -- 172.21.15.17:0/331979482 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd77400ee60 con 0x7fd780154b30 2024-09-05T07:29:40.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.404+0000 7fd76effd640 1 -- 172.21.15.17:0/331979482 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77400cb80 con 0x7fd780154b30 2024-09-05T07:29:40.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.404+0000 7fd784a74640 1 -- 172.21.15.17:0/331979482 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd78015bac0 con 0x7fd780154b30 2024-09-05T07:29:40.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.404+0000 7fd784a74640 1 -- 172.21.15.17:0/331979482 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7800c7680 con 0x7fd780154b30 2024-09-05T07:29:40.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.405+0000 7fd784a74640 1 -- 172.21.15.17:0/331979482 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd78006c900 con 0x7fd780154b30 2024-09-05T07:29:40.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.424+0000 7fd76effd640 1 -- 172.21.15.17:0/331979482 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd77401a070 con 0x7fd780154b30 2024-09-05T07:29:40.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.424+0000 7fd76effd640 1 --2- 172.21.15.17:0/331979482 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd76006be80 0x7fd76006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:40.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.424+0000 7fd77e59c640 1 --2- 172.21.15.17:0/331979482 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd76006be80 0x7fd76006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:40.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.425+0000 7fd77e59c640 1 --2- 172.21.15.17:0/331979482 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd76006be80 0x7fd76006e340 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd770035040 tx=0x7fd77002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:40.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.684+0000 7fd76effd640 1 -- 172.21.15.17:0/331979482 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd774057760 con 0x7fd780154b30 2024-09-05T07:29:40.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.697+0000 7fd76effd640 1 -- 172.21.15.17:0/331979482 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd7740596c0 con 0x7fd780154b30 2024-09-05T07:29:40.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.878+0000 7fd784a74640 1 -- 172.21.15.17:0/331979482 --> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd780073e50 con 0x7fd76006be80 2024-09-05T07:29:40.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.886+0000 7fd76effd640 1 -- 172.21.15.17:0/331979482 <== mgr.4099 v2:172.21.15.26:6800/2736912541 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251887 (secure 0 0 0) 0x7fd780073e50 con 0x7fd76006be80 2024-09-05T07:29:40.889 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:29:40.890 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-05T07:29:40.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.889+0000 7fd784a74640 1 -- 172.21.15.17:0/331979482 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd76006be80 msgr2=0x7fd76006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:40.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.889+0000 7fd784a74640 1 --2- 172.21.15.17:0/331979482 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd76006be80 0x7fd76006e340 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd770035040 tx=0x7fd77002e000 comp rx=0 tx=0).stop 2024-09-05T07:29:40.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.889+0000 7fd784a74640 1 -- 172.21.15.17:0/331979482 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd780154b30 msgr2=0x7fd7800c7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:40.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.889+0000 7fd784a74640 1 --2- 172.21.15.17:0/331979482 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd780154b30 0x7fd7800c7e80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd77400e870 tx=0x7fd77400ed30 comp rx=0 tx=0).stop 2024-09-05T07:29:40.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.889+0000 7fd784a74640 1 -- 172.21.15.17:0/331979482 shutdown_connections 2024-09-05T07:29:40.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.889+0000 7fd784a74640 1 --2- 172.21.15.17:0/331979482 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd76006be80 0x7fd76006e340 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:40.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.889+0000 7fd784a74640 1 --2- 172.21.15.17:0/331979482 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd780154b30 0x7fd7800c7e80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:40.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.889+0000 7fd784a74640 1 --2- 172.21.15.17:0/331979482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd78015b250 0x7fd7800c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:40.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.889+0000 7fd784a74640 1 --2- 172.21.15.17:0/331979482 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7800cafc0 0x7fd7801f06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:40.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.889+0000 7fd784a74640 1 -- 172.21.15.17:0/331979482 >> 172.21.15.17:0/331979482 conn(0x7fd780073750 msgr2=0x7fd7800d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:40.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.889+0000 7fd784a74640 1 -- 172.21.15.17:0/331979482 shutdown_connections 2024-09-05T07:29:40.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:40.889+0000 7fd784a74640 1 -- 172.21.15.17:0/331979482 wait complete. 2024-09-05T07:29:40.900 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-09-05T07:29:39.874390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594094,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":230,"num_write_kb":2441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":181,"ondisk_log_size":181,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":269140,"kb_used_data":2960,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754705580,"statfs":{"total":773094113280,"available":772818513920,"internally_reserved":0,"allocated":3031040,"data_stored":1800194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":272354865},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3726,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.339489"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.880921+0000","last_change":"2024-09-05T07:29:30.556803+0000","last_active":"2024-09-05T07:29:31.880921+0000","last_peered":"2024-09-05T07:29:31.880921+0000","last_clean":"2024-09-05T07:29:31.880921+0000","last_became_active":"2024-09-05T07:29:30.556513+0000","last_became_peered":"2024-09-05T07:29:30.556513+0000","last_unstale":"2024-09-05T07:29:31.880921+0000","last_undegraded":"2024-09-05T07:29:31.880921+0000","last_fullsized":"2024-09-05T07:29:31.880921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:38:11.961137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.631582+0000","last_change":"2024-09-05T07:29:30.658489+0000","last_active":"2024-09-05T07:29:31.631582+0000","last_peered":"2024-09-05T07:29:31.631582+0000","last_clean":"2024-09-05T07:29:31.631582+0000","last_became_active":"2024-09-05T07:29:30.658225+0000","last_became_peered":"2024-09-05T07:29:30.658225+0000","last_unstale":"2024-09-05T07:29:31.631582+0000","last_undegraded":"2024-09-05T07:29:31.631582+0000","last_fullsized":"2024-09-05T07:29:31.631582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:03:07.788844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.631512+0000","last_change":"2024-09-05T07:29:30.659535+0000","last_active":"2024-09-05T07:29:31.631512+0000","last_peered":"2024-09-05T07:29:31.631512+0000","last_clean":"2024-09-05T07:29:31.631512+0000","last_became_active":"2024-09-05T07:29:30.659042+0000","last_became_peered":"2024-09-05T07:29:30.659042+0000","last_unstale":"2024-09-05T07:29:31.631512+0000","last_undegraded":"2024-09-05T07:29:31.631512+0000","last_fullsized":"2024-09-05T07:29:31.631512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:08:39.718764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.882099+0000","last_change":"2024-09-05T07:29:30.640489+0000","last_active":"2024-09-05T07:29:31.882099+0000","last_peered":"2024-09-05T07:29:31.882099+0000","last_clean":"2024-09-05T07:29:31.882099+0000","last_became_active":"2024-09-05T07:29:30.640141+0000","last_became_peered":"2024-09-05T07:29:30.640141+0000","last_unstale":"2024-09-05T07:29:31.882099+0000","last_undegraded":"2024-09-05T07:29:31.882099+0000","last_fullsized":"2024-09-05T07:29:31.882099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:53:14.516901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881415+0000","last_change":"2024-09-05T07:29:30.659266+0000","last_active":"2024-09-05T07:29:31.881415+0000","last_peered":"2024-09-05T07:29:31.881415+0000","last_clean":"2024-09-05T07:29:31.881415+0000","last_became_active":"2024-09-05T07:29:30.658981+0000","last_became_peered":"2024-09-05T07:29:30.658981+0000","last_unstale":"2024-09-05T07:29:31.881415+0000","last_undegraded":"2024-09-05T07:29:31.881415+0000","last_fullsized":"2024-09-05T07:29:31.881415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:34:49.879681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881926+0000","last_change":"2024-09-05T07:29:30.641512+0000","last_active":"2024-09-05T07:29:31.881926+0000","last_peered":"2024-09-05T07:29:31.881926+0000","last_clean":"2024-09-05T07:29:31.881926+0000","last_became_active":"2024-09-05T07:29:30.641255+0000","last_became_peered":"2024-09-05T07:29:30.641255+0000","last_unstale":"2024-09-05T07:29:31.881926+0000","last_undegraded":"2024-09-05T07:29:31.881926+0000","last_fullsized":"2024-09-05T07:29:31.881926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:42.938157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881721+0000","last_change":"2024-09-05T07:29:30.556064+0000","last_active":"2024-09-05T07:29:31.881721+0000","last_peered":"2024-09-05T07:29:31.881721+0000","last_clean":"2024-09-05T07:29:31.881721+0000","last_became_active":"2024-09-05T07:29:30.555796+0000","last_became_peered":"2024-09-05T07:29:30.555796+0000","last_unstale":"2024-09-05T07:29:31.881721+0000","last_undegraded":"2024-09-05T07:29:31.881721+0000","last_fullsized":"2024-09-05T07:29:31.881721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:37:28.088603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.631334+0000","last_change":"2024-09-05T07:29:30.659561+0000","last_active":"2024-09-05T07:29:31.631334+0000","last_peered":"2024-09-05T07:29:31.631334+0000","last_clean":"2024-09-05T07:29:31.631334+0000","last_became_active":"2024-09-05T07:29:30.659070+0000","last_became_peered":"2024-09-05T07:29:30.659070+0000","last_unstale":"2024-09-05T07:29:31.631334+0000","last_undegraded":"2024-09-05T07:29:31.631334+0000","last_fullsized":"2024-09-05T07:29:31.631334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:13:33.902479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.907890+0000","last_change":"2024-09-05T07:29:30.565653+0000","last_active":"2024-09-05T07:29:31.907890+0000","last_peered":"2024-09-05T07:29:31.907890+0000","last_clean":"2024-09-05T07:29:31.907890+0000","last_became_active":"2024-09-05T07:29:30.565408+0000","last_became_peered":"2024-09-05T07:29:30.565408+0000","last_unstale":"2024-09-05T07:29:31.907890+0000","last_undegraded":"2024-09-05T07:29:31.907890+0000","last_fullsized":"2024-09-05T07:29:31.907890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:42.938157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881571+0000","last_change":"2024-09-05T07:29:30.643865+0000","last_active":"2024-09-05T07:29:31.881571+0000","last_peered":"2024-09-05T07:29:31.881571+0000","last_clean":"2024-09-05T07:29:31.881571+0000","last_became_active":"2024-09-05T07:29:30.643587+0000","last_became_peered":"2024-09-05T07:29:30.643587+0000","last_unstale":"2024-09-05T07:29:31.881571+0000","last_undegraded":"2024-09-05T07:29:31.881571+0000","last_fullsized":"2024-09-05T07:29:31.881571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:37:46.507371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.880939+0000","last_change":"2024-09-05T07:29:30.557314+0000","last_active":"2024-09-05T07:29:31.880939+0000","last_peered":"2024-09-05T07:29:31.880939+0000","last_clean":"2024-09-05T07:29:31.880939+0000","last_became_active":"2024-09-05T07:29:30.557039+0000","last_became_peered":"2024-09-05T07:29:30.557039+0000","last_unstale":"2024-09-05T07:29:31.880939+0000","last_undegraded":"2024-09-05T07:29:31.880939+0000","last_fullsized":"2024-09-05T07:29:31.880939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:08:39.718764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881426+0000","last_change":"2024-09-05T07:29:30.564518+0000","last_active":"2024-09-05T07:29:31.881426+0000","last_peered":"2024-09-05T07:29:31.881426+0000","last_clean":"2024-09-05T07:29:31.881426+0000","last_became_active":"2024-09-05T07:29:30.564271+0000","last_became_peered":"2024-09-05T07:29:30.564271+0000","last_unstale":"2024-09-05T07:29:31.881426+0000","last_undegraded":"2024-09-05T07:29:31.881426+0000","last_fullsized":"2024-09-05T07:29:31.881426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:09:22.026287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908103+0000","last_change":"2024-09-05T07:29:30.631857+0000","last_active":"2024-09-05T07:29:31.908103+0000","last_peered":"2024-09-05T07:29:31.908103+0000","last_clean":"2024-09-05T07:29:31.908103+0000","last_became_active":"2024-09-05T07:29:30.631588+0000","last_became_peered":"2024-09-05T07:29:30.631588+0000","last_unstale":"2024-09-05T07:29:31.908103+0000","last_undegraded":"2024-09-05T07:29:31.908103+0000","last_fullsized":"2024-09-05T07:29:31.908103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:41:25.696697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908490+0000","last_change":"2024-09-05T07:29:30.632829+0000","last_active":"2024-09-05T07:29:31.908490+0000","last_peered":"2024-09-05T07:29:31.908490+0000","last_clean":"2024-09-05T07:29:31.908490+0000","last_became_active":"2024-09-05T07:29:30.632528+0000","last_became_peered":"2024-09-05T07:29:30.632528+0000","last_unstale":"2024-09-05T07:29:31.908490+0000","last_undegraded":"2024-09-05T07:29:31.908490+0000","last_fullsized":"2024-09-05T07:29:31.908490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:22:35.613478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.631381+0000","last_change":"2024-09-05T07:29:30.657306+0000","last_active":"2024-09-05T07:29:31.631381+0000","last_peered":"2024-09-05T07:29:31.631381+0000","last_clean":"2024-09-05T07:29:31.631381+0000","last_became_active":"2024-09-05T07:29:30.656997+0000","last_became_peered":"2024-09-05T07:29:30.656997+0000","last_unstale":"2024-09-05T07:29:31.631381+0000","last_undegraded":"2024-09-05T07:29:31.631381+0000","last_fullsized":"2024-09-05T07:29:31.631381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:15:28.381136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.625605+0000","last_change":"2024-09-05T07:29:30.641543+0000","last_active":"2024-09-05T07:29:31.625605+0000","last_peered":"2024-09-05T07:29:31.625605+0000","last_clean":"2024-09-05T07:29:31.625605+0000","last_became_active":"2024-09-05T07:29:30.641283+0000","last_became_peered":"2024-09-05T07:29:30.641283+0000","last_unstale":"2024-09-05T07:29:31.625605+0000","last_undegraded":"2024-09-05T07:29:31.625605+0000","last_fullsized":"2024-09-05T07:29:31.625605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:36:59.967135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.626113+0000","last_change":"2024-09-05T07:29:30.558414+0000","last_active":"2024-09-05T07:29:31.626113+0000","last_peered":"2024-09-05T07:29:31.626113+0000","last_clean":"2024-09-05T07:29:31.626113+0000","last_became_active":"2024-09-05T07:29:30.558105+0000","last_became_peered":"2024-09-05T07:29:30.558105+0000","last_unstale":"2024-09-05T07:29:31.626113+0000","last_undegraded":"2024-09-05T07:29:31.626113+0000","last_fullsized":"2024-09-05T07:29:31.626113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:55:31.494616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908249+0000","last_change":"2024-09-05T07:29:30.643169+0000","last_active":"2024-09-05T07:29:31.908249+0000","last_peered":"2024-09-05T07:29:31.908249+0000","last_clean":"2024-09-05T07:29:31.908249+0000","last_became_active":"2024-09-05T07:29:30.642876+0000","last_became_peered":"2024-09-05T07:29:30.642876+0000","last_unstale":"2024-09-05T07:29:31.908249+0000","last_undegraded":"2024-09-05T07:29:31.908249+0000","last_fullsized":"2024-09-05T07:29:31.908249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:40.101513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.626245+0000","last_change":"2024-09-05T07:29:30.557239+0000","last_active":"2024-09-05T07:29:31.626245+0000","last_peered":"2024-09-05T07:29:31.626245+0000","last_clean":"2024-09-05T07:29:31.626245+0000","last_became_active":"2024-09-05T07:29:30.556969+0000","last_became_peered":"2024-09-05T07:29:30.556969+0000","last_unstale":"2024-09-05T07:29:31.626245+0000","last_undegraded":"2024-09-05T07:29:31.626245+0000","last_fullsized":"2024-09-05T07:29:31.626245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:47:29.801348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881573+0000","last_change":"2024-09-05T07:29:30.564077+0000","last_active":"2024-09-05T07:29:31.881573+0000","last_peered":"2024-09-05T07:29:31.881573+0000","last_clean":"2024-09-05T07:29:31.881573+0000","last_became_active":"2024-09-05T07:29:30.563808+0000","last_became_peered":"2024-09-05T07:29:30.563808+0000","last_unstale":"2024-09-05T07:29:31.881573+0000","last_undegraded":"2024-09-05T07:29:31.881573+0000","last_fullsized":"2024-09-05T07:29:31.881573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:00:35.625571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.668993+0000","last_change":"2024-09-05T07:29:30.643879+0000","last_active":"2024-09-05T07:29:31.668993+0000","last_peered":"2024-09-05T07:29:31.668993+0000","last_clean":"2024-09-05T07:29:31.668993+0000","last_became_active":"2024-09-05T07:29:30.643559+0000","last_became_peered":"2024-09-05T07:29:30.643559+0000","last_unstale":"2024-09-05T07:29:31.668993+0000","last_undegraded":"2024-09-05T07:29:31.668993+0000","last_fullsized":"2024-09-05T07:29:31.668993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:52:56.756904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.907631+0000","last_change":"2024-09-05T07:29:30.564954+0000","last_active":"2024-09-05T07:29:31.907631+0000","last_peered":"2024-09-05T07:29:31.907631+0000","last_clean":"2024-09-05T07:29:31.907631+0000","last_became_active":"2024-09-05T07:29:30.564669+0000","last_became_peered":"2024-09-05T07:29:30.564669+0000","last_unstale":"2024-09-05T07:29:31.907631+0000","last_undegraded":"2024-09-05T07:29:31.907631+0000","last_fullsized":"2024-09-05T07:29:31.907631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:53:40.150507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.631446+0000","last_change":"2024-09-05T07:29:30.656718+0000","last_active":"2024-09-05T07:29:31.631446+0000","last_peered":"2024-09-05T07:29:31.631446+0000","last_clean":"2024-09-05T07:29:31.631446+0000","last_became_active":"2024-09-05T07:29:30.656451+0000","last_became_peered":"2024-09-05T07:29:30.656451+0000","last_unstale":"2024-09-05T07:29:31.631446+0000","last_undegraded":"2024-09-05T07:29:31.631446+0000","last_fullsized":"2024-09-05T07:29:31.631446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:38:11.961137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.625602+0000","last_change":"2024-09-05T07:29:30.658481+0000","last_active":"2024-09-05T07:29:31.625602+0000","last_peered":"2024-09-05T07:29:31.625602+0000","last_clean":"2024-09-05T07:29:31.625602+0000","last_became_active":"2024-09-05T07:29:30.658207+0000","last_became_peered":"2024-09-05T07:29:30.658207+0000","last_unstale":"2024-09-05T07:29:31.625602+0000","last_undegraded":"2024-09-05T07:29:31.625602+0000","last_fullsized":"2024-09-05T07:29:31.625602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:23:04.483495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.631597+0000","last_change":"2024-09-05T07:29:30.657936+0000","last_active":"2024-09-05T07:29:31.631597+0000","last_peered":"2024-09-05T07:29:31.631597+0000","last_clean":"2024-09-05T07:29:31.631597+0000","last_became_active":"2024-09-05T07:29:30.657177+0000","last_became_peered":"2024-09-05T07:29:30.657177+0000","last_unstale":"2024-09-05T07:29:31.631597+0000","last_undegraded":"2024-09-05T07:29:31.631597+0000","last_fullsized":"2024-09-05T07:29:31.631597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:01:34.217228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.882231+0000","last_change":"2024-09-05T07:29:30.642790+0000","last_active":"2024-09-05T07:29:31.882231+0000","last_peered":"2024-09-05T07:29:31.882231+0000","last_clean":"2024-09-05T07:29:31.882231+0000","last_became_active":"2024-09-05T07:29:30.641834+0000","last_became_peered":"2024-09-05T07:29:30.641834+0000","last_unstale":"2024-09-05T07:29:31.882231+0000","last_undegraded":"2024-09-05T07:29:31.882231+0000","last_fullsized":"2024-09-05T07:29:31.882231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:34:17.448981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908717+0000","last_change":"2024-09-05T07:29:30.633776+0000","last_active":"2024-09-05T07:29:31.908717+0000","last_peered":"2024-09-05T07:29:31.908717+0000","last_clean":"2024-09-05T07:29:31.908717+0000","last_became_active":"2024-09-05T07:29:30.633507+0000","last_became_peered":"2024-09-05T07:29:30.633507+0000","last_unstale":"2024-09-05T07:29:31.908717+0000","last_undegraded":"2024-09-05T07:29:31.908717+0000","last_fullsized":"2024-09-05T07:29:31.908717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:34:54.335152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908515+0000","last_change":"2024-09-05T07:29:30.632558+0000","last_active":"2024-09-05T07:29:31.908515+0000","last_peered":"2024-09-05T07:29:31.908515+0000","last_clean":"2024-09-05T07:29:31.908515+0000","last_became_active":"2024-09-05T07:29:30.632269+0000","last_became_peered":"2024-09-05T07:29:30.632269+0000","last_unstale":"2024-09-05T07:29:31.908515+0000","last_undegraded":"2024-09-05T07:29:31.908515+0000","last_fullsized":"2024-09-05T07:29:31.908515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:35:18.927192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.631730+0000","last_change":"2024-09-05T07:29:30.656638+0000","last_active":"2024-09-05T07:29:31.631730+0000","last_peered":"2024-09-05T07:29:31.631730+0000","last_clean":"2024-09-05T07:29:31.631730+0000","last_became_active":"2024-09-05T07:29:30.656382+0000","last_became_peered":"2024-09-05T07:29:30.656382+0000","last_unstale":"2024-09-05T07:29:31.631730+0000","last_undegraded":"2024-09-05T07:29:31.631730+0000","last_fullsized":"2024-09-05T07:29:31.631730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:34:49.879681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.625711+0000","last_change":"2024-09-05T07:29:30.657421+0000","last_active":"2024-09-05T07:29:31.625711+0000","last_peered":"2024-09-05T07:29:31.625711+0000","last_clean":"2024-09-05T07:29:31.625711+0000","last_became_active":"2024-09-05T07:29:30.657159+0000","last_became_peered":"2024-09-05T07:29:30.657159+0000","last_unstale":"2024-09-05T07:29:31.625711+0000","last_undegraded":"2024-09-05T07:29:31.625711+0000","last_fullsized":"2024-09-05T07:29:31.625711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:13:05.334750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908422+0000","last_change":"2024-09-05T07:29:30.624866+0000","last_active":"2024-09-05T07:29:31.908422+0000","last_peered":"2024-09-05T07:29:31.908422+0000","last_clean":"2024-09-05T07:29:31.908422+0000","last_became_active":"2024-09-05T07:29:30.624605+0000","last_became_peered":"2024-09-05T07:29:30.624605+0000","last_unstale":"2024-09-05T07:29:31.908422+0000","last_undegraded":"2024-09-05T07:29:31.908422+0000","last_fullsized":"2024-09-05T07:29:31.908422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:42.938157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881624+0000","last_change":"2024-09-05T07:29:30.642514+0000","last_active":"2024-09-05T07:29:31.881624+0000","last_peered":"2024-09-05T07:29:31.881624+0000","last_clean":"2024-09-05T07:29:31.881624+0000","last_became_active":"2024-09-05T07:29:30.642084+0000","last_became_peered":"2024-09-05T07:29:30.642084+0000","last_unstale":"2024-09-05T07:29:31.881624+0000","last_undegraded":"2024-09-05T07:29:31.881624+0000","last_fullsized":"2024-09-05T07:29:31.881624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:40.101513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.907656+0000","last_change":"2024-09-05T07:29:30.657456+0000","last_active":"2024-09-05T07:29:31.907656+0000","last_peered":"2024-09-05T07:29:31.907656+0000","last_clean":"2024-09-05T07:29:31.907656+0000","last_became_active":"2024-09-05T07:29:30.657117+0000","last_became_peered":"2024-09-05T07:29:30.657117+0000","last_unstale":"2024-09-05T07:29:31.907656+0000","last_undegraded":"2024-09-05T07:29:31.907656+0000","last_fullsized":"2024-09-05T07:29:31.907656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:40.101513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'5","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.497941+0000","last_change":"2024-09-05T07:29:29.568126+0000","last_active":"2024-09-05T07:29:36.497941+0000","last_peered":"2024-09-05T07:29:36.497941+0000","last_clean":"2024-09-05T07:29:36.497941+0000","last_became_active":"2024-09-05T07:29:29.567846+0000","last_became_peered":"2024-09-05T07:29:29.567846+0000","last_unstale":"2024-09-05T07:29:36.497941+0000","last_undegraded":"2024-09-05T07:29:36.497941+0000","last_fullsized":"2024-09-05T07:29:36.497941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:48:25.900221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.669165+0000","last_change":"2024-09-05T07:29:30.557504+0000","last_active":"2024-09-05T07:29:31.669165+0000","last_peered":"2024-09-05T07:29:31.669165+0000","last_clean":"2024-09-05T07:29:31.669165+0000","last_became_active":"2024-09-05T07:29:30.557203+0000","last_became_peered":"2024-09-05T07:29:30.557203+0000","last_unstale":"2024-09-05T07:29:31.669165+0000","last_undegraded":"2024-09-05T07:29:31.669165+0000","last_fullsized":"2024-09-05T07:29:31.669165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:55:13.742728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.626198+0000","last_change":"2024-09-05T07:29:29.524587+0000","last_active":"2024-09-05T07:29:31.626198+0000","last_peered":"2024-09-05T07:29:31.626198+0000","last_clean":"2024-09-05T07:29:31.626198+0000","last_became_active":"2024-09-05T07:29:29.524321+0000","last_became_peered":"2024-09-05T07:29:29.524321+0000","last_unstale":"2024-09-05T07:29:31.626198+0000","last_undegraded":"2024-09-05T07:29:31.626198+0000","last_fullsized":"2024-09-05T07:29:31.626198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:53:13.376716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908122+0000","last_change":"2024-09-05T07:29:29.570879+0000","last_active":"2024-09-05T07:29:31.908122+0000","last_peered":"2024-09-05T07:29:31.908122+0000","last_clean":"2024-09-05T07:29:31.908122+0000","last_became_active":"2024-09-05T07:29:29.570456+0000","last_became_peered":"2024-09-05T07:29:29.570456+0000","last_unstale":"2024-09-05T07:29:31.908122+0000","last_undegraded":"2024-09-05T07:29:31.908122+0000","last_fullsized":"2024-09-05T07:29:31.908122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:52:54.638586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.632417+0000","last_change":"2024-09-05T07:29:30.657364+0000","last_active":"2024-09-05T07:29:31.632417+0000","last_peered":"2024-09-05T07:29:31.632417+0000","last_clean":"2024-09-05T07:29:31.632417+0000","last_became_active":"2024-09-05T07:29:30.657008+0000","last_became_peered":"2024-09-05T07:29:30.657008+0000","last_unstale":"2024-09-05T07:29:31.632417+0000","last_undegraded":"2024-09-05T07:29:31.632417+0000","last_fullsized":"2024-09-05T07:29:31.632417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:36:59.967135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.626059+0000","last_change":"2024-09-05T07:29:29.562802+0000","last_active":"2024-09-05T07:29:31.626059+0000","last_peered":"2024-09-05T07:29:31.626059+0000","last_clean":"2024-09-05T07:29:31.626059+0000","last_became_active":"2024-09-05T07:29:29.562520+0000","last_became_peered":"2024-09-05T07:29:29.562520+0000","last_unstale":"2024-09-05T07:29:31.626059+0000","last_undegraded":"2024-09-05T07:29:31.626059+0000","last_fullsized":"2024-09-05T07:29:31.626059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:34:16.308797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.669116+0000","last_change":"2024-09-05T07:29:30.563197+0000","last_active":"2024-09-05T07:29:31.669116+0000","last_peered":"2024-09-05T07:29:31.669116+0000","last_clean":"2024-09-05T07:29:31.669116+0000","last_became_active":"2024-09-05T07:29:30.562945+0000","last_became_peered":"2024-09-05T07:29:30.562945+0000","last_unstale":"2024-09-05T07:29:31.669116+0000","last_undegraded":"2024-09-05T07:29:31.669116+0000","last_fullsized":"2024-09-05T07:29:31.669116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:31:37.754325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.489982+0000","last_change":"2024-09-05T07:29:29.559012+0000","last_active":"2024-09-05T07:29:36.489982+0000","last_peered":"2024-09-05T07:29:36.489982+0000","last_clean":"2024-09-05T07:29:36.489982+0000","last_became_active":"2024-09-05T07:29:29.558744+0000","last_became_peered":"2024-09-05T07:29:29.558744+0000","last_unstale":"2024-09-05T07:29:36.489982+0000","last_undegraded":"2024-09-05T07:29:36.489982+0000","last_fullsized":"2024-09-05T07:29:36.489982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:28:41.630593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.882278+0000","last_change":"2024-09-05T07:29:30.641594+0000","last_active":"2024-09-05T07:29:31.882278+0000","last_peered":"2024-09-05T07:29:31.882278+0000","last_clean":"2024-09-05T07:29:31.882278+0000","last_became_active":"2024-09-05T07:29:30.641360+0000","last_became_peered":"2024-09-05T07:29:30.641360+0000","last_unstale":"2024-09-05T07:29:31.882278+0000","last_undegraded":"2024-09-05T07:29:31.882278+0000","last_fullsized":"2024-09-05T07:29:31.882278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:49:40.327718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881205+0000","last_change":"2024-09-05T07:29:29.559998+0000","last_active":"2024-09-05T07:29:31.881205+0000","last_peered":"2024-09-05T07:29:31.881205+0000","last_clean":"2024-09-05T07:29:31.881205+0000","last_became_active":"2024-09-05T07:29:29.559717+0000","last_became_peered":"2024-09-05T07:29:29.559717+0000","last_unstale":"2024-09-05T07:29:31.881205+0000","last_undegraded":"2024-09-05T07:29:31.881205+0000","last_fullsized":"2024-09-05T07:29:31.881205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:58.513308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.632185+0000","last_change":"2024-09-05T07:29:30.657727+0000","last_active":"2024-09-05T07:29:31.632185+0000","last_peered":"2024-09-05T07:29:31.632185+0000","last_clean":"2024-09-05T07:29:31.632185+0000","last_became_active":"2024-09-05T07:29:30.657038+0000","last_became_peered":"2024-09-05T07:29:30.657038+0000","last_unstale":"2024-09-05T07:29:31.632185+0000","last_undegraded":"2024-09-05T07:29:31.632185+0000","last_fullsized":"2024-09-05T07:29:31.632185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:00:35.625571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.962311+0000","last_change":"2024-09-05T07:29:29.566840+0000","last_active":"2024-09-05T07:29:31.962311+0000","last_peered":"2024-09-05T07:29:31.962311+0000","last_clean":"2024-09-05T07:29:31.962311+0000","last_became_active":"2024-09-05T07:29:29.566501+0000","last_became_peered":"2024-09-05T07:29:29.566501+0000","last_unstale":"2024-09-05T07:29:31.962311+0000","last_undegraded":"2024-09-05T07:29:31.962311+0000","last_fullsized":"2024-09-05T07:29:31.962311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:47:57.187710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.625755+0000","last_change":"2024-09-05T07:29:30.642252+0000","last_active":"2024-09-05T07:29:31.625755+0000","last_peered":"2024-09-05T07:29:31.625755+0000","last_clean":"2024-09-05T07:29:31.625755+0000","last_became_active":"2024-09-05T07:29:30.641991+0000","last_became_peered":"2024-09-05T07:29:30.641991+0000","last_unstale":"2024-09-05T07:29:31.625755+0000","last_undegraded":"2024-09-05T07:29:31.625755+0000","last_fullsized":"2024-09-05T07:29:31.625755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:42:04.216273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.495388+0000","last_change":"2024-09-05T07:29:29.562441+0000","last_active":"2024-09-05T07:29:36.495388+0000","last_peered":"2024-09-05T07:29:36.495388+0000","last_clean":"2024-09-05T07:29:36.495388+0000","last_became_active":"2024-09-05T07:29:29.562136+0000","last_became_peered":"2024-09-05T07:29:29.562136+0000","last_unstale":"2024-09-05T07:29:36.495388+0000","last_undegraded":"2024-09-05T07:29:36.495388+0000","last_fullsized":"2024-09-05T07:29:36.495388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:06:20.633881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881213+0000","last_change":"2024-09-05T07:29:30.633033+0000","last_active":"2024-09-05T07:29:31.881213+0000","last_peered":"2024-09-05T07:29:31.881213+0000","last_clean":"2024-09-05T07:29:31.881213+0000","last_became_active":"2024-09-05T07:29:30.632784+0000","last_became_peered":"2024-09-05T07:29:30.632784+0000","last_unstale":"2024-09-05T07:29:31.881213+0000","last_undegraded":"2024-09-05T07:29:31.881213+0000","last_fullsized":"2024-09-05T07:29:31.881213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:03:07.788844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.411896+0000","last_change":"2024-09-05T07:29:29.567195+0000","last_active":"2024-09-05T07:29:36.411896+0000","last_peered":"2024-09-05T07:29:36.411896+0000","last_clean":"2024-09-05T07:29:36.411896+0000","last_became_active":"2024-09-05T07:29:29.566934+0000","last_became_peered":"2024-09-05T07:29:29.566934+0000","last_unstale":"2024-09-05T07:29:36.411896+0000","last_undegraded":"2024-09-05T07:29:36.411896+0000","last_fullsized":"2024-09-05T07:29:36.411896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:10:28.438071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908548+0000","last_change":"2024-09-05T07:29:30.632260+0000","last_active":"2024-09-05T07:29:31.908548+0000","last_peered":"2024-09-05T07:29:31.908548+0000","last_clean":"2024-09-05T07:29:31.908548+0000","last_became_active":"2024-09-05T07:29:30.631974+0000","last_became_peered":"2024-09-05T07:29:30.631974+0000","last_unstale":"2024-09-05T07:29:31.908548+0000","last_undegraded":"2024-09-05T07:29:31.908548+0000","last_fullsized":"2024-09-05T07:29:31.908548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:45:00.967978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.418310+0000","last_change":"2024-09-05T07:29:29.567028+0000","last_active":"2024-09-05T07:29:36.418310+0000","last_peered":"2024-09-05T07:29:36.418310+0000","last_clean":"2024-09-05T07:29:36.418310+0000","last_became_active":"2024-09-05T07:29:29.566754+0000","last_became_peered":"2024-09-05T07:29:29.566754+0000","last_unstale":"2024-09-05T07:29:36.418310+0000","last_undegraded":"2024-09-05T07:29:36.418310+0000","last_fullsized":"2024-09-05T07:29:36.418310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:49:13.565181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.626093+0000","last_change":"2024-09-05T07:29:30.558658+0000","last_active":"2024-09-05T07:29:31.626093+0000","last_peered":"2024-09-05T07:29:31.626093+0000","last_clean":"2024-09-05T07:29:31.626093+0000","last_became_active":"2024-09-05T07:29:30.558179+0000","last_became_peered":"2024-09-05T07:29:30.558179+0000","last_unstale":"2024-09-05T07:29:31.626093+0000","last_undegraded":"2024-09-05T07:29:31.626093+0000","last_fullsized":"2024-09-05T07:29:31.626093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:44:13.003367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.880926+0000","last_change":"2024-09-05T07:29:29.525420+0000","last_active":"2024-09-05T07:29:31.880926+0000","last_peered":"2024-09-05T07:29:31.880926+0000","last_clean":"2024-09-05T07:29:31.880926+0000","last_became_active":"2024-09-05T07:29:29.525139+0000","last_became_peered":"2024-09-05T07:29:29.525139+0000","last_unstale":"2024-09-05T07:29:31.880926+0000","last_undegraded":"2024-09-05T07:29:31.880926+0000","last_fullsized":"2024-09-05T07:29:31.880926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:54:00.339029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.907555+0000","last_change":"2024-09-05T07:29:30.659606+0000","last_active":"2024-09-05T07:29:31.907555+0000","last_peered":"2024-09-05T07:29:31.907555+0000","last_clean":"2024-09-05T07:29:31.907555+0000","last_became_active":"2024-09-05T07:29:30.659311+0000","last_became_peered":"2024-09-05T07:29:30.659311+0000","last_unstale":"2024-09-05T07:29:31.907555+0000","last_undegraded":"2024-09-05T07:29:31.907555+0000","last_fullsized":"2024-09-05T07:29:31.907555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:54:01.479214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:32.039691+0000","last_change":"2024-09-05T07:29:29.566784+0000","last_active":"2024-09-05T07:29:32.039691+0000","last_peered":"2024-09-05T07:29:32.039691+0000","last_clean":"2024-09-05T07:29:32.039691+0000","last_became_active":"2024-09-05T07:29:29.566503+0000","last_became_peered":"2024-09-05T07:29:29.566503+0000","last_unstale":"2024-09-05T07:29:32.039691+0000","last_undegraded":"2024-09-05T07:29:32.039691+0000","last_fullsized":"2024-09-05T07:29:32.039691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:35:54.465221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.625644+0000","last_change":"2024-09-05T07:29:30.641565+0000","last_active":"2024-09-05T07:29:31.625644+0000","last_peered":"2024-09-05T07:29:31.625644+0000","last_clean":"2024-09-05T07:29:31.625644+0000","last_became_active":"2024-09-05T07:29:30.641309+0000","last_became_peered":"2024-09-05T07:29:30.641309+0000","last_unstale":"2024-09-05T07:29:31.625644+0000","last_undegraded":"2024-09-05T07:29:31.625644+0000","last_fullsized":"2024-09-05T07:29:31.625644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:37:28.088603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881203+0000","last_change":"2024-09-05T07:29:29.524793+0000","last_active":"2024-09-05T07:29:31.881203+0000","last_peered":"2024-09-05T07:29:31.881203+0000","last_clean":"2024-09-05T07:29:31.881203+0000","last_became_active":"2024-09-05T07:29:29.524522+0000","last_became_peered":"2024-09-05T07:29:29.524522+0000","last_unstale":"2024-09-05T07:29:31.881203+0000","last_undegraded":"2024-09-05T07:29:31.881203+0000","last_fullsized":"2024-09-05T07:29:31.881203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:41.797972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.882353+0000","last_change":"2024-09-05T07:29:30.642565+0000","last_active":"2024-09-05T07:29:31.882353+0000","last_peered":"2024-09-05T07:29:31.882353+0000","last_clean":"2024-09-05T07:29:31.882353+0000","last_became_active":"2024-09-05T07:29:30.641774+0000","last_became_peered":"2024-09-05T07:29:30.641774+0000","last_unstale":"2024-09-05T07:29:31.882353+0000","last_undegraded":"2024-09-05T07:29:31.882353+0000","last_fullsized":"2024-09-05T07:29:31.882353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:09:36.911425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:32.036409+0000","last_change":"2024-09-05T07:29:29.525374+0000","last_active":"2024-09-05T07:29:32.036409+0000","last_peered":"2024-09-05T07:29:32.036409+0000","last_clean":"2024-09-05T07:29:32.036409+0000","last_became_active":"2024-09-05T07:29:29.525044+0000","last_became_peered":"2024-09-05T07:29:29.525044+0000","last_unstale":"2024-09-05T07:29:32.036409+0000","last_undegraded":"2024-09-05T07:29:32.036409+0000","last_fullsized":"2024-09-05T07:29:32.036409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:25:35.862773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881625+0000","last_change":"2024-09-05T07:29:30.563669+0000","last_active":"2024-09-05T07:29:31.881625+0000","last_peered":"2024-09-05T07:29:31.881625+0000","last_clean":"2024-09-05T07:29:31.881625+0000","last_became_active":"2024-09-05T07:29:30.563408+0000","last_became_peered":"2024-09-05T07:29:30.563408+0000","last_unstale":"2024-09-05T07:29:31.881625+0000","last_undegraded":"2024-09-05T07:29:31.881625+0000","last_fullsized":"2024-09-05T07:29:31.881625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:42:04.216273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:32.041498+0000","last_change":"2024-09-05T07:29:29.559111+0000","last_active":"2024-09-05T07:29:32.041498+0000","last_peered":"2024-09-05T07:29:32.041498+0000","last_clean":"2024-09-05T07:29:32.041498+0000","last_became_active":"2024-09-05T07:29:29.558856+0000","last_became_peered":"2024-09-05T07:29:29.558856+0000","last_unstale":"2024-09-05T07:29:32.041498+0000","last_undegraded":"2024-09-05T07:29:32.041498+0000","last_fullsized":"2024-09-05T07:29:32.041498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:47:57.187710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881728+0000","last_change":"2024-09-05T07:29:30.624401+0000","last_active":"2024-09-05T07:29:31.881728+0000","last_peered":"2024-09-05T07:29:31.881728+0000","last_clean":"2024-09-05T07:29:31.881728+0000","last_became_active":"2024-09-05T07:29:30.624057+0000","last_became_peered":"2024-09-05T07:29:30.624057+0000","last_unstale":"2024-09-05T07:29:31.881728+0000","last_undegraded":"2024-09-05T07:29:31.881728+0000","last_fullsized":"2024-09-05T07:29:31.881728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:36:59.967135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908780+0000","last_change":"2024-09-05T07:29:29.570940+0000","last_active":"2024-09-05T07:29:31.908780+0000","last_peered":"2024-09-05T07:29:31.908780+0000","last_clean":"2024-09-05T07:29:31.908780+0000","last_became_active":"2024-09-05T07:29:29.570478+0000","last_became_peered":"2024-09-05T07:29:29.570478+0000","last_unstale":"2024-09-05T07:29:31.908780+0000","last_undegraded":"2024-09-05T07:29:31.908780+0000","last_fullsized":"2024-09-05T07:29:31.908780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:35:54.465221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.625978+0000","last_change":"2024-09-05T07:29:30.563109+0000","last_active":"2024-09-05T07:29:31.625978+0000","last_peered":"2024-09-05T07:29:31.625978+0000","last_clean":"2024-09-05T07:29:31.625978+0000","last_became_active":"2024-09-05T07:29:30.562824+0000","last_became_peered":"2024-09-05T07:29:30.562824+0000","last_unstale":"2024-09-05T07:29:31.625978+0000","last_undegraded":"2024-09-05T07:29:31.625978+0000","last_fullsized":"2024-09-05T07:29:31.625978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:42:02.212868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":171,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.907582+0000","last_change":"2024-09-05T07:29:13.366600+0000","last_active":"2024-09-05T07:29:31.907582+0000","last_peered":"2024-09-05T07:29:31.907582+0000","last_clean":"2024-09-05T07:29:31.907582+0000","last_became_active":"2024-09-05T07:29:13.365841+0000","last_became_peered":"2024-09-05T07:29:13.365841+0000","last_unstale":"2024-09-05T07:29:31.907582+0000","last_undegraded":"2024-09-05T07:29:31.907582+0000","last_fullsized":"2024-09-05T07:29:31.907582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:10.874807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:10.874807+0000","last_clean_scrub_stamp":"2024-09-05T07:29:10.874807+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:21:17.673107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.418148+0000","last_change":"2024-09-05T07:29:29.563604+0000","last_active":"2024-09-05T07:29:36.418148+0000","last_peered":"2024-09-05T07:29:36.418148+0000","last_clean":"2024-09-05T07:29:36.418148+0000","last_became_active":"2024-09-05T07:29:29.562956+0000","last_became_peered":"2024-09-05T07:29:29.562956+0000","last_unstale":"2024-09-05T07:29:36.418148+0000","last_undegraded":"2024-09-05T07:29:36.418148+0000","last_fullsized":"2024-09-05T07:29:36.418148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:41.797972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.669026+0000","last_change":"2024-09-05T07:29:30.641543+0000","last_active":"2024-09-05T07:29:31.669026+0000","last_peered":"2024-09-05T07:29:31.669026+0000","last_clean":"2024-09-05T07:29:31.669026+0000","last_became_active":"2024-09-05T07:29:30.641243+0000","last_became_peered":"2024-09-05T07:29:30.641243+0000","last_unstale":"2024-09-05T07:29:31.669026+0000","last_undegraded":"2024-09-05T07:29:31.669026+0000","last_fullsized":"2024-09-05T07:29:31.669026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:34:54.335152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.625958+0000","last_change":"2024-09-05T07:29:29.479329+0000","last_active":"2024-09-05T07:29:31.625958+0000","last_peered":"2024-09-05T07:29:31.625958+0000","last_clean":"2024-09-05T07:29:31.625958+0000","last_became_active":"2024-09-05T07:29:29.479005+0000","last_became_peered":"2024-09-05T07:29:29.479005+0000","last_unstale":"2024-09-05T07:29:31.625958+0000","last_undegraded":"2024-09-05T07:29:31.625958+0000","last_fullsized":"2024-09-05T07:29:31.625958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:49:39.187534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908022+0000","last_change":"2024-09-05T07:29:30.641557+0000","last_active":"2024-09-05T07:29:31.908022+0000","last_peered":"2024-09-05T07:29:31.908022+0000","last_clean":"2024-09-05T07:29:31.908022+0000","last_became_active":"2024-09-05T07:29:30.641269+0000","last_became_peered":"2024-09-05T07:29:30.641269+0000","last_unstale":"2024-09-05T07:29:31.908022+0000","last_undegraded":"2024-09-05T07:29:31.908022+0000","last_fullsized":"2024-09-05T07:29:31.908022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:32:30.263430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908555+0000","last_change":"2024-09-05T07:29:29.568835+0000","last_active":"2024-09-05T07:29:31.908555+0000","last_peered":"2024-09-05T07:29:31.908555+0000","last_clean":"2024-09-05T07:29:31.908555+0000","last_became_active":"2024-09-05T07:29:29.568576+0000","last_became_peered":"2024-09-05T07:29:29.568576+0000","last_unstale":"2024-09-05T07:29:31.908555+0000","last_undegraded":"2024-09-05T07:29:31.908555+0000","last_fullsized":"2024-09-05T07:29:31.908555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:05:05.417016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.632195+0000","last_change":"2024-09-05T07:29:30.660008+0000","last_active":"2024-09-05T07:29:31.632195+0000","last_peered":"2024-09-05T07:29:31.632195+0000","last_clean":"2024-09-05T07:29:31.632195+0000","last_became_active":"2024-09-05T07:29:30.659720+0000","last_became_peered":"2024-09-05T07:29:30.659720+0000","last_unstale":"2024-09-05T07:29:31.632195+0000","last_undegraded":"2024-09-05T07:29:31.632195+0000","last_fullsized":"2024-09-05T07:29:31.632195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:42:04.216273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.626314+0000","last_change":"2024-09-05T07:29:29.568569+0000","last_active":"2024-09-05T07:29:31.626314+0000","last_peered":"2024-09-05T07:29:31.626314+0000","last_clean":"2024-09-05T07:29:31.626314+0000","last_became_active":"2024-09-05T07:29:29.568307+0000","last_became_peered":"2024-09-05T07:29:29.568307+0000","last_unstale":"2024-09-05T07:29:31.626314+0000","last_undegraded":"2024-09-05T07:29:31.626314+0000","last_fullsized":"2024-09-05T07:29:31.626314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:12:38.814463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881267+0000","last_change":"2024-09-05T07:29:30.642687+0000","last_active":"2024-09-05T07:29:31.881267+0000","last_peered":"2024-09-05T07:29:31.881267+0000","last_clean":"2024-09-05T07:29:31.881267+0000","last_became_active":"2024-09-05T07:29:30.642414+0000","last_became_peered":"2024-09-05T07:29:30.642414+0000","last_unstale":"2024-09-05T07:29:31.881267+0000","last_undegraded":"2024-09-05T07:29:31.881267+0000","last_fullsized":"2024-09-05T07:29:31.881267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:01:34.217228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.631634+0000","last_change":"2024-09-05T07:29:29.568739+0000","last_active":"2024-09-05T07:29:31.631634+0000","last_peered":"2024-09-05T07:29:31.631634+0000","last_clean":"2024-09-05T07:29:31.631634+0000","last_became_active":"2024-09-05T07:29:29.568499+0000","last_became_peered":"2024-09-05T07:29:29.568499+0000","last_unstale":"2024-09-05T07:29:31.631634+0000","last_undegraded":"2024-09-05T07:29:31.631634+0000","last_fullsized":"2024-09-05T07:29:31.631634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:05:05.417016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881813+0000","last_change":"2024-09-05T07:29:30.641340+0000","last_active":"2024-09-05T07:29:31.881813+0000","last_peered":"2024-09-05T07:29:31.881813+0000","last_clean":"2024-09-05T07:29:31.881813+0000","last_became_active":"2024-09-05T07:29:30.640805+0000","last_became_peered":"2024-09-05T07:29:30.640805+0000","last_unstale":"2024-09-05T07:29:31.881813+0000","last_undegraded":"2024-09-05T07:29:31.881813+0000","last_fullsized":"2024-09-05T07:29:31.881813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:59.653492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.626381+0000","last_change":"2024-09-05T07:29:29.525212+0000","last_active":"2024-09-05T07:29:31.626381+0000","last_peered":"2024-09-05T07:29:31.626381+0000","last_clean":"2024-09-05T07:29:31.626381+0000","last_became_active":"2024-09-05T07:29:29.524918+0000","last_became_peered":"2024-09-05T07:29:29.524918+0000","last_unstale":"2024-09-05T07:29:31.626381+0000","last_undegraded":"2024-09-05T07:29:31.626381+0000","last_fullsized":"2024-09-05T07:29:31.626381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:09:35.771241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908661+0000","last_change":"2024-09-05T07:29:30.658407+0000","last_active":"2024-09-05T07:29:31.908661+0000","last_peered":"2024-09-05T07:29:31.908661+0000","last_clean":"2024-09-05T07:29:31.908661+0000","last_became_active":"2024-09-05T07:29:30.658155+0000","last_became_peered":"2024-09-05T07:29:30.658155+0000","last_unstale":"2024-09-05T07:29:31.908661+0000","last_undegraded":"2024-09-05T07:29:31.908661+0000","last_fullsized":"2024-09-05T07:29:31.908661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:52:56.756904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.669406+0000","last_change":"2024-09-05T07:29:29.526674+0000","last_active":"2024-09-05T07:29:31.669406+0000","last_peered":"2024-09-05T07:29:31.669406+0000","last_clean":"2024-09-05T07:29:31.669406+0000","last_became_active":"2024-09-05T07:29:29.526421+0000","last_became_peered":"2024-09-05T07:29:29.526421+0000","last_unstale":"2024-09-05T07:29:31.669406+0000","last_undegraded":"2024-09-05T07:29:31.669406+0000","last_fullsized":"2024-09-05T07:29:31.669406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:52:13.496606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.669439+0000","last_change":"2024-09-05T07:29:30.633806+0000","last_active":"2024-09-05T07:29:31.669439+0000","last_peered":"2024-09-05T07:29:31.669439+0000","last_clean":"2024-09-05T07:29:31.669439+0000","last_became_active":"2024-09-05T07:29:30.633535+0000","last_became_peered":"2024-09-05T07:29:30.633535+0000","last_unstale":"2024-09-05T07:29:31.669439+0000","last_undegraded":"2024-09-05T07:29:31.669439+0000","last_fullsized":"2024-09-05T07:29:31.669439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:40:35.334862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.417663+0000","last_change":"2024-09-05T07:29:29.524532+0000","last_active":"2024-09-05T07:29:36.417663+0000","last_peered":"2024-09-05T07:29:36.417663+0000","last_clean":"2024-09-05T07:29:36.417663+0000","last_became_active":"2024-09-05T07:29:29.524268+0000","last_became_peered":"2024-09-05T07:29:29.524268+0000","last_unstale":"2024-09-05T07:29:36.417663+0000","last_undegraded":"2024-09-05T07:29:36.417663+0000","last_fullsized":"2024-09-05T07:29:36.417663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:58.513308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.669296+0000","last_change":"2024-09-05T07:29:30.624431+0000","last_active":"2024-09-05T07:29:31.669296+0000","last_peered":"2024-09-05T07:29:31.669296+0000","last_clean":"2024-09-05T07:29:31.669296+0000","last_became_active":"2024-09-05T07:29:30.624117+0000","last_became_peered":"2024-09-05T07:29:30.624117+0000","last_unstale":"2024-09-05T07:29:31.669296+0000","last_undegraded":"2024-09-05T07:29:31.669296+0000","last_fullsized":"2024-09-05T07:29:31.669296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:10:00.845713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.880568+0000","last_change":"2024-09-05T07:29:29.561285+0000","last_active":"2024-09-05T07:29:31.880568+0000","last_peered":"2024-09-05T07:29:31.880568+0000","last_clean":"2024-09-05T07:29:31.880568+0000","last_became_active":"2024-09-05T07:29:29.561026+0000","last_became_peered":"2024-09-05T07:29:29.561026+0000","last_unstale":"2024-09-05T07:29:31.880568+0000","last_undegraded":"2024-09-05T07:29:31.880568+0000","last_fullsized":"2024-09-05T07:29:31.880568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:48:25.900221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.626031+0000","last_change":"2024-09-05T07:29:30.556889+0000","last_active":"2024-09-05T07:29:31.626031+0000","last_peered":"2024-09-05T07:29:31.626031+0000","last_clean":"2024-09-05T07:29:31.626031+0000","last_became_active":"2024-09-05T07:29:30.556627+0000","last_became_peered":"2024-09-05T07:29:30.556627+0000","last_unstale":"2024-09-05T07:29:31.626031+0000","last_undegraded":"2024-09-05T07:29:31.626031+0000","last_fullsized":"2024-09-05T07:29:31.626031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:20:01.152157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.669180+0000","last_change":"2024-09-05T07:29:29.526873+0000","last_active":"2024-09-05T07:29:31.669180+0000","last_peered":"2024-09-05T07:29:31.669180+0000","last_clean":"2024-09-05T07:29:31.669180+0000","last_became_active":"2024-09-05T07:29:29.526572+0000","last_became_peered":"2024-09-05T07:29:29.526572+0000","last_unstale":"2024-09-05T07:29:31.669180+0000","last_undegraded":"2024-09-05T07:29:31.669180+0000","last_fullsized":"2024-09-05T07:29:31.669180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:33:14.122911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.668972+0000","last_change":"2024-09-05T07:29:30.624592+0000","last_active":"2024-09-05T07:29:31.668972+0000","last_peered":"2024-09-05T07:29:31.668972+0000","last_clean":"2024-09-05T07:29:31.668972+0000","last_became_active":"2024-09-05T07:29:30.624109+0000","last_became_peered":"2024-09-05T07:29:30.624109+0000","last_unstale":"2024-09-05T07:29:31.668972+0000","last_undegraded":"2024-09-05T07:29:31.668972+0000","last_fullsized":"2024-09-05T07:29:31.668972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:22:35.613478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908688+0000","last_change":"2024-09-05T07:29:29.569816+0000","last_active":"2024-09-05T07:29:31.908688+0000","last_peered":"2024-09-05T07:29:31.908688+0000","last_clean":"2024-09-05T07:29:31.908688+0000","last_became_active":"2024-09-05T07:29:29.569536+0000","last_became_peered":"2024-09-05T07:29:29.569536+0000","last_unstale":"2024-09-05T07:29:31.908688+0000","last_undegraded":"2024-09-05T07:29:31.908688+0000","last_fullsized":"2024-09-05T07:29:31.908688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:59:18.418220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908389+0000","last_change":"2024-09-05T07:29:30.632805+0000","last_active":"2024-09-05T07:29:31.908389+0000","last_peered":"2024-09-05T07:29:31.908389+0000","last_clean":"2024-09-05T07:29:31.908389+0000","last_became_active":"2024-09-05T07:29:30.632502+0000","last_became_peered":"2024-09-05T07:29:30.632502+0000","last_unstale":"2024-09-05T07:29:31.908389+0000","last_undegraded":"2024-09-05T07:29:31.908389+0000","last_fullsized":"2024-09-05T07:29:31.908389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:59.653492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.417932+0000","last_change":"2024-09-05T07:29:29.563821+0000","last_active":"2024-09-05T07:29:36.417932+0000","last_peered":"2024-09-05T07:29:36.417932+0000","last_clean":"2024-09-05T07:29:36.417932+0000","last_became_active":"2024-09-05T07:29:29.563316+0000","last_became_peered":"2024-09-05T07:29:29.563316+0000","last_unstale":"2024-09-05T07:29:36.417932+0000","last_undegraded":"2024-09-05T07:29:36.417932+0000","last_fullsized":"2024-09-05T07:29:36.417932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:38.961328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.626045+0000","last_change":"2024-09-05T07:29:30.563106+0000","last_active":"2024-09-05T07:29:31.626045+0000","last_peered":"2024-09-05T07:29:31.626045+0000","last_clean":"2024-09-05T07:29:31.626045+0000","last_became_active":"2024-09-05T07:29:30.562776+0000","last_became_peered":"2024-09-05T07:29:30.562776+0000","last_unstale":"2024-09-05T07:29:31.626045+0000","last_undegraded":"2024-09-05T07:29:31.626045+0000","last_fullsized":"2024-09-05T07:29:31.626045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:37:16.174244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.625848+0000","last_change":"2024-09-05T07:29:30.558029+0000","last_active":"2024-09-05T07:29:31.625848+0000","last_peered":"2024-09-05T07:29:31.625848+0000","last_clean":"2024-09-05T07:29:31.625848+0000","last_became_active":"2024-09-05T07:29:30.557747+0000","last_became_peered":"2024-09-05T07:29:30.557747+0000","last_unstale":"2024-09-05T07:29:31.625848+0000","last_undegraded":"2024-09-05T07:29:31.625848+0000","last_fullsized":"2024-09-05T07:29:31.625848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:55:28.983976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.975672+0000","last_change":"2024-09-05T07:29:29.561333+0000","last_active":"2024-09-05T07:29:31.975672+0000","last_peered":"2024-09-05T07:29:31.975672+0000","last_clean":"2024-09-05T07:29:31.975672+0000","last_became_active":"2024-09-05T07:29:29.561065+0000","last_became_peered":"2024-09-05T07:29:29.561065+0000","last_unstale":"2024-09-05T07:29:31.975672+0000","last_undegraded":"2024-09-05T07:29:31.975672+0000","last_fullsized":"2024-09-05T07:29:31.975672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:38.961328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.907784+0000","last_change":"2024-09-05T07:29:30.566028+0000","last_active":"2024-09-05T07:29:31.907784+0000","last_peered":"2024-09-05T07:29:31.907784+0000","last_clean":"2024-09-05T07:29:31.907784+0000","last_became_active":"2024-09-05T07:29:30.565787+0000","last_became_peered":"2024-09-05T07:29:30.565787+0000","last_unstale":"2024-09-05T07:29:31.907784+0000","last_undegraded":"2024-09-05T07:29:31.907784+0000","last_fullsized":"2024-09-05T07:29:31.907784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:59.653492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.975500+0000","last_change":"2024-09-05T07:29:29.559969+0000","last_active":"2024-09-05T07:29:31.975500+0000","last_peered":"2024-09-05T07:29:31.975500+0000","last_clean":"2024-09-05T07:29:31.975500+0000","last_became_active":"2024-09-05T07:29:29.559675+0000","last_became_peered":"2024-09-05T07:29:29.559675+0000","last_unstale":"2024-09-05T07:29:31.975500+0000","last_undegraded":"2024-09-05T07:29:31.975500+0000","last_fullsized":"2024-09-05T07:29:31.975500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:53:39.010323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.631741+0000","last_change":"2024-09-05T07:29:30.657369+0000","last_active":"2024-09-05T07:29:31.631741+0000","last_peered":"2024-09-05T07:29:31.631741+0000","last_clean":"2024-09-05T07:29:31.631741+0000","last_became_active":"2024-09-05T07:29:30.656876+0000","last_became_peered":"2024-09-05T07:29:30.656876+0000","last_unstale":"2024-09-05T07:29:31.631741+0000","last_undegraded":"2024-09-05T07:29:31.631741+0000","last_fullsized":"2024-09-05T07:29:31.631741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:09:22.026287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:32.040857+0000","last_change":"2024-09-05T07:29:29.567440+0000","last_active":"2024-09-05T07:29:32.040857+0000","last_peered":"2024-09-05T07:29:32.040857+0000","last_clean":"2024-09-05T07:29:32.040857+0000","last_became_active":"2024-09-05T07:29:29.567129+0000","last_became_peered":"2024-09-05T07:29:29.567129+0000","last_unstale":"2024-09-05T07:29:32.040857+0000","last_undegraded":"2024-09-05T07:29:32.040857+0000","last_fullsized":"2024-09-05T07:29:32.040857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:54:00.339029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.632072+0000","last_change":"2024-09-05T07:29:30.657929+0000","last_active":"2024-09-05T07:29:31.632072+0000","last_peered":"2024-09-05T07:29:31.632072+0000","last_clean":"2024-09-05T07:29:31.632072+0000","last_became_active":"2024-09-05T07:29:30.657625+0000","last_became_peered":"2024-09-05T07:29:30.657625+0000","last_unstale":"2024-09-05T07:29:31.632072+0000","last_undegraded":"2024-09-05T07:29:31.632072+0000","last_fullsized":"2024-09-05T07:29:31.632072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:37:46.507371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:32.037358+0000","last_change":"2024-09-05T07:29:29.526099+0000","last_active":"2024-09-05T07:29:32.037358+0000","last_peered":"2024-09-05T07:29:32.037358+0000","last_clean":"2024-09-05T07:29:32.037358+0000","last_became_active":"2024-09-05T07:29:29.525832+0000","last_became_peered":"2024-09-05T07:29:29.525832+0000","last_unstale":"2024-09-05T07:29:32.037358+0000","last_undegraded":"2024-09-05T07:29:32.037358+0000","last_fullsized":"2024-09-05T07:29:32.037358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:44:32.741898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3726,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":6226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476746,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36156,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335684,"statfs":{"total":96636764160,"available":96599740416,"internally_reserved":0,"allocated":831488,"data_stored":667834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35576,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336264,"statfs":{"total":96636764160,"available":96600334336,"internally_reserved":0,"allocated":229376,"data_stored":76876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":225280,"data_stored":77334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":233472,"data_stored":78364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":819200,"data_stored":667190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":229376,"data_stored":76808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35572,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336268,"statfs":{"total":96636764160,"available":96600338432,"internally_reserved":0,"allocated":221184,"data_stored":76752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35592,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336248,"statfs":{"total":96636764160,"available":96600317952,"internally_reserved":0,"allocated":241664,"data_stored":79036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T07:29:40.904 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-05T07:29:40.905 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-05T07:29:40.905 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-05T07:29:40.905 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-05T07:29:40.905 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-05T07:29:41.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.039+0000 7f6e59c77640 1 Processor -- start 2024-09-05T07:29:41.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.039+0000 7f6e59c77640 1 -- start start 2024-09-05T07:29:41.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.040+0000 7f6e59c77640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e541549c0 0x7f6e540cd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:41.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.040+0000 7f6e59c77640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e54068570 con 0x7f6e54067fc0 2024-09-05T07:29:41.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.040+0000 7f6e59c77640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e5415a8d0 con 0x7f6e5406bc10 2024-09-05T07:29:41.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.040+0000 7f6e59c77640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f6e5415b4e0 con 0x7f6e541549c0 2024-09-05T07:29:41.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.041+0000 7f6e53fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f6e54067fc0 0x7f6e54165140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42100/0 (socket says 172.21.15.17:42100) 2024-09-05T07:29:41.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.041+0000 7f6e53fff640 1 -- 172.21.15.17:0/1968938524 learned_addr learned my addr 172.21.15.17:0/1968938524 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:29:41.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.041+0000 7f6e537fe640 1 --2- 172.21.15.17:0/1968938524 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e541549c0 0x7f6e540cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:41.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.043+0000 7f6e527fc640 1 -- 172.21.15.17:0/1968938524 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 252062604 0 0) 0x7f6e54068570 con 0x7f6e54067fc0 2024-09-05T07:29:41.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.043+0000 7f6e527fc640 1 -- 172.21.15.17:0/1968938524 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e3c003520 con 0x7f6e54067fc0 2024-09-05T07:29:41.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.043+0000 7f6e527fc640 1 -- 172.21.15.17:0/1968938524 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1603075686 0 0) 0x7f6e5415a8d0 con 0x7f6e5406bc10 2024-09-05T07:29:41.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.043+0000 7f6e537fe640 1 -- 172.21.15.17:0/1968938524 >> v1:172.21.15.26:6789/0 conn(0x7f6e5406bc10 legacy=0x7f6e540c9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:41.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.043+0000 7f6e537fe640 1 -- 172.21.15.17:0/1968938524 >> v1:172.21.15.17:6789/0 conn(0x7f6e54067fc0 legacy=0x7f6e54165140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:41.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.043+0000 7f6e537fe640 1 -- 172.21.15.17:0/1968938524 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e5415abb0 con 0x7f6e541549c0 2024-09-05T07:29:41.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.045+0000 7f6e537fe640 1 --2- 172.21.15.17:0/1968938524 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e541549c0 0x7f6e540cd260 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6e440097d0 tx=0x7f6e4402a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67cc2404f772ab29 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:41.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.049+0000 7f6e527fc640 1 -- 172.21.15.17:0/1968938524 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e44037070 con 0x7f6e541549c0 2024-09-05T07:29:41.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.049+0000 7f6e527fc640 1 -- 172.21.15.17:0/1968938524 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e44032440 con 0x7f6e541549c0 2024-09-05T07:29:41.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.049+0000 7f6e527fc640 1 -- 172.21.15.17:0/1968938524 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e440327f0 con 0x7f6e541549c0 2024-09-05T07:29:41.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.049+0000 7f6e59c77640 1 -- 172.21.15.17:0/1968938524 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e541549c0 msgr2=0x7f6e540cd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:41.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.049+0000 7f6e59c77640 1 --2- 172.21.15.17:0/1968938524 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e541549c0 0x7f6e540cd260 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6e440097d0 tx=0x7f6e4402a290 comp rx=0 tx=0).stop 2024-09-05T07:29:41.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.050+0000 7f6e59c77640 1 -- 172.21.15.17:0/1968938524 shutdown_connections 2024-09-05T07:29:41.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.050+0000 7f6e59c77640 1 --2- 172.21.15.17:0/1968938524 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e541549c0 0x7f6e540cd260 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:41.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.050+0000 7f6e59c77640 1 -- 172.21.15.17:0/1968938524 >> 172.21.15.17:0/1968938524 conn(0x7f6e5406e8d0 msgr2=0x7f6e5406ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:41.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.050+0000 7f6e59c77640 1 -- 172.21.15.17:0/1968938524 shutdown_connections 2024-09-05T07:29:41.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.050+0000 7f6e59c77640 1 -- 172.21.15.17:0/1968938524 wait complete. 2024-09-05T07:29:41.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.051+0000 7f6e59c77640 1 Processor -- start 2024-09-05T07:29:41.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.051+0000 7f6e59c77640 1 -- start start 2024-09-05T07:29:41.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.052+0000 7f6e59c77640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e54067fc0 0x7f6e540cc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:41.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.052+0000 7f6e59c77640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e5406bc10 0x7f6e54150050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:41.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.052+0000 7f6e59c77640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e541549c0 0x7f6e54146b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:41.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.052+0000 7f6e59c77640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6e540c90c0 con 0x7f6e54067fc0 2024-09-05T07:29:41.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.052+0000 7f6e59c77640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5415b170 con 0x7f6e5406bc10 2024-09-05T07:29:41.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.052+0000 7f6e59c77640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f6e540c7d10 con 0x7f6e541549c0 2024-09-05T07:29:41.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.052+0000 7f6e537fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e54067fc0 0x7f6e540cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:41.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.052+0000 7f6e53fff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e541549c0 0x7f6e54146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:41.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.052+0000 7f6e52ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e5406bc10 0x7f6e54150050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:41.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.052+0000 7f6e53fff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e541549c0 0x7f6e54146b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:59754/0 (socket says 172.21.15.17:59754) 2024-09-05T07:29:41.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.052+0000 7f6e53fff640 1 -- 172.21.15.17:0/2691183436 learned_addr learned my addr 172.21.15.17:0/2691183436 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:41.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.056+0000 7f6e53fff640 1 -- 172.21.15.17:0/2691183436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e5406bc10 msgr2=0x7f6e54150050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:41.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.056+0000 7f6e53fff640 1 --2- 172.21.15.17:0/2691183436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e5406bc10 0x7f6e54150050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:41.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.056+0000 7f6e53fff640 1 -- 172.21.15.17:0/2691183436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e54067fc0 msgr2=0x7f6e540cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:41.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.056+0000 7f6e53fff640 1 --2- 172.21.15.17:0/2691183436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e54067fc0 0x7f6e540cc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:41.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.056+0000 7f6e53fff640 1 -- 172.21.15.17:0/2691183436 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e54155450 con 0x7f6e541549c0 2024-09-05T07:29:41.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.059+0000 7f6e53fff640 1 --2- 172.21.15.17:0/2691183436 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e541549c0 0x7f6e54146b70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c00caa0 tx=0x7f6e4c00cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:41.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.063+0000 7f6e3bfff640 1 -- 172.21.15.17:0/2691183436 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c017070 con 0x7f6e541549c0 2024-09-05T07:29:41.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.063+0000 7f6e3bfff640 1 -- 172.21.15.17:0/2691183436 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e4c00ac00 con 0x7f6e541549c0 2024-09-05T07:29:41.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.063+0000 7f6e59c77640 1 -- 172.21.15.17:0/2691183436 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e541f4170 con 0x7f6e541549c0 2024-09-05T07:29:41.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.063+0000 7f6e3bfff640 1 -- 172.21.15.17:0/2691183436 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c012400 con 0x7f6e541549c0 2024-09-05T07:29:41.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.063+0000 7f6e59c77640 1 -- 172.21.15.17:0/2691183436 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e540cb640 con 0x7f6e541549c0 2024-09-05T07:29:41.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.064+0000 7f6e59c77640 1 -- 172.21.15.17:0/2691183436 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e54154da0 con 0x7f6e541549c0 2024-09-05T07:29:41.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.083+0000 7f6e3bfff640 1 -- 172.21.15.17:0/2691183436 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6e4c01a070 con 0x7f6e541549c0 2024-09-05T07:29:41.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.083+0000 7f6e3bfff640 1 --2- 172.21.15.17:0/2691183436 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f6e4006be80 0x7f6e4006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:41.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.084+0000 7f6e537fe640 1 --2- 172.21.15.17:0/2691183436 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f6e4006be80 0x7f6e4006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:41.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.084+0000 7f6e537fe640 1 --2- 172.21.15.17:0/2691183436 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f6e4006be80 0x7f6e4006e340 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6e44034000 tx=0x7f6e4402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:41.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.340+0000 7f6e3bfff640 1 -- 172.21.15.17:0/2691183436 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f6e4c057470 con 0x7f6e541549c0 2024-09-05T07:29:41.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.351+0000 7f6e3bfff640 1 -- 172.21.15.17:0/2691183436 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6e4c021020 con 0x7f6e541549c0 2024-09-05T07:29:41.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.577+0000 7f6e59c77640 1 -- 172.21.15.17:0/2691183436 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f6e54067a70 con 0x7f6e541549c0 2024-09-05T07:29:41.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.728+0000 7f6e3bfff640 1 -- 172.21.15.17:0/2691183436 <== mon.2 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+172939 (secure 0 0 0) 0x7f6e4c0593d0 con 0x7f6e541549c0 2024-09-05T07:29:41.731 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:29:41.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.731+0000 7f6e59c77640 1 -- 172.21.15.17:0/2691183436 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f6e4006be80 msgr2=0x7f6e4006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:41.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.731+0000 7f6e59c77640 1 --2- 172.21.15.17:0/2691183436 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f6e4006be80 0x7f6e4006e340 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6e44034000 tx=0x7f6e4402e000 comp rx=0 tx=0).stop 2024-09-05T07:29:41.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.731+0000 7f6e59c77640 1 -- 172.21.15.17:0/2691183436 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e541549c0 msgr2=0x7f6e54146b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:41.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.731+0000 7f6e59c77640 1 --2- 172.21.15.17:0/2691183436 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e541549c0 0x7f6e54146b70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c00caa0 tx=0x7f6e4c00cf60 comp rx=0 tx=0).stop 2024-09-05T07:29:41.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.731+0000 7f6e59c77640 1 -- 172.21.15.17:0/2691183436 shutdown_connections 2024-09-05T07:29:41.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.731+0000 7f6e59c77640 1 --2- 172.21.15.17:0/2691183436 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f6e4006be80 0x7f6e4006e340 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:41.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.731+0000 7f6e59c77640 1 --2- 172.21.15.17:0/2691183436 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e541549c0 0x7f6e54146b70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:41.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.731+0000 7f6e59c77640 1 --2- 172.21.15.17:0/2691183436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e5406bc10 0x7f6e54150050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:41.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.731+0000 7f6e59c77640 1 --2- 172.21.15.17:0/2691183436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e54067fc0 0x7f6e540cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:41.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.731+0000 7f6e59c77640 1 -- 172.21.15.17:0/2691183436 >> 172.21.15.17:0/2691183436 conn(0x7f6e5406e8d0 msgr2=0x7f6e54151990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:41.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.731+0000 7f6e59c77640 1 -- 172.21.15.17:0/2691183436 shutdown_connections 2024-09-05T07:29:41.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.731+0000 7f6e59c77640 1 -- 172.21.15.17:0/2691183436 wait complete. 2024-09-05T07:29:41.743 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":5,"flags":0,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":2736912541},{"type":"v1","addr":"172.21.15.26:6801","nonce":2736912541}]},"active_addr":"172.21.15.26:6801/2736912541","active_change":"2024-09-05T07:28:59.560676+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4103,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.26:0","nonce":1847181031}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.26:0","nonce":3682399955}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.26:0","nonce":3429550112}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.26:0","nonce":2873448151}]}]} 2024-09-05T07:29:41.748 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-05T07:29:41.748 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-05T07:29:41.748 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-05T07:29:41.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.848+0000 7f4660a47640 1 Processor -- start 2024-09-05T07:29:41.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.848+0000 7f4660a47640 1 -- start start 2024-09-05T07:29:41.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.849+0000 7f4660a47640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f465c0ca3a0 0x7f465c0c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:41.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.849+0000 7f4660a47640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f465c0ca780 0x7f465c0c3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:41.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.849+0000 7f4660a47640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f465c0c9630 con 0x7f465c158d70 2024-09-05T07:29:41.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.849+0000 7f4660a47640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f465c0c93e0 con 0x7f465c0ca780 2024-09-05T07:29:41.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.849+0000 7f4660a47640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f465c0c9910 con 0x7f465c0ca3a0 2024-09-05T07:29:41.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.853+0000 7f4653fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f465c0ca780 0x7f465c0c3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:41.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.853+0000 7f4653fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f465c0ca780 0x7f465c0c3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60410/0 (socket says 172.21.15.17:60410) 2024-09-05T07:29:41.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.853+0000 7f4653fff640 1 -- 172.21.15.17:0/121906643 learned_addr learned my addr 172.21.15.17:0/121906643 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:41.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.856+0000 7f4653fff640 1 -- 172.21.15.17:0/121906643 >> v2:172.21.15.26:3300/0 conn(0x7f465c0ca3a0 msgr2=0x7f465c0c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:41.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.856+0000 7f4653fff640 1 --2- 172.21.15.17:0/121906643 >> v2:172.21.15.26:3300/0 conn(0x7f465c0ca3a0 0x7f465c0c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:41.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.856+0000 7f4653fff640 1 -- 172.21.15.17:0/121906643 >> v1:172.21.15.17:6789/0 conn(0x7f465c158d70 legacy=0x7f465c152550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:41.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.856+0000 7f4653fff640 1 -- 172.21.15.17:0/121906643 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f465c0c9bf0 con 0x7f465c0ca780 2024-09-05T07:29:41.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.860+0000 7f4653fff640 1 --2- 172.21.15.17:0/121906643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f465c0ca780 0x7f465c0c3260 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f465c0cee30 tx=0x7f464402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3501638d0858a76d server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:41.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.865+0000 7f4659d9b640 1 -- 172.21.15.17:0/121906643 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4644037070 con 0x7f465c0ca780 2024-09-05T07:29:41.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.865+0000 7f4659d9b640 1 -- 172.21.15.17:0/121906643 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4644032440 con 0x7f465c0ca780 2024-09-05T07:29:41.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.865+0000 7f4659d9b640 1 -- 172.21.15.17:0/121906643 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4644032810 con 0x7f465c0ca780 2024-09-05T07:29:41.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.865+0000 7f4660a47640 1 -- 172.21.15.17:0/121906643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f465c0ca780 msgr2=0x7f465c0c3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:41.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.865+0000 7f4660a47640 1 --2- 172.21.15.17:0/121906643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f465c0ca780 0x7f465c0c3260 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f465c0cee30 tx=0x7f464402a270 comp rx=0 tx=0).stop 2024-09-05T07:29:41.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.866+0000 7f4660a47640 1 -- 172.21.15.17:0/121906643 shutdown_connections 2024-09-05T07:29:41.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.866+0000 7f4660a47640 1 --2- 172.21.15.17:0/121906643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f465c0ca780 0x7f465c0c3260 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:41.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.866+0000 7f4660a47640 1 --2- 172.21.15.17:0/121906643 >> v2:172.21.15.26:3300/0 conn(0x7f465c0ca3a0 0x7f465c0c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:41.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.866+0000 7f4660a47640 1 -- 172.21.15.17:0/121906643 >> 172.21.15.17:0/121906643 conn(0x7f465c06de20 msgr2=0x7f465c06e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:41.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.866+0000 7f4660a47640 1 -- 172.21.15.17:0/121906643 shutdown_connections 2024-09-05T07:29:41.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.866+0000 7f4660a47640 1 -- 172.21.15.17:0/121906643 wait complete. 2024-09-05T07:29:41.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.867+0000 7f4660a47640 1 Processor -- start 2024-09-05T07:29:41.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.867+0000 7f4660a47640 1 -- start start 2024-09-05T07:29:41.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.868+0000 7f4660a47640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f465c0ca3a0 0x7f465c0c7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:41.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.868+0000 7f4660a47640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f465c0ca780 0x7f465c1e5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:41.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.868+0000 7f4660a47640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f465c158d70 0x7f465c14bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:41.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.868+0000 7f4660a47640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f465c0c5260 con 0x7f465c158d70 2024-09-05T07:29:41.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.868+0000 7f4660a47640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f465c158850 con 0x7f465c0ca780 2024-09-05T07:29:41.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.868+0000 7f4660a47640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f465c0c37a0 con 0x7f465c0ca3a0 2024-09-05T07:29:41.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.868+0000 7f465ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f465c158d70 0x7f465c14bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:41.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.869+0000 7f465ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f465c158d70 0x7f465c14bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60426/0 (socket says 172.21.15.17:60426) 2024-09-05T07:29:41.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.869+0000 7f465ad9d640 1 -- 172.21.15.17:0/3711062118 learned_addr learned my addr 172.21.15.17:0/3711062118 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:41.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.872+0000 7f465ad9d640 1 -- 172.21.15.17:0/3711062118 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f465c0ca3a0 msgr2=0x7f465c0c7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:41.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.872+0000 7f465ad9d640 1 --2- 172.21.15.17:0/3711062118 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f465c0ca3a0 0x7f465c0c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:41.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.872+0000 7f465ad9d640 1 -- 172.21.15.17:0/3711062118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f465c0ca780 msgr2=0x7f465c1e5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:41.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.872+0000 7f465ad9d640 1 --2- 172.21.15.17:0/3711062118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f465c0ca780 0x7f465c1e5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:41.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.872+0000 7f465ad9d640 1 -- 172.21.15.17:0/3711062118 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f465c0c7170 con 0x7f465c158d70 2024-09-05T07:29:41.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.875+0000 7f465ad9d640 1 --2- 172.21.15.17:0/3711062118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f465c158d70 0x7f465c14bb50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f465400c6b0 tx=0x7f465400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:41.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.894+0000 7f4652ffd640 1 -- 172.21.15.17:0/3711062118 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4654003b70 con 0x7f465c158d70 2024-09-05T07:29:41.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.894+0000 7f4652ffd640 1 -- 172.21.15.17:0/3711062118 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4654003d30 con 0x7f465c158d70 2024-09-05T07:29:41.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.894+0000 7f4652ffd640 1 -- 172.21.15.17:0/3711062118 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4654005310 con 0x7f465c158d70 2024-09-05T07:29:41.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.894+0000 7f4660a47640 1 -- 172.21.15.17:0/3711062118 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f465c0cdd20 con 0x7f465c158d70 2024-09-05T07:29:41.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.894+0000 7f4660a47640 1 -- 172.21.15.17:0/3711062118 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f465c0ce2c0 con 0x7f465c158d70 2024-09-05T07:29:41.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.895+0000 7f4660a47640 1 -- 172.21.15.17:0/3711062118 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f465c0c3260 con 0x7f465c158d70 2024-09-05T07:29:41.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.916+0000 7f4652ffd640 1 -- 172.21.15.17:0/3711062118 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f46540054b0 con 0x7f465c158d70 2024-09-05T07:29:41.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.916+0000 7f4652ffd640 1 --2- 172.21.15.17:0/3711062118 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f463c06be80 0x7f463c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:41.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.916+0000 7f465a59c640 1 --2- 172.21.15.17:0/3711062118 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f463c06be80 0x7f463c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:41.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.917+0000 7f465a59c640 1 --2- 172.21.15.17:0/3711062118 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f463c06be80 0x7f463c06e340 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f464c009710 tx=0x7f464c006c90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:41.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:41.920+0000 7f4652ffd640 1 -- 172.21.15.17:0/3711062118 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f46540057a0 con 0x7f465c158d70 2024-09-05T07:29:42.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.218+0000 7f4652ffd640 1 -- 172.21.15.17:0/3711062118 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f465405a1a0 con 0x7f465c158d70 2024-09-05T07:29:42.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.445+0000 7f4660a47640 1 -- 172.21.15.17:0/3711062118 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f465c0c4ee0 con 0x7f465c158d70 2024-09-05T07:29:42.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.497+0000 7f4652ffd640 1 -- 172.21.15.17:0/3711062118 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16621 (secure 0 0 0) 0x7f4654059aa0 con 0x7f465c158d70 2024-09-05T07:29:42.499 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:29:42.499 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":22,"fsid":"848dac54-74f8-48f3-8686-c6495dcb972b","created":"2024-09-05T07:28:54.070215+0000","modified":"2024-09-05T07:29:31.467668+0000","last_up_change":"2024-09-05T07:29:11.992790+0000","last_in_change":"2024-09-05T07:29:00.001829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T07:29:10.227047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T07:29:27.905154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T07:29:29.039672+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f01a8b4-dc10-4cdf-a65e-b7f96de4e2b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2731314060},{"type":"v1","addr":"172.21.15.17:6825","nonce":2731314060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2731314060},{"type":"v1","addr":"172.21.15.17:6827","nonce":2731314060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2731314060},{"type":"v1","addr":"172.21.15.17:6831","nonce":2731314060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2731314060},{"type":"v1","addr":"172.21.15.17:6829","nonce":2731314060}]},"public_addr":"172.21.15.17:6825/2731314060","cluster_addr":"172.21.15.17:6827/2731314060","heartbeat_back_addr":"172.21.15.17:6831/2731314060","heartbeat_front_addr":"172.21.15.17:6829/2731314060","state":["exists","up"]},{"osd":1,"uuid":"d16867fb-2290-486c-9ac8-327ca54326d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3327408852},{"type":"v1","addr":"172.21.15.17:6817","nonce":3327408852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3327408852},{"type":"v1","addr":"172.21.15.17:6819","nonce":3327408852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3327408852},{"type":"v1","addr":"172.21.15.17:6823","nonce":3327408852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3327408852},{"type":"v1","addr":"172.21.15.17:6821","nonce":3327408852}]},"public_addr":"172.21.15.17:6817/3327408852","cluster_addr":"172.21.15.17:6819/3327408852","heartbeat_back_addr":"172.21.15.17:6823/3327408852","heartbeat_front_addr":"172.21.15.17:6821/3327408852","state":["exists","up"]},{"osd":2,"uuid":"632ad558-bd14-4240-a8f1-5beda951b3b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":363420609},{"type":"v1","addr":"172.21.15.17:6809","nonce":363420609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":363420609},{"type":"v1","addr":"172.21.15.17:6811","nonce":363420609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":363420609},{"type":"v1","addr":"172.21.15.17:6815","nonce":363420609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":363420609},{"type":"v1","addr":"172.21.15.17:6813","nonce":363420609}]},"public_addr":"172.21.15.17:6809/363420609","cluster_addr":"172.21.15.17:6811/363420609","heartbeat_back_addr":"172.21.15.17:6815/363420609","heartbeat_front_addr":"172.21.15.17:6813/363420609","state":["exists","up"]},{"osd":3,"uuid":"9727a970-8f98-45b9-8eca-62da1f28ff17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":3512342499},{"type":"v1","addr":"172.21.15.17:6801","nonce":3512342499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":3512342499},{"type":"v1","addr":"172.21.15.17:6803","nonce":3512342499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":3512342499},{"type":"v1","addr":"172.21.15.17:6807","nonce":3512342499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":3512342499},{"type":"v1","addr":"172.21.15.17:6805","nonce":3512342499}]},"public_addr":"172.21.15.17:6801/3512342499","cluster_addr":"172.21.15.17:6803/3512342499","heartbeat_back_addr":"172.21.15.17:6807/3512342499","heartbeat_front_addr":"172.21.15.17:6805/3512342499","state":["exists","up"]},{"osd":4,"uuid":"0e0141e0-51f1-4229-861f-1992afe70c96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6803","nonce":3740556509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6805","nonce":3740556509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6809","nonce":3740556509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6807","nonce":3740556509}]},"public_addr":"172.21.15.26:6803/3740556509","cluster_addr":"172.21.15.26:6805/3740556509","heartbeat_back_addr":"172.21.15.26:6809/3740556509","heartbeat_front_addr":"172.21.15.26:6807/3740556509","state":["exists","up"]},{"osd":5,"uuid":"5603d79b-fcf8-45aa-a1db-96918af450be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3020770750},{"type":"v1","addr":"172.21.15.26:6819","nonce":3020770750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3020770750},{"type":"v1","addr":"172.21.15.26:6821","nonce":3020770750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3020770750},{"type":"v1","addr":"172.21.15.26:6825","nonce":3020770750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3020770750},{"type":"v1","addr":"172.21.15.26:6823","nonce":3020770750}]},"public_addr":"172.21.15.26:6819/3020770750","cluster_addr":"172.21.15.26:6821/3020770750","heartbeat_back_addr":"172.21.15.26:6825/3020770750","heartbeat_front_addr":"172.21.15.26:6823/3020770750","state":["exists","up"]},{"osd":6,"uuid":"14f3b696-1b3c-4749-8f61-ac10edbb5b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6811","nonce":158775588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6813","nonce":158775588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6817","nonce":158775588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6815","nonce":158775588}]},"public_addr":"172.21.15.26:6811/158775588","cluster_addr":"172.21.15.26:6813/158775588","heartbeat_back_addr":"172.21.15.26:6817/158775588","heartbeat_front_addr":"172.21.15.26:6815/158775588","state":["exists","up"]},{"osd":7,"uuid":"be7b4121-c71b-4908-ba4a-9c4389423201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":4176189153},{"type":"v1","addr":"172.21.15.26:6827","nonce":4176189153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":4176189153},{"type":"v1","addr":"172.21.15.26:6829","nonce":4176189153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":4176189153},{"type":"v1","addr":"172.21.15.26:6833","nonce":4176189153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":4176189153},{"type":"v1","addr":"172.21.15.26:6831","nonce":4176189153}]},"public_addr":"172.21.15.26:6827/4176189153","cluster_addr":"172.21.15.26:6829/4176189153","heartbeat_back_addr":"172.21.15.26:6833/4176189153","heartbeat_front_addr":"172.21.15.26:6831/4176189153","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.923722+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.404043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.275202+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.434925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.159606+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.379036+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.196000+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.387333+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T07:29:42.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.499+0000 7f4660a47640 1 -- 172.21.15.17:0/3711062118 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f463c06be80 msgr2=0x7f463c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:42.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.499+0000 7f4660a47640 1 --2- 172.21.15.17:0/3711062118 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f463c06be80 0x7f463c06e340 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f464c009710 tx=0x7f464c006c90 comp rx=0 tx=0).stop 2024-09-05T07:29:42.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.499+0000 7f4660a47640 1 -- 172.21.15.17:0/3711062118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f465c158d70 msgr2=0x7f465c14bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:42.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.499+0000 7f4660a47640 1 --2- 172.21.15.17:0/3711062118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f465c158d70 0x7f465c14bb50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f465400c6b0 tx=0x7f465400cb70 comp rx=0 tx=0).stop 2024-09-05T07:29:42.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.499+0000 7f4660a47640 1 -- 172.21.15.17:0/3711062118 shutdown_connections 2024-09-05T07:29:42.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.499+0000 7f4660a47640 1 --2- 172.21.15.17:0/3711062118 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f463c06be80 0x7f463c06e340 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:42.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.499+0000 7f4660a47640 1 --2- 172.21.15.17:0/3711062118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f465c158d70 0x7f465c14bb50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:42.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.499+0000 7f4660a47640 1 --2- 172.21.15.17:0/3711062118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f465c0ca780 0x7f465c1e5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:42.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.499+0000 7f4660a47640 1 --2- 172.21.15.17:0/3711062118 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f465c0ca3a0 0x7f465c0c7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:42.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.499+0000 7f4660a47640 1 -- 172.21.15.17:0/3711062118 >> 172.21.15.17:0/3711062118 conn(0x7f465c06de20 msgr2=0x7f465c152320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:42.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.499+0000 7f4660a47640 1 -- 172.21.15.17:0/3711062118 shutdown_connections 2024-09-05T07:29:42.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.499+0000 7f4660a47640 1 -- 172.21.15.17:0/3711062118 wait complete. 2024-09-05T07:29:42.513 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-05T07:29:42.513 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-05T07:29:42.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.611+0000 7f6e11c8d640 1 Processor -- start 2024-09-05T07:29:42.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.611+0000 7f6e11c8d640 1 -- start start 2024-09-05T07:29:42.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.612+0000 7f6e11c8d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6e0c0c5870 0x7f6e0c0c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:42.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.612+0000 7f6e11c8d640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e0c073ed0 con 0x7f6e0c0c78e0 2024-09-05T07:29:42.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.612+0000 7f6e11c8d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e0c073910 con 0x7f6e0c0c8eb0 2024-09-05T07:29:42.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.612+0000 7f6e11c8d640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f6e0c073bf0 con 0x7f6e0c0c5870 2024-09-05T07:29:42.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.612+0000 7f6e0b7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6e0c0c8eb0 0x7f6e0c0c9290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.17:44600/0 (socket says 172.21.15.17:44600) 2024-09-05T07:29:42.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.613+0000 7f6e0b7fe640 1 -- 172.21.15.17:0/2446072687 learned_addr learned my addr 172.21.15.17:0/2446072687 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:29:42.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.613+0000 7f6e0affd640 1 --2- 172.21.15.17:0/2446072687 >> v2:172.21.15.17:3300/0 conn(0x7f6e0c0c5870 0x7f6e0c0c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:42.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.615+0000 7f6e0a7fc640 1 -- 172.21.15.17:0/2446072687 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4098455307 0 0) 0x7f6e0c073910 con 0x7f6e0c0c8eb0 2024-09-05T07:29:42.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.615+0000 7f6e0a7fc640 1 -- 172.21.15.17:0/2446072687 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6df4003520 con 0x7f6e0c0c8eb0 2024-09-05T07:29:42.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.616+0000 7f6e0affd640 1 -- 172.21.15.17:0/2446072687 >> v1:172.21.15.26:6789/0 conn(0x7f6e0c0c8eb0 legacy=0x7f6e0c0c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:42.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.616+0000 7f6e0affd640 1 -- 172.21.15.17:0/2446072687 >> v1:172.21.15.17:6789/0 conn(0x7f6e0c0c78e0 legacy=0x7f6e0c0c6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:42.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.616+0000 7f6e0affd640 1 -- 172.21.15.17:0/2446072687 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e0c0c5f50 con 0x7f6e0c0c5870 2024-09-05T07:29:42.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.620+0000 7f6e0affd640 1 --2- 172.21.15.17:0/2446072687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e0c0c5870 0x7f6e0c0c44e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6e000097a0 tx=0x7f6e0002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cedc832ea2f4d40 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:42.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.625+0000 7f6e0a7fc640 1 -- 172.21.15.17:0/2446072687 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e00037070 con 0x7f6e0c0c5870 2024-09-05T07:29:42.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.625+0000 7f6e0a7fc640 1 -- 172.21.15.17:0/2446072687 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e00032440 con 0x7f6e0c0c5870 2024-09-05T07:29:42.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.625+0000 7f6e0a7fc640 1 -- 172.21.15.17:0/2446072687 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e00032810 con 0x7f6e0c0c5870 2024-09-05T07:29:42.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.626+0000 7f6e11c8d640 1 -- 172.21.15.17:0/2446072687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e0c0c5870 msgr2=0x7f6e0c0c44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:42.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.626+0000 7f6e11c8d640 1 --2- 172.21.15.17:0/2446072687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e0c0c5870 0x7f6e0c0c44e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6e000097a0 tx=0x7f6e0002a270 comp rx=0 tx=0).stop 2024-09-05T07:29:42.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.626+0000 7f6e11c8d640 1 -- 172.21.15.17:0/2446072687 shutdown_connections 2024-09-05T07:29:42.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.626+0000 7f6e11c8d640 1 --2- 172.21.15.17:0/2446072687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e0c0c5870 0x7f6e0c0c44e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:42.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.626+0000 7f6e11c8d640 1 -- 172.21.15.17:0/2446072687 >> 172.21.15.17:0/2446072687 conn(0x7f6e0c0c9ae0 msgr2=0x7f6e0c0c9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:42.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.626+0000 7f6e11c8d640 1 -- 172.21.15.17:0/2446072687 shutdown_connections 2024-09-05T07:29:42.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.626+0000 7f6e11c8d640 1 -- 172.21.15.17:0/2446072687 wait complete. 2024-09-05T07:29:42.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.627+0000 7f6e11c8d640 1 Processor -- start 2024-09-05T07:29:42.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.627+0000 7f6e11c8d640 1 -- start start 2024-09-05T07:29:42.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.628+0000 7f6e11c8d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e0c0c5870 0x7f6e0c1ef080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:42.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.628+0000 7f6e11c8d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e0c0c78e0 0x7f6e0c0ac800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:42.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.628+0000 7f6e11c8d640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e0c0c8eb0 0x7f6e0c0ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:42.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.628+0000 7f6e11c8d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6e0c0c7140 con 0x7f6e0c0c78e0 2024-09-05T07:29:42.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.628+0000 7f6e11c8d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f6e0c0c6510 con 0x7f6e0c0c5870 2024-09-05T07:29:42.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.628+0000 7f6e11c8d640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f6e0c0c72c0 con 0x7f6e0c0c8eb0 2024-09-05T07:29:42.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.628+0000 7f6e0affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e0c0c78e0 0x7f6e0c0ac800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:42.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.629+0000 7f6e0b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e0c0c5870 0x7f6e0c1ef080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:42.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.629+0000 7f6e0bfff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e0c0c8eb0 0x7f6e0c0ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:42.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.629+0000 7f6e0affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e0c0c78e0 0x7f6e0c0ac800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60450/0 (socket says 172.21.15.17:60450) 2024-09-05T07:29:42.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.629+0000 7f6e0affd640 1 -- 172.21.15.17:0/3090284444 learned_addr learned my addr 172.21.15.17:0/3090284444 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:42.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.632+0000 7f6e0b7fe640 1 -- 172.21.15.17:0/3090284444 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e0c0c8eb0 msgr2=0x7f6e0c0ae2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:42.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.632+0000 7f6e0b7fe640 1 --2- 172.21.15.17:0/3090284444 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e0c0c8eb0 0x7f6e0c0ae2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:42.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.632+0000 7f6e0b7fe640 1 -- 172.21.15.17:0/3090284444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e0c0c78e0 msgr2=0x7f6e0c0ac800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:42.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.632+0000 7f6e0b7fe640 1 --2- 172.21.15.17:0/3090284444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e0c0c78e0 0x7f6e0c0ac800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:42.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.632+0000 7f6e0b7fe640 1 -- 172.21.15.17:0/3090284444 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e0c0b2160 con 0x7f6e0c0c5870 2024-09-05T07:29:42.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.634+0000 7f6e0b7fe640 1 --2- 172.21.15.17:0/3090284444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e0c0c5870 0x7f6e0c1ef080 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc00c420 tx=0x7f6dfc001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:42.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.639+0000 7f6df3fff640 1 -- 172.21.15.17:0/3090284444 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc017070 con 0x7f6e0c0c5870 2024-09-05T07:29:42.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.639+0000 7f6df3fff640 1 -- 172.21.15.17:0/3090284444 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dfc005ce0 con 0x7f6e0c0c5870 2024-09-05T07:29:42.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.639+0000 7f6e11c8d640 1 -- 172.21.15.17:0/3090284444 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e0c1ee5a0 con 0x7f6e0c0c5870 2024-09-05T07:29:42.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.639+0000 7f6df3fff640 1 -- 172.21.15.17:0/3090284444 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc0072d0 con 0x7f6e0c0c5870 2024-09-05T07:29:42.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.639+0000 7f6e11c8d640 1 -- 172.21.15.17:0/3090284444 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e0c1eeb60 con 0x7f6e0c0c5870 2024-09-05T07:29:42.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.640+0000 7f6e11c8d640 1 -- 172.21.15.17:0/3090284444 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e0c0c8910 con 0x7f6e0c0c5870 2024-09-05T07:29:42.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.659+0000 7f6df3fff640 1 -- 172.21.15.17:0/3090284444 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6dfc01a070 con 0x7f6e0c0c5870 2024-09-05T07:29:42.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.659+0000 7f6df3fff640 1 --2- 172.21.15.17:0/3090284444 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f6df806be80 0x7f6df806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:42.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.660+0000 7f6e0affd640 1 --2- 172.21.15.17:0/3090284444 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f6df806be80 0x7f6df806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:42.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.660+0000 7f6e0affd640 1 --2- 172.21.15.17:0/3090284444 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f6df806be80 0x7f6df806e340 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6e0002a2b0 tx=0x7f6e0002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:42.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.662+0000 7f6df3fff640 1 -- 172.21.15.17:0/3090284444 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f6dfc056a50 con 0x7f6e0c0c5870 2024-09-05T07:29:42.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:42.928+0000 7f6df3fff640 1 -- 172.21.15.17:0/3090284444 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6e0c0c8910 con 0x7f6e0c0c5870 2024-09-05T07:29:43.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.125+0000 7f6e11c8d640 1 -- 172.21.15.17:0/3090284444 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6e0c0c53d0 con 0x7f6e0c0c5870 2024-09-05T07:29:43.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.172+0000 7f6df3fff640 1 -- 172.21.15.17:0/3090284444 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16621 (secure 0 0 0) 0x7f6e0c0c53d0 con 0x7f6e0c0c5870 2024-09-05T07:29:43.175 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:29:43.175 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":22,"fsid":"848dac54-74f8-48f3-8686-c6495dcb972b","created":"2024-09-05T07:28:54.070215+0000","modified":"2024-09-05T07:29:31.467668+0000","last_up_change":"2024-09-05T07:29:11.992790+0000","last_in_change":"2024-09-05T07:29:00.001829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T07:29:10.227047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T07:29:27.905154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T07:29:29.039672+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f01a8b4-dc10-4cdf-a65e-b7f96de4e2b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2731314060},{"type":"v1","addr":"172.21.15.17:6825","nonce":2731314060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2731314060},{"type":"v1","addr":"172.21.15.17:6827","nonce":2731314060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2731314060},{"type":"v1","addr":"172.21.15.17:6831","nonce":2731314060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2731314060},{"type":"v1","addr":"172.21.15.17:6829","nonce":2731314060}]},"public_addr":"172.21.15.17:6825/2731314060","cluster_addr":"172.21.15.17:6827/2731314060","heartbeat_back_addr":"172.21.15.17:6831/2731314060","heartbeat_front_addr":"172.21.15.17:6829/2731314060","state":["exists","up"]},{"osd":1,"uuid":"d16867fb-2290-486c-9ac8-327ca54326d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3327408852},{"type":"v1","addr":"172.21.15.17:6817","nonce":3327408852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3327408852},{"type":"v1","addr":"172.21.15.17:6819","nonce":3327408852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3327408852},{"type":"v1","addr":"172.21.15.17:6823","nonce":3327408852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3327408852},{"type":"v1","addr":"172.21.15.17:6821","nonce":3327408852}]},"public_addr":"172.21.15.17:6817/3327408852","cluster_addr":"172.21.15.17:6819/3327408852","heartbeat_back_addr":"172.21.15.17:6823/3327408852","heartbeat_front_addr":"172.21.15.17:6821/3327408852","state":["exists","up"]},{"osd":2,"uuid":"632ad558-bd14-4240-a8f1-5beda951b3b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":363420609},{"type":"v1","addr":"172.21.15.17:6809","nonce":363420609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":363420609},{"type":"v1","addr":"172.21.15.17:6811","nonce":363420609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":363420609},{"type":"v1","addr":"172.21.15.17:6815","nonce":363420609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":363420609},{"type":"v1","addr":"172.21.15.17:6813","nonce":363420609}]},"public_addr":"172.21.15.17:6809/363420609","cluster_addr":"172.21.15.17:6811/363420609","heartbeat_back_addr":"172.21.15.17:6815/363420609","heartbeat_front_addr":"172.21.15.17:6813/363420609","state":["exists","up"]},{"osd":3,"uuid":"9727a970-8f98-45b9-8eca-62da1f28ff17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":3512342499},{"type":"v1","addr":"172.21.15.17:6801","nonce":3512342499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":3512342499},{"type":"v1","addr":"172.21.15.17:6803","nonce":3512342499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":3512342499},{"type":"v1","addr":"172.21.15.17:6807","nonce":3512342499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":3512342499},{"type":"v1","addr":"172.21.15.17:6805","nonce":3512342499}]},"public_addr":"172.21.15.17:6801/3512342499","cluster_addr":"172.21.15.17:6803/3512342499","heartbeat_back_addr":"172.21.15.17:6807/3512342499","heartbeat_front_addr":"172.21.15.17:6805/3512342499","state":["exists","up"]},{"osd":4,"uuid":"0e0141e0-51f1-4229-861f-1992afe70c96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6803","nonce":3740556509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6805","nonce":3740556509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6809","nonce":3740556509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6807","nonce":3740556509}]},"public_addr":"172.21.15.26:6803/3740556509","cluster_addr":"172.21.15.26:6805/3740556509","heartbeat_back_addr":"172.21.15.26:6809/3740556509","heartbeat_front_addr":"172.21.15.26:6807/3740556509","state":["exists","up"]},{"osd":5,"uuid":"5603d79b-fcf8-45aa-a1db-96918af450be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3020770750},{"type":"v1","addr":"172.21.15.26:6819","nonce":3020770750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3020770750},{"type":"v1","addr":"172.21.15.26:6821","nonce":3020770750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3020770750},{"type":"v1","addr":"172.21.15.26:6825","nonce":3020770750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3020770750},{"type":"v1","addr":"172.21.15.26:6823","nonce":3020770750}]},"public_addr":"172.21.15.26:6819/3020770750","cluster_addr":"172.21.15.26:6821/3020770750","heartbeat_back_addr":"172.21.15.26:6825/3020770750","heartbeat_front_addr":"172.21.15.26:6823/3020770750","state":["exists","up"]},{"osd":6,"uuid":"14f3b696-1b3c-4749-8f61-ac10edbb5b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6811","nonce":158775588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6813","nonce":158775588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6817","nonce":158775588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6815","nonce":158775588}]},"public_addr":"172.21.15.26:6811/158775588","cluster_addr":"172.21.15.26:6813/158775588","heartbeat_back_addr":"172.21.15.26:6817/158775588","heartbeat_front_addr":"172.21.15.26:6815/158775588","state":["exists","up"]},{"osd":7,"uuid":"be7b4121-c71b-4908-ba4a-9c4389423201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":4176189153},{"type":"v1","addr":"172.21.15.26:6827","nonce":4176189153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":4176189153},{"type":"v1","addr":"172.21.15.26:6829","nonce":4176189153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":4176189153},{"type":"v1","addr":"172.21.15.26:6833","nonce":4176189153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":4176189153},{"type":"v1","addr":"172.21.15.26:6831","nonce":4176189153}]},"public_addr":"172.21.15.26:6827/4176189153","cluster_addr":"172.21.15.26:6829/4176189153","heartbeat_back_addr":"172.21.15.26:6833/4176189153","heartbeat_front_addr":"172.21.15.26:6831/4176189153","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.923722+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.404043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.275202+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.434925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.159606+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.379036+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.196000+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.387333+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T07:29:43.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.175+0000 7f6e11c8d640 1 -- 172.21.15.17:0/3090284444 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f6df806be80 msgr2=0x7f6df806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.175+0000 7f6e11c8d640 1 --2- 172.21.15.17:0/3090284444 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f6df806be80 0x7f6df806e340 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6e0002a2b0 tx=0x7f6e0002e000 comp rx=0 tx=0).stop 2024-09-05T07:29:43.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.175+0000 7f6e11c8d640 1 -- 172.21.15.17:0/3090284444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e0c0c5870 msgr2=0x7f6e0c1ef080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.175+0000 7f6e11c8d640 1 --2- 172.21.15.17:0/3090284444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e0c0c5870 0x7f6e0c1ef080 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc00c420 tx=0x7f6dfc001e70 comp rx=0 tx=0).stop 2024-09-05T07:29:43.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.176+0000 7f6e11c8d640 1 -- 172.21.15.17:0/3090284444 shutdown_connections 2024-09-05T07:29:43.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.176+0000 7f6e11c8d640 1 --2- 172.21.15.17:0/3090284444 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f6df806be80 0x7f6df806e340 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.176+0000 7f6e11c8d640 1 --2- 172.21.15.17:0/3090284444 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6e0c0c8eb0 0x7f6e0c0ae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.176+0000 7f6e11c8d640 1 --2- 172.21.15.17:0/3090284444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e0c0c78e0 0x7f6e0c0ac800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.176+0000 7f6e11c8d640 1 --2- 172.21.15.17:0/3090284444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6e0c0c5870 0x7f6e0c1ef080 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.176+0000 7f6e11c8d640 1 -- 172.21.15.17:0/3090284444 >> 172.21.15.17:0/3090284444 conn(0x7f6e0c0c9ae0 msgr2=0x7f6e0c0c30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:43.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.176+0000 7f6e11c8d640 1 -- 172.21.15.17:0/3090284444 shutdown_connections 2024-09-05T07:29:43.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.176+0000 7f6e11c8d640 1 -- 172.21.15.17:0/3090284444 wait complete. 2024-09-05T07:29:43.189 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-05T07:29:43.189 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-05T07:29:43.190 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-05T07:29:43.190 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-05T07:29:43.190 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-05T07:29:43.191 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-05T07:29:43.191 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-05T07:29:43.191 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-05T07:29:43.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.364+0000 7fe67ae4c640 1 Processor -- start 2024-09-05T07:29:43.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.364+0000 7fe67ae4c640 1 -- start start 2024-09-05T07:29:43.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.365+0000 7fe67ae4c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe6740b1220 0x7fe67406ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.365+0000 7fe67ae4c640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe6740c2400 0x7fe67406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.365+0000 7fe67ae4c640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe67415a020 con 0x7fe6740c6be0 2024-09-05T07:29:43.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.365+0000 7fe67ae4c640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fe67406efc0 con 0x7fe6740b1220 2024-09-05T07:29:43.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.365+0000 7fe67ae4c640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fe67415a2c0 con 0x7fe6740c2400 2024-09-05T07:29:43.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.368+0000 7fe673fff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe6740c2400 0x7fe67406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.368+0000 7fc3ad3e8640 1 Processor -- start 2024-09-05T07:29:43.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.368+0000 7fc3ad3e8640 1 -- start start 2024-09-05T07:29:43.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.369+0000 7fe6793e9640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe6740c6be0 0x7fe674156dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.17:44616/0 (socket says 172.21.15.17:44616) 2024-09-05T07:29:43.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.369+0000 7fe6793e9640 1 -- 172.21.15.17:0/3329148304 learned_addr learned my addr 172.21.15.17:0/3329148304 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:29:43.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.370+0000 7fe678be8640 1 --2- 172.21.15.17:0/3329148304 >> v2:172.21.15.17:3300/0 conn(0x7fe6740b1220 0x7fe67406ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.374+0000 7fe673fff640 1 -- 172.21.15.17:0/3329148304 >> v2:172.21.15.17:3300/0 conn(0x7fe6740b1220 msgr2=0x7fe67406ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:43.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.374+0000 7fe673fff640 1 --2- 172.21.15.17:0/3329148304 >> v2:172.21.15.17:3300/0 conn(0x7fe6740b1220 0x7fe67406ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.374+0000 7fe673fff640 1 -- 172.21.15.17:0/3329148304 >> v1:172.21.15.26:6789/0 conn(0x7fe6740c6be0 legacy=0x7fe674156dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.374+0000 7fe673fff640 1 -- 172.21.15.17:0/3329148304 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe67415a5a0 con 0x7fe6740c2400 2024-09-05T07:29:43.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.378+0000 7fe673fff640 1 --2- 172.21.15.17:0/3329148304 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe6740c2400 0x7fe67406bc10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe664009b10 tx=0x7fe66402bb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fef4234ca0a672ea server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.378+0000 7fc3ad3e8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc3a80cd0b0 0x7fc3a80cc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.378+0000 7fc3ad3e8640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc3a80cd490 0x7fc3a815f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.378+0000 7fc3ad3e8640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc3a80c53d0 0x7fc3a815f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.378+0000 7fc3ad3e8640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fc3a80b35e0 con 0x7fc3a80c53d0 2024-09-05T07:29:43.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.378+0000 7fc3ad3e8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fc3a80b38c0 con 0x7fc3a80cd0b0 2024-09-05T07:29:43.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.378+0000 7fc3ad3e8640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fc3a80b3ba0 con 0x7fc3a80cd490 2024-09-05T07:29:43.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.378+0000 7efee28b7640 1 Processor -- start 2024-09-05T07:29:43.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.378+0000 7efee28b7640 1 -- start start 2024-09-05T07:29:43.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.380+0000 7efee28b7640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efedc150db0 0x7efedc156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.380+0000 7efee28b7640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efedc0aece0 0x7efedc06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.380+0000 7efee28b7640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efedc06e790 con 0x7efedc071880 2024-09-05T07:29:43.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.380+0000 7efee28b7640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7efedc0aeb10 con 0x7efedc0aece0 2024-09-05T07:29:43.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.380+0000 7efee28b7640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7efedc156b40 con 0x7efedc150db0 2024-09-05T07:29:43.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.380+0000 7fc3a6ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc3a80cd0b0 0x7fc3a80cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.380+0000 7fe5a759e640 1 Processor -- start 2024-09-05T07:29:43.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.380+0000 7fe5a759e640 1 -- start start 2024-09-05T07:29:43.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.381+0000 7fc3a6ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc3a80cd0b0 0x7fc3a80cc510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:36054/0 (socket says 172.21.15.17:36054) 2024-09-05T07:29:43.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.381+0000 7fc3a6ffd640 1 -- 172.21.15.17:0/1848847727 learned_addr learned my addr 172.21.15.17:0/1848847727 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:43.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.381+0000 7fc3a77fe640 1 --2- 172.21.15.17:0/1848847727 >> v2:172.21.15.17:3300/0 conn(0x7fc3a80c53d0 0x7fc3a815f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.381+0000 7fc3a67fc640 1 --2- 172.21.15.17:0/1848847727 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc3a80cd490 0x7fc3a815f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.381+0000 7efedbfff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efedc150db0 0x7efedc156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.382+0000 7fe5a759e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe5a80b1f00 0x7fe5a81574b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.382+0000 7efedbfff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efedc150db0 0x7efedc156fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:59794/0 (socket says 172.21.15.17:59794) 2024-09-05T07:29:43.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.383+0000 7efedbfff640 1 -- 172.21.15.17:0/809754895 learned_addr learned my addr 172.21.15.17:0/809754895 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:43.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.382+0000 7fe5a759e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe5a80c9580 0x7fe5a80c6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.382+0000 7fe5a759e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5a806d360 con 0x7fe5a806dc50 2024-09-05T07:29:43.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.382+0000 7fe5a759e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fe5a806d640 con 0x7fe5a80c9580 2024-09-05T07:29:43.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.382+0000 7fe5a759e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fe5a806d920 con 0x7fe5a80b1f00 2024-09-05T07:29:43.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.383+0000 7fe6737fe640 1 -- 172.21.15.17:0/3329148304 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66402d8b0 con 0x7fe6740c2400 2024-09-05T07:29:43.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.383+0000 7fe6737fe640 1 -- 172.21.15.17:0/3329148304 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe66402da50 con 0x7fe6740c2400 2024-09-05T07:29:43.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.383+0000 7fe6737fe640 1 -- 172.21.15.17:0/3329148304 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66402de60 con 0x7fe6740c2400 2024-09-05T07:29:43.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.383+0000 7fc3a6ffd640 1 -- 172.21.15.17:0/1848847727 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc3a80cd490 msgr2=0x7fc3a815f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:43.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.383+0000 7fc3a6ffd640 1 --2- 172.21.15.17:0/1848847727 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc3a80cd490 0x7fc3a815f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.383+0000 7fc3a6ffd640 1 -- 172.21.15.17:0/1848847727 >> v2:172.21.15.17:3300/0 conn(0x7fc3a80c53d0 msgr2=0x7fc3a815f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:43.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.383+0000 7fc3a6ffd640 1 --2- 172.21.15.17:0/1848847727 >> v2:172.21.15.17:3300/0 conn(0x7fc3a80c53d0 0x7fc3a815f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.383+0000 7fc3a6ffd640 1 -- 172.21.15.17:0/1848847727 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3a80b3e80 con 0x7fc3a80cd0b0 2024-09-05T07:29:43.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.384+0000 7fe67ae4c640 1 -- 172.21.15.17:0/3329148304 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe6740c2400 msgr2=0x7fe67406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.384+0000 7fe67ae4c640 1 --2- 172.21.15.17:0/3329148304 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe6740c2400 0x7fe67406bc10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe664009b10 tx=0x7fe66402bb50 comp rx=0 tx=0).stop 2024-09-05T07:29:43.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.385+0000 7fe67ae4c640 1 -- 172.21.15.17:0/3329148304 shutdown_connections 2024-09-05T07:29:43.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.385+0000 7fe67ae4c640 1 --2- 172.21.15.17:0/3329148304 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe6740c2400 0x7fe67406bc10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.385+0000 7fe67ae4c640 1 --2- 172.21.15.17:0/3329148304 >> v2:172.21.15.17:3300/0 conn(0x7fe6740b1220 0x7fe67406ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.385+0000 7fe67ae4c640 1 -- 172.21.15.17:0/3329148304 >> 172.21.15.17:0/3329148304 conn(0x7fe6740cc1e0 msgr2=0x7fe6740cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:43.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.385+0000 7efedb7fe640 1 --2- 172.21.15.17:0/809754895 >> v2:172.21.15.26:3300/0 conn(0x7efedc0aece0 0x7efedc06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.385+0000 7fe67ae4c640 1 -- 172.21.15.17:0/3329148304 shutdown_connections 2024-09-05T07:29:43.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.385+0000 7fe5a659c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe5a80b1f00 0x7fe5a81574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.385+0000 7fe67ae4c640 1 -- 172.21.15.17:0/3329148304 wait complete. 2024-09-05T07:29:43.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.387+0000 7fe5a659c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe5a80b1f00 0x7fe5a81574b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:36068/0 (socket says 172.21.15.17:36068) 2024-09-05T07:29:43.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.387+0000 7fe5a659c640 1 -- 172.21.15.17:0/3073567821 learned_addr learned my addr 172.21.15.17:0/3073567821 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:43.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.387+0000 7fe67ae4c640 1 Processor -- start 2024-09-05T07:29:43.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.387+0000 7fe67ae4c640 1 -- start start 2024-09-05T07:29:43.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.388+0000 7fc3a6ffd640 1 --2- 172.21.15.17:0/1848847727 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a80cd0b0 0x7fc3a80cc510 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc3a806ca80 tx=0x7fc3a002a720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f75a60a93f9a7d5b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.389+0000 7fe67ae4c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6740b1220 0x7fe6740c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.389+0000 7fe67ae4c640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe6740c2400 0x7fe6740cb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.388+0000 7efedbfff640 1 -- 172.21.15.17:0/809754895 >> v2:172.21.15.26:3300/0 conn(0x7efedc0aece0 msgr2=0x7efedc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:43.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.388+0000 7efedbfff640 1 --2- 172.21.15.17:0/809754895 >> v2:172.21.15.26:3300/0 conn(0x7efedc0aece0 0x7efedc06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.389+0000 7fe67ae4c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6740c6be0 0x7fe6741f35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.388+0000 7efedbfff640 1 -- 172.21.15.17:0/809754895 >> v1:172.21.15.17:6789/0 conn(0x7efedc071880 legacy=0x7efedc0c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:43.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.388+0000 7efedbfff640 1 -- 172.21.15.17:0/809754895 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efedc06ea50 con 0x7efedc150db0 2024-09-05T07:29:43.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.389+0000 7fe67ae4c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe6740b1600 con 0x7fe6740c6be0 2024-09-05T07:29:43.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.389+0000 7fe67ae4c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe67415ab60 con 0x7fe6740b1220 2024-09-05T07:29:43.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.389+0000 7fe67ae4c640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fe6740b1780 con 0x7fe6740c2400 2024-09-05T07:29:43.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.390+0000 7fe673fff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe6740c2400 0x7fe6740cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.391+0000 7fe673fff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe6740c2400 0x7fe6740cb210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:59808/0 (socket says 172.21.15.17:59808) 2024-09-05T07:29:43.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.391+0000 7fe673fff640 1 -- 172.21.15.17:0/3413921702 learned_addr learned my addr 172.21.15.17:0/3413921702 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:43.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.392+0000 7efedbfff640 1 --2- 172.21.15.17:0/809754895 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efedc150db0 0x7efedc156fd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efecc009870 tx=0x7efecc02a2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55c263acc333b593 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.393+0000 7ff27d447640 1 Processor -- start 2024-09-05T07:29:43.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.393+0000 7f65fcb1f640 1 Processor -- start 2024-09-05T07:29:43.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.393+0000 7ff27d447640 1 -- start start 2024-09-05T07:29:43.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.393+0000 7f65fcb1f640 1 -- start start 2024-09-05T07:29:43.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.394+0000 7ff27d447640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff278073ee0 0x7ff27806f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.395+0000 7ff27d447640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff2780c8e40 0x7ff2781566e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.395+0000 7f65fcb1f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f65f00d65f0 0x7f65f004cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.395+0000 7ff27d447640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff278073070 con 0x7ff278073b00 2024-09-05T07:29:43.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.395+0000 7ff27d447640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7ff278073350 con 0x7ff278073ee0 2024-09-05T07:29:43.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.395+0000 7ff27d447640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7ff278073630 con 0x7ff2780c8e40 2024-09-05T07:29:43.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.395+0000 7f65fcb1f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f65f00dce90 0x7f65f0052010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.395+0000 7f65fcb1f640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f65f0052550 0x7f65f0047b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.395+0000 7f65fcb1f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f65f004d270 con 0x7f65f00dce90 2024-09-05T07:29:43.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.395+0000 7f65fcb1f640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f65f004d550 con 0x7f65f00d65f0 2024-09-05T07:29:43.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.395+0000 7f65fcb1f640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f65f004d830 con 0x7f65f0052550 2024-09-05T07:29:43.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.395+0000 7fe673fff640 1 -- 172.21.15.17:0/3413921702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6740b1220 msgr2=0x7fe6740c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.395+0000 7fe673fff640 1 --2- 172.21.15.17:0/3413921702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6740b1220 0x7fe6740c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.395+0000 7fe673fff640 1 -- 172.21.15.17:0/3413921702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6740c6be0 msgr2=0x7fe6741f35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.395+0000 7fe673fff640 1 --2- 172.21.15.17:0/3413921702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6740c6be0 0x7fe6741f35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.395+0000 7fe673fff640 1 -- 172.21.15.17:0/3413921702 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6740c9920 con 0x7fe6740c2400 2024-09-05T07:29:43.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.395+0000 7fafaf359640 1 Processor -- start 2024-09-05T07:29:43.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.396+0000 7fafaf359640 1 -- start start 2024-09-05T07:29:43.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.396+0000 7fe5a659c640 1 -- 172.21.15.17:0/3073567821 >> v2:172.21.15.17:3300/0 conn(0x7fe5a80c9580 msgr2=0x7fe5a80c6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:43.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.396+0000 7fe5a659c640 1 --2- 172.21.15.17:0/3073567821 >> v2:172.21.15.17:3300/0 conn(0x7fe5a80c9580 0x7fe5a80c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.396+0000 7fe5a659c640 1 -- 172.21.15.17:0/3073567821 >> v1:172.21.15.17:6789/0 conn(0x7fe5a806dc50 legacy=0x7fe5a80c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.396+0000 7fe5a659c640 1 -- 172.21.15.17:0/3073567821 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5a81569d0 con 0x7fe5a80b1f00 2024-09-05T07:29:43.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.397+0000 7fafaf359640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fafa8075650 0x7fafa8072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.397+0000 7fafaf359640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fafa80734e0 0x7fafa806f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.397+0000 7fafaf359640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafa815dcb0 con 0x7fafa81549c0 2024-09-05T07:29:43.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.397+0000 7fafaf359640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fafa806f1c0 con 0x7fafa80734e0 2024-09-05T07:29:43.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.397+0000 7fafaf359640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fafa815df50 con 0x7fafa8075650 2024-09-05T07:29:43.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.398+0000 7f65f77fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f65f00d65f0 0x7f65f004cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.398+0000 7f8e6f3b9640 1 Processor -- start 2024-09-05T07:29:43.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.398+0000 7f8e6f3b9640 1 -- start start 2024-09-05T07:29:43.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.399+0000 7f8e6f3b9640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8e68151ac0 0x7f8e680c8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.399+0000 7f8e6f3b9640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e6815bd10 con 0x7f8e680705b0 2024-09-05T07:29:43.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.399+0000 7f8e6f3b9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e6815aeb0 con 0x7f8e681516e0 2024-09-05T07:29:43.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.399+0000 7f8e6f3b9640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f8e680c5670 con 0x7f8e68151ac0 2024-09-05T07:29:43.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.400+0000 7fe5a659c640 1 --2- 172.21.15.17:0/3073567821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5a80b1f00 0x7fe5a81574b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8069a60 tx=0x7fe5a002a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4109541a12bce6d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.401+0000 7efedaffd640 1 -- 172.21.15.17:0/809754895 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efecc037070 con 0x7efedc150db0 2024-09-05T07:29:43.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.401+0000 7f65f77fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f65f00d65f0 0x7f65f004cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:36080/0 (socket says 172.21.15.17:36080) 2024-09-05T07:29:43.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.401+0000 7f65f77fe640 1 -- 172.21.15.17:0/2794658886 learned_addr learned my addr 172.21.15.17:0/2794658886 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:43.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.401+0000 7efedaffd640 1 -- 172.21.15.17:0/809754895 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efecc032440 con 0x7efedc150db0 2024-09-05T07:29:43.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.401+0000 7fe673fff640 1 --2- 172.21.15.17:0/3413921702 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe6740c2400 0x7fe6740cb210 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe664009c00 tx=0x7fe664004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.401+0000 7efedaffd640 1 -- 172.21.15.17:0/809754895 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efecc032850 con 0x7efedc150db0 2024-09-05T07:29:43.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.403+0000 7efee28b7640 1 -- 172.21.15.17:0/809754895 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efedc150db0 msgr2=0x7efedc156fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.403+0000 7efee28b7640 1 --2- 172.21.15.17:0/809754895 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efedc150db0 0x7efedc156fd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efecc009870 tx=0x7efecc02a2c0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.403+0000 7efee28b7640 1 -- 172.21.15.17:0/809754895 shutdown_connections 2024-09-05T07:29:43.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.403+0000 7efee28b7640 1 --2- 172.21.15.17:0/809754895 >> v2:172.21.15.26:3300/0 conn(0x7efedc0aece0 0x7efedc06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.403+0000 7efee28b7640 1 --2- 172.21.15.17:0/809754895 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efedc150db0 0x7efedc156fd0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.403+0000 7efee28b7640 1 -- 172.21.15.17:0/809754895 >> 172.21.15.17:0/809754895 conn(0x7efedc0cc1e0 msgr2=0x7efedc0cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:43.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.403+0000 7efee28b7640 1 -- 172.21.15.17:0/809754895 shutdown_connections 2024-09-05T07:29:43.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.403+0000 7efee28b7640 1 -- 172.21.15.17:0/809754895 wait complete. 2024-09-05T07:29:43.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.403+0000 7ff26ffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff278073ee0 0x7ff27806f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.403+0000 7efee28b7640 1 Processor -- start 2024-09-05T07:29:43.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.403+0000 7ff26ffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff278073ee0 0x7ff27806f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60494/0 (socket says 172.21.15.17:60494) 2024-09-05T07:29:43.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.403+0000 7ff26ffff640 1 -- 172.21.15.17:0/591272241 learned_addr learned my addr 172.21.15.17:0/591272241 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:43.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.403+0000 7efee28b7640 1 -- start start 2024-09-05T07:29:43.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.404+0000 7efee28b7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efedc071880 0x7efedc0cb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.404+0000 7efee28b7640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efedc0aece0 0x7efedc165bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.404+0000 7efee28b7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efedc150db0 0x7efedc1f87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.404+0000 7efee28b7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efedc0ae790 con 0x7efedc071880 2024-09-05T07:29:43.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.404+0000 7efee28b7640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7efedc15ab20 con 0x7efedc150db0 2024-09-05T07:29:43.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.404+0000 7efee28b7640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7efedc0c8700 con 0x7efedc0aece0 2024-09-05T07:29:43.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.407+0000 7ff2777fe640 1 --2- 172.21.15.17:0/591272241 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff2780c8e40 0x7ff2781566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.407+0000 7ff26ffff640 1 -- 172.21.15.17:0/591272241 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff2780c8e40 msgr2=0x7ff2781566e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:43.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.407+0000 7ff26ffff640 1 --2- 172.21.15.17:0/591272241 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff2780c8e40 0x7ff2781566e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.407+0000 7ff26ffff640 1 -- 172.21.15.17:0/591272241 >> v1:172.21.15.26:6789/0 conn(0x7ff278073b00 legacy=0x7ff27815ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:43.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.407+0000 7ff26ffff640 1 -- 172.21.15.17:0/591272241 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2780c8380 con 0x7ff278073ee0 2024-09-05T07:29:43.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.407+0000 7f65fdd81640 1 --2- 172.21.15.17:0/2794658886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f65f0052550 0x7f65f0047b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.408+0000 7efedb7fe640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efedc0aece0 0x7efedc165bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.409+0000 7f65f77fe640 1 -- 172.21.15.17:0/2794658886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f65f0052550 msgr2=0x7f65f0047b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:43.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.409+0000 7f65f77fe640 1 --2- 172.21.15.17:0/2794658886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f65f0052550 0x7f65f0047b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.409+0000 7f65f77fe640 1 -- 172.21.15.17:0/2794658886 >> v2:172.21.15.17:3300/0 conn(0x7f65f00dce90 msgr2=0x7f65f0052010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:43.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.409+0000 7f65f77fe640 1 --2- 172.21.15.17:0/2794658886 >> v2:172.21.15.17:3300/0 conn(0x7f65f00dce90 0x7f65f0052010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.409+0000 7f65f77fe640 1 -- 172.21.15.17:0/2794658886 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f004db10 con 0x7f65f00d65f0 2024-09-05T07:29:43.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.409+0000 7ff26ffff640 1 --2- 172.21.15.17:0/591272241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff278073ee0 0x7ff27806f780 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff260009870 tx=0x7ff26002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ce6f120e86228d server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.410+0000 7efedb7fe640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efedc0aece0 0x7efedc165bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:59832/0 (socket says 172.21.15.17:59832) 2024-09-05T07:29:43.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.410+0000 7efedb7fe640 1 -- 172.21.15.17:0/3869439914 learned_addr learned my addr 172.21.15.17:0/3869439914 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:43.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.411+0000 7f8e6d956640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f8e680705b0 0x7f8e680c5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42160/0 (socket says 172.21.15.17:42160) 2024-09-05T07:29:43.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.411+0000 7f8e6d956640 1 -- 172.21.15.17:0/684444387 learned_addr learned my addr 172.21.15.17:0/684444387 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:29:43.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.413+0000 7fc3a5ffb640 1 -- 172.21.15.17:0/1848847727 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0036070 con 0x7fc3a80cd0b0 2024-09-05T07:29:43.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.413+0000 7fc3a5ffb640 1 -- 172.21.15.17:0/1848847727 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3a0031600 con 0x7fc3a80cd0b0 2024-09-05T07:29:43.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.413+0000 7fc3a5ffb640 1 -- 172.21.15.17:0/1848847727 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a00319d0 con 0x7fc3a80cd0b0 2024-09-05T07:29:43.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.414+0000 7fc3ad3e8640 1 -- 172.21.15.17:0/1848847727 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a80cd0b0 msgr2=0x7fc3a80cc510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.414+0000 7fc3ad3e8640 1 --2- 172.21.15.17:0/1848847727 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a80cd0b0 0x7fc3a80cc510 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc3a806ca80 tx=0x7fc3a002a720 comp rx=0 tx=0).stop 2024-09-05T07:29:43.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.414+0000 7fc3ad3e8640 1 -- 172.21.15.17:0/1848847727 shutdown_connections 2024-09-05T07:29:43.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.414+0000 7fc3ad3e8640 1 --2- 172.21.15.17:0/1848847727 >> v2:172.21.15.17:3300/0 conn(0x7fc3a80c53d0 0x7fc3a815f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.414+0000 7fc3ad3e8640 1 --2- 172.21.15.17:0/1848847727 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc3a80cd490 0x7fc3a815f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.414+0000 7fc3ad3e8640 1 --2- 172.21.15.17:0/1848847727 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a80cd0b0 0x7fc3a80cc510 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.414+0000 7fc3ad3e8640 1 -- 172.21.15.17:0/1848847727 >> 172.21.15.17:0/1848847727 conn(0x7fc3a806bc10 msgr2=0x7fc3a806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:43.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.414+0000 7fc3ad3e8640 1 -- 172.21.15.17:0/1848847727 shutdown_connections 2024-09-05T07:29:43.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.414+0000 7fc3ad3e8640 1 -- 172.21.15.17:0/1848847727 wait complete. 2024-09-05T07:29:43.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.414+0000 7f65f77fe640 1 --2- 172.21.15.17:0/2794658886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f00d65f0 0x7f65f004cc00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f65f000fb90 tx=0x7f65ec02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ac7662c06eccc4f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.416+0000 7fc3ad3e8640 1 Processor -- start 2024-09-05T07:29:43.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.416+0000 7fc3ad3e8640 1 -- start start 2024-09-05T07:29:43.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.416+0000 7efedb7fe640 1 -- 172.21.15.17:0/3869439914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efedc150db0 msgr2=0x7efedc1f87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.416+0000 7efedb7fe640 1 --2- 172.21.15.17:0/3869439914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efedc150db0 0x7efedc1f87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.416+0000 7efedb7fe640 1 -- 172.21.15.17:0/3869439914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efedc071880 msgr2=0x7efedc0cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.416+0000 7efedb7fe640 1 --2- 172.21.15.17:0/3869439914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efedc071880 0x7efedc0cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.416+0000 7efedb7fe640 1 -- 172.21.15.17:0/3869439914 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efedc0cbac0 con 0x7efedc0aece0 2024-09-05T07:29:43.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.416+0000 7fc3ad3e8640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc3a80c53d0 0x7fc3a81f8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.416+0000 7fc3ad3e8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a80cd0b0 0x7fc3a81f5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.416+0000 7fc3ad3e8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3a80cd490 0x7fc3a815acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.416+0000 7fc3ad3e8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a80cca50 con 0x7fc3a80cd490 2024-09-05T07:29:43.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.416+0000 7fc3ad3e8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a815ec70 con 0x7fc3a80cd0b0 2024-09-05T07:29:43.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.416+0000 7fc3ad3e8640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fc3a80ccbd0 con 0x7fc3a80c53d0 2024-09-05T07:29:43.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.417+0000 7fe6717fa640 1 -- 172.21.15.17:0/3413921702 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66402ebd0 con 0x7fe6740c2400 2024-09-05T07:29:43.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.417+0000 7fe6717fa640 1 -- 172.21.15.17:0/3413921702 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe66402ed90 con 0x7fe6740c2400 2024-09-05T07:29:43.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.417+0000 7fe67ae4c640 1 -- 172.21.15.17:0/3413921702 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe674156550 con 0x7fe6740c2400 2024-09-05T07:29:43.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.417+0000 7fe67ae4c640 1 -- 172.21.15.17:0/3413921702 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe674071990 con 0x7fe6740c2400 2024-09-05T07:29:43.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.417+0000 7fe6717fa640 1 -- 172.21.15.17:0/3413921702 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe664041650 con 0x7fe6740c2400 2024-09-05T07:29:43.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.418+0000 7efedb7fe640 1 --2- 172.21.15.17:0/3869439914 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efedc0aece0 0x7efedc165bf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efed000e980 tx=0x7efed000ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.418+0000 7fe67ae4c640 1 -- 172.21.15.17:0/3413921702 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe6740c8fc0 con 0x7fe6740c2400 2024-09-05T07:29:43.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.418+0000 7fafac8f4640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fafa8075650 0x7fafa8072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.419+0000 7fafac8f4640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fafa8075650 0x7fafa8072fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:59824/0 (socket says 172.21.15.17:59824) 2024-09-05T07:29:43.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.419+0000 7fafac8f4640 1 -- 172.21.15.17:0/2125730718 learned_addr learned my addr 172.21.15.17:0/2125730718 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:43.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.422+0000 7fafac8f4640 1 -- 172.21.15.17:0/2125730718 >> v2:172.21.15.26:3300/0 conn(0x7fafa80734e0 msgr2=0x7fafa806f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:43.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.422+0000 7fafac8f4640 1 --2- 172.21.15.17:0/2125730718 >> v2:172.21.15.26:3300/0 conn(0x7fafa80734e0 0x7fafa806f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.422+0000 7fafac8f4640 1 -- 172.21.15.17:0/2125730718 >> v1:172.21.15.26:6789/0 conn(0x7fafa81549c0 legacy=0x7fafa8071d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:43.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.422+0000 7fafac8f4640 1 -- 172.21.15.17:0/2125730718 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafa815e210 con 0x7fafa8075650 2024-09-05T07:29:43.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.426+0000 7efed8ff9640 1 -- 172.21.15.17:0/3869439914 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed0017070 con 0x7efedc0aece0 2024-09-05T07:29:43.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.426+0000 7efed8ff9640 1 -- 172.21.15.17:0/3869439914 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efed000ca00 con 0x7efedc0aece0 2024-09-05T07:29:43.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.426+0000 7efee28b7640 1 -- 172.21.15.17:0/3869439914 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efedc073f60 con 0x7efedc0aece0 2024-09-05T07:29:43.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.426+0000 7efed8ff9640 1 -- 172.21.15.17:0/3869439914 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed000cdd0 con 0x7efedc0aece0 2024-09-05T07:29:43.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.427+0000 7efee28b7640 1 -- 172.21.15.17:0/3869439914 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efedc157d50 con 0x7efedc0aece0 2024-09-05T07:29:43.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.427+0000 7efee28b7640 1 -- 172.21.15.17:0/3869439914 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efedc156fd0 con 0x7efedc0aece0 2024-09-05T07:29:43.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.439+0000 7fc3a6ffd640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc3a80c53d0 0x7fc3a81f8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.440+0000 7fc3a6ffd640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc3a80c53d0 0x7fc3a81f8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:59842/0 (socket says 172.21.15.17:59842) 2024-09-05T07:29:43.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.440+0000 7fc3a6ffd640 1 -- 172.21.15.17:0/247626344 learned_addr learned my addr 172.21.15.17:0/247626344 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:43.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.453+0000 7efed8ff9640 1 -- 172.21.15.17:0/3869439914 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efed001a070 con 0x7efedc0aece0 2024-09-05T07:29:43.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.453+0000 7efed8ff9640 1 --2- 172.21.15.17:0/3869439914 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7efec806be30 0x7efec806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.454+0000 7efedbfff640 1 --2- 172.21.15.17:0/3869439914 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7efec806be30 0x7efec806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.454+0000 7efedbfff640 1 --2- 172.21.15.17:0/3869439914 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7efec806be30 0x7efec806e2f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efecc034000 tx=0x7efecc02c000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.459+0000 7f8e6c954640 1 --2- 172.21.15.17:0/684444387 >> v2:172.21.15.17:3300/0 conn(0x7f8e68151ac0 0x7f8e680c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.459+0000 7efed8ff9640 1 -- 172.21.15.17:0/3869439914 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7efed00575f0 con 0x7efedc0aece0 2024-09-05T07:29:43.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.460+0000 7efed8ff9640 1 --2- 172.21.15.17:0/3869439914 >> [v2:172.21.15.26:6802/3740556509,v1:172.21.15.26:6803/3740556509] conn(0x7efec8074030 0x7efec8076450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.460+0000 7efed8ff9640 1 -- 172.21.15.17:0/3869439914 --> [v2:172.21.15.26:6802/3740556509,v1:172.21.15.26:6803/3740556509] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efed0022e50 con 0x7efec8074030 2024-09-05T07:29:43.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.460+0000 7efee0e54640 1 --2- 172.21.15.17:0/3869439914 >> [v2:172.21.15.26:6802/3740556509,v1:172.21.15.26:6803/3740556509] conn(0x7efec8074030 0x7efec8076450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.460+0000 7efee0e54640 1 --2- 172.21.15.17:0/3869439914 >> [v2:172.21.15.26:6802/3740556509,v1:172.21.15.26:6803/3740556509] conn(0x7efec8074030 0x7efec8076450 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.461+0000 7efed8ff9640 1 -- 172.21.15.17:0/3869439914 <== osd.4 v2:172.21.15.26:6802/3740556509 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efed0022e50 con 0x7efec8074030 2024-09-05T07:29:43.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.463+0000 7fc3a6ffd640 1 -- 172.21.15.17:0/247626344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a80cd0b0 msgr2=0x7fc3a81f5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.463+0000 7fc3a6ffd640 1 --2- 172.21.15.17:0/247626344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3a80cd0b0 0x7fc3a81f5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.463+0000 7fc3a6ffd640 1 -- 172.21.15.17:0/247626344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3a80cd490 msgr2=0x7fc3a815acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.463+0000 7fc3a6ffd640 1 --2- 172.21.15.17:0/247626344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3a80cd490 0x7fc3a815acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.463+0000 7fc3a6ffd640 1 -- 172.21.15.17:0/247626344 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3a80cf830 con 0x7fc3a80c53d0 2024-09-05T07:29:43.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.469+0000 7fafac8f4640 1 --2- 172.21.15.17:0/2125730718 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fafa8075650 0x7fafa8072fa0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fafa815de80 tx=0x7faf9802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a888d8f03e943f70 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.472+0000 7fc3a6ffd640 1 --2- 172.21.15.17:0/247626344 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc3a80c53d0 0x7fc3a81f8880 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0034040 tx=0x7fc3a0004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.476+0000 7efee28b7640 1 -- 172.21.15.17:0/3869439914 --> [v2:172.21.15.26:6802/3740556509,v1:172.21.15.26:6803/3740556509] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efedc163e60 con 0x7efec8074030 2024-09-05T07:29:43.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.476+0000 7efed8ff9640 1 -- 172.21.15.17:0/3869439914 <== osd.4 v2:172.21.15.26:6802/3740556509 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7efedc163e60 con 0x7efec8074030 2024-09-05T07:29:43.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.477+0000 7efee28b7640 1 -- 172.21.15.17:0/3869439914 >> [v2:172.21.15.26:6802/3740556509,v1:172.21.15.26:6803/3740556509] conn(0x7efec8074030 msgr2=0x7efec8076450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.477+0000 7efee28b7640 1 --2- 172.21.15.17:0/3869439914 >> [v2:172.21.15.26:6802/3740556509,v1:172.21.15.26:6803/3740556509] conn(0x7efec8074030 0x7efec8076450 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.477+0000 7efee28b7640 1 -- 172.21.15.17:0/3869439914 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7efec806be30 msgr2=0x7efec806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.477+0000 7efee28b7640 1 --2- 172.21.15.17:0/3869439914 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7efec806be30 0x7efec806e2f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efecc034000 tx=0x7efecc02c000 comp rx=0 tx=0).stop 2024-09-05T07:29:43.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.477+0000 7efee28b7640 1 -- 172.21.15.17:0/3869439914 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efedc0aece0 msgr2=0x7efedc165bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.477+0000 7efee28b7640 1 --2- 172.21.15.17:0/3869439914 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efedc0aece0 0x7efedc165bf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efed000e980 tx=0x7efed000ee40 comp rx=0 tx=0).stop 2024-09-05T07:29:43.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.477+0000 7efee0e54640 1 -- 172.21.15.17:0/3869439914 reap_dead start 2024-09-05T07:29:43.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.477+0000 7fe5a559a640 1 -- 172.21.15.17:0/3073567821 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a0036070 con 0x7fe5a80b1f00 2024-09-05T07:29:43.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.477+0000 7efee28b7640 1 -- 172.21.15.17:0/3869439914 shutdown_connections 2024-09-05T07:29:43.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.477+0000 7efee28b7640 1 -- 172.21.15.17:0/3869439914 >> 172.21.15.17:0/3869439914 conn(0x7efedc0cc1e0 msgr2=0x7efedc0c9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:43.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.477+0000 7fe5a559a640 1 -- 172.21.15.17:0/3073567821 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5a0031600 con 0x7fe5a80b1f00 2024-09-05T07:29:43.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.477+0000 7fe5a559a640 1 -- 172.21.15.17:0/3073567821 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a00319d0 con 0x7fe5a80b1f00 2024-09-05T07:29:43.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.477+0000 7efee28b7640 1 -- 172.21.15.17:0/3869439914 shutdown_connections 2024-09-05T07:29:43.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.477+0000 7efee28b7640 1 -- 172.21.15.17:0/3869439914 wait complete. 2024-09-05T07:29:43.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.478+0000 7fe5a759e640 1 -- 172.21.15.17:0/3073567821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5a80b1f00 msgr2=0x7fe5a81574b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.478+0000 7fe5a759e640 1 --2- 172.21.15.17:0/3073567821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5a80b1f00 0x7fe5a81574b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8069a60 tx=0x7fe5a002a730 comp rx=0 tx=0).stop 2024-09-05T07:29:43.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.478+0000 7fe5a759e640 1 -- 172.21.15.17:0/3073567821 shutdown_connections 2024-09-05T07:29:43.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.478+0000 7fe5a759e640 1 --2- 172.21.15.17:0/3073567821 >> v2:172.21.15.17:3300/0 conn(0x7fe5a80c9580 0x7fe5a80c6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.478+0000 7fe5a759e640 1 --2- 172.21.15.17:0/3073567821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5a80b1f00 0x7fe5a81574b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.478+0000 7fe5a759e640 1 -- 172.21.15.17:0/3073567821 >> 172.21.15.17:0/3073567821 conn(0x7fe5a80c8a60 msgr2=0x7fe5a80c8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:43.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.478+0000 7fe5a759e640 1 -- 172.21.15.17:0/3073567821 shutdown_connections 2024-09-05T07:29:43.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.478+0000 7fe5a759e640 1 -- 172.21.15.17:0/3073567821 wait complete. 2024-09-05T07:29:43.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.479+0000 7fe5a759e640 1 Processor -- start 2024-09-05T07:29:43.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.479+0000 7fe5a759e640 1 -- start start 2024-09-05T07:29:43.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.480+0000 7fe5a759e640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe5a806dc50 0x7fe5a80caff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.480+0000 7fe5a759e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5a80b1f00 0x7fe5a80cb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.480+0000 7fe5a759e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5a80c9580 0x7fe5a814a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.480+0000 7fe5a759e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a806cbf0 con 0x7fe5a80b1f00 2024-09-05T07:29:43.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.480+0000 7fe5a759e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a8156f90 con 0x7fe5a80c9580 2024-09-05T07:29:43.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.480+0000 7fe5a759e640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fe5a806cd70 con 0x7fe5a806dc50 2024-09-05T07:29:43.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.484+0000 7ff2767fc640 1 -- 172.21.15.17:0/591272241 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff260037070 con 0x7ff278073ee0 2024-09-05T07:29:43.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.486+0000 7f65f67fc640 1 -- 172.21.15.17:0/2794658886 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec004030 con 0x7f65f00d65f0 2024-09-05T07:29:43.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.486+0000 7f65f67fc640 1 -- 172.21.15.17:0/2794658886 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65ec0041d0 con 0x7f65f00d65f0 2024-09-05T07:29:43.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.486+0000 7f65f67fc640 1 -- 172.21.15.17:0/2794658886 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec003610 con 0x7f65f00d65f0 2024-09-05T07:29:43.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.486+0000 7f65fcb1f640 1 -- 172.21.15.17:0/2794658886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f00d65f0 msgr2=0x7f65f004cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.486+0000 7f65fcb1f640 1 --2- 172.21.15.17:0/2794658886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f00d65f0 0x7f65f004cc00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f65f000fb90 tx=0x7f65ec02a1c0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.487+0000 7f65fcb1f640 1 -- 172.21.15.17:0/2794658886 shutdown_connections 2024-09-05T07:29:43.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.487+0000 7f65fcb1f640 1 --2- 172.21.15.17:0/2794658886 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f65f0052550 0x7f65f0047b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.487+0000 7f65fcb1f640 1 --2- 172.21.15.17:0/2794658886 >> v2:172.21.15.17:3300/0 conn(0x7f65f00dce90 0x7f65f0052010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.487+0000 7f65fcb1f640 1 --2- 172.21.15.17:0/2794658886 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f00d65f0 0x7f65f004cc00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.487+0000 7f65fcb1f640 1 -- 172.21.15.17:0/2794658886 >> 172.21.15.17:0/2794658886 conn(0x7f65f0009b60 msgr2=0x7f65f0009f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:43.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.487+0000 7f65fcb1f640 1 -- 172.21.15.17:0/2794658886 shutdown_connections 2024-09-05T07:29:43.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.487+0000 7f65fcb1f640 1 -- 172.21.15.17:0/2794658886 wait complete. 2024-09-05T07:29:43.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.488+0000 7f65fcb1f640 1 Processor -- start 2024-09-05T07:29:43.490 INFO:teuthology.orchestra.run.smithi017.stdout:60129542154 2024-09-05T07:29:43.491 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-05T07:29:43.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.488+0000 7f65fcb1f640 1 -- start start 2024-09-05T07:29:43.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.489+0000 7f65fcb1f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65f0052550 0x7f65f00512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.489+0000 7f65fcb1f640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f65f00d65f0 0x7f65f00cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.489+0000 7f65fcb1f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f00dce90 0x7f65f00cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.489+0000 7f65fcb1f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f65f00dd2c0 con 0x7f65f0052550 2024-09-05T07:29:43.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.489+0000 7f65fcb1f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f65f00475e0 con 0x7f65f00dce90 2024-09-05T07:29:43.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.489+0000 7f65fcb1f640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f65f00d69d0 con 0x7f65f00d65f0 2024-09-05T07:29:43.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.490+0000 7fe5a6d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5a80c9580 0x7fe5a814a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.491+0000 7fe5a6d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5a80c9580 0x7fe5a814a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:36124/0 (socket says 172.21.15.17:36124) 2024-09-05T07:29:43.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.491+0000 7fe5a6d9d640 1 -- 172.21.15.17:0/1353233904 learned_addr learned my addr 172.21.15.17:0/1353233904 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:43.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.492+0000 7f8e5ffff640 1 -- 172.21.15.17:0/684444387 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4021304798 0 0) 0x7f8e6815bd10 con 0x7f8e680705b0 2024-09-05T07:29:43.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.492+0000 7f8e5ffff640 1 -- 172.21.15.17:0/684444387 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e54003520 con 0x7f8e680705b0 2024-09-05T07:29:43.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.493+0000 7ff2767fc640 1 -- 172.21.15.17:0/591272241 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff260032440 con 0x7ff278073ee0 2024-09-05T07:29:43.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.493+0000 7ff2767fc640 1 -- 172.21.15.17:0/591272241 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff260032810 con 0x7ff278073ee0 2024-09-05T07:29:43.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.494+0000 7ff27d447640 1 -- 172.21.15.17:0/591272241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff278073ee0 msgr2=0x7ff27806f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.494+0000 7ff27d447640 1 --2- 172.21.15.17:0/591272241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff278073ee0 0x7ff27806f780 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff260009870 tx=0x7ff26002a180 comp rx=0 tx=0).stop 2024-09-05T07:29:43.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.494+0000 7ff27d447640 1 -- 172.21.15.17:0/591272241 shutdown_connections 2024-09-05T07:29:43.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.494+0000 7ff27d447640 1 --2- 172.21.15.17:0/591272241 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff2780c8e40 0x7ff2781566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.494+0000 7ff27d447640 1 --2- 172.21.15.17:0/591272241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff278073ee0 0x7ff27806f780 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.494+0000 7ff27d447640 1 -- 172.21.15.17:0/591272241 >> 172.21.15.17:0/591272241 conn(0x7ff2780cd260 msgr2=0x7ff2780cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:43.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.494+0000 7ff27d447640 1 -- 172.21.15.17:0/591272241 shutdown_connections 2024-09-05T07:29:43.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.494+0000 7ff27d447640 1 -- 172.21.15.17:0/591272241 wait complete. 2024-09-05T07:29:43.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.495+0000 7ff27d447640 1 Processor -- start 2024-09-05T07:29:43.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.495+0000 7ff27d447640 1 -- start start 2024-09-05T07:29:43.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.496+0000 7ff27d447640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff278073b00 0x7ff2780c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.496+0000 7ff27d447640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff278073ee0 0x7ff2781f0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.496+0000 7ff27d447640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff2780c8e40 0x7ff2780aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.496+0000 7ff27d447640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff27806fcc0 con 0x7ff278073ee0 2024-09-05T07:29:43.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.496+0000 7ff27d447640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ff2780c8940 con 0x7ff278073b00 2024-09-05T07:29:43.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.496+0000 7ff27d447640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7ff27806fe40 con 0x7ff2780c8e40 2024-09-05T07:29:43.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.498+0000 7fe5a6d9d640 1 -- 172.21.15.17:0/1353233904 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe5a806dc50 msgr2=0x7fe5a80caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.498+0000 7fe5a6d9d640 1 --2- 172.21.15.17:0/1353233904 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe5a806dc50 0x7fe5a80caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.498+0000 7fe5a6d9d640 1 -- 172.21.15.17:0/1353233904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5a80b1f00 msgr2=0x7fe5a80cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.498+0000 7fe5a6d9d640 1 --2- 172.21.15.17:0/1353233904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5a80b1f00 0x7fe5a80cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.498+0000 7fe5a6d9d640 1 -- 172.21.15.17:0/1353233904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5a8073d60 con 0x7fe5a80c9580 2024-09-05T07:29:43.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.503+0000 7f8e6c954640 1 -- 172.21.15.17:0/684444387 >> v1:172.21.15.26:6789/0 conn(0x7f8e681516e0 legacy=0x7f8e680c3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.503+0000 7f8e6c954640 1 -- 172.21.15.17:0/684444387 >> v1:172.21.15.17:6789/0 conn(0x7f8e680705b0 legacy=0x7f8e680c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.503+0000 7f8e6c954640 1 -- 172.21.15.17:0/684444387 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e6815b190 con 0x7f8e68151ac0 2024-09-05T07:29:43.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.507+0000 7fe5a6d9d640 1 --2- 172.21.15.17:0/1353233904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5a80c9580 0x7fe5a814a080 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00c3f0 tx=0x7fe59c00c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.508+0000 7f65fdd81640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f00dce90 0x7f65f00cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.508+0000 7f65fdd81640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f00dce90 0x7f65f00cc0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:36126/0 (socket says 172.21.15.17:36126) 2024-09-05T07:29:43.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.509+0000 7f65fdd81640 1 -- 172.21.15.17:0/736910624 learned_addr learned my addr 172.21.15.17:0/736910624 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:43.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.516+0000 7ff26ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff278073ee0 0x7ff2781f0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.516+0000 7fe596ffd640 1 -- 172.21.15.17:0/1353233904 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59c0052d0 con 0x7fe5a80c9580 2024-09-05T07:29:43.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.517+0000 7fe596ffd640 1 -- 172.21.15.17:0/1353233904 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe59c005470 con 0x7fe5a80c9580 2024-09-05T07:29:43.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.517+0000 7fe596ffd640 1 -- 172.21.15.17:0/1353233904 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59c007260 con 0x7fe5a80c9580 2024-09-05T07:29:43.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.517+0000 7fe5a759e640 1 -- 172.21.15.17:0/1353233904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5a8144060 con 0x7fe5a80c9580 2024-09-05T07:29:43.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.517+0000 7fe5a759e640 1 -- 172.21.15.17:0/1353233904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5a80c37e0 con 0x7fe5a80c9580 2024-09-05T07:29:43.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.517+0000 7ff26ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff278073ee0 0x7ff2781f0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60582/0 (socket says 172.21.15.17:60582) 2024-09-05T07:29:43.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.517+0000 7ff26ffff640 1 -- 172.21.15.17:0/3408721903 learned_addr learned my addr 172.21.15.17:0/3408721903 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:43.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.518+0000 7fe5a759e640 1 -- 172.21.15.17:0/1353233904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe5a80c39e0 con 0x7fe5a80c9580 2024-09-05T07:29:43.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.518+0000 7f8e6c954640 1 --2- 172.21.15.17:0/684444387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e68151ac0 0x7f8e680c8340 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8e580097a0 tx=0x7f8e5802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7085043017998189 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.519+0000 7f65fdd81640 1 -- 172.21.15.17:0/736910624 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f65f00d65f0 msgr2=0x7f65f00cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.520+0000 7f65fdd81640 1 --2- 172.21.15.17:0/736910624 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f65f00d65f0 0x7f65f00cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.520+0000 7f65fdd81640 1 -- 172.21.15.17:0/736910624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65f0052550 msgr2=0x7f65f00512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.520+0000 7f65fdd81640 1 --2- 172.21.15.17:0/736910624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65f0052550 0x7f65f00512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.520+0000 7f65fdd81640 1 -- 172.21.15.17:0/736910624 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f0037e10 con 0x7f65f00dce90 2024-09-05T07:29:43.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.523+0000 7ff26ffff640 1 -- 172.21.15.17:0/3408721903 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff2780c8e40 msgr2=0x7ff2780aeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.523+0000 7ff26ffff640 1 --2- 172.21.15.17:0/3408721903 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff2780c8e40 0x7ff2780aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.523+0000 7ff26ffff640 1 -- 172.21.15.17:0/3408721903 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff278073b00 msgr2=0x7ff2780c4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.523+0000 7ff26ffff640 1 --2- 172.21.15.17:0/3408721903 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff278073b00 0x7ff2780c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.523+0000 7ff26ffff640 1 -- 172.21.15.17:0/3408721903 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff278150bf0 con 0x7ff278073ee0 2024-09-05T07:29:43.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.531+0000 7f65fdd81640 1 --2- 172.21.15.17:0/736910624 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f00dce90 0x7f65f00cc0b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f65f8051790 tx=0x7f65f8069810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.534+0000 7ff26ffff640 1 --2- 172.21.15.17:0/3408721903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff278073ee0 0x7ff2781f0360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff260000c00 tx=0x7ff2600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.535+0000 7f8e5ffff640 1 -- 172.21.15.17:0/684444387 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e58037070 con 0x7f8e68151ac0 2024-09-05T07:29:43.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.535+0000 7f8e5ffff640 1 -- 172.21.15.17:0/684444387 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e58032440 con 0x7f8e68151ac0 2024-09-05T07:29:43.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.535+0000 7f8e5ffff640 1 -- 172.21.15.17:0/684444387 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e58032810 con 0x7f8e68151ac0 2024-09-05T07:29:43.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.535+0000 7f8e6f3b9640 1 -- 172.21.15.17:0/684444387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e68151ac0 msgr2=0x7f8e680c8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.535+0000 7f8e6f3b9640 1 --2- 172.21.15.17:0/684444387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e68151ac0 0x7f8e680c8340 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8e580097a0 tx=0x7f8e5802a230 comp rx=0 tx=0).stop 2024-09-05T07:29:43.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.535+0000 7f65e3fff640 1 -- 172.21.15.17:0/736910624 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f80763c0 con 0x7f65f00dce90 2024-09-05T07:29:43.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.535+0000 7f65e3fff640 1 -- 172.21.15.17:0/736910624 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65f80736b0 con 0x7f65f00dce90 2024-09-05T07:29:43.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.535+0000 7f65e3fff640 1 -- 172.21.15.17:0/736910624 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f8073ae0 con 0x7f65f00dce90 2024-09-05T07:29:43.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.535+0000 7f8e6f3b9640 1 -- 172.21.15.17:0/684444387 shutdown_connections 2024-09-05T07:29:43.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.535+0000 7f8e6f3b9640 1 --2- 172.21.15.17:0/684444387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e68151ac0 0x7f8e680c8340 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.535+0000 7f8e6f3b9640 1 -- 172.21.15.17:0/684444387 >> 172.21.15.17:0/684444387 conn(0x7f8e6806fac0 msgr2=0x7f8e6806fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:43.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.535+0000 7f65fcb1f640 1 -- 172.21.15.17:0/736910624 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65f00caad0 con 0x7f65f00dce90 2024-09-05T07:29:43.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.535+0000 7f65fcb1f640 1 -- 172.21.15.17:0/736910624 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65f00cb090 con 0x7f65f00dce90 2024-09-05T07:29:43.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.536+0000 7f8e6f3b9640 1 -- 172.21.15.17:0/684444387 shutdown_connections 2024-09-05T07:29:43.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.536+0000 7f8e6f3b9640 1 -- 172.21.15.17:0/684444387 wait complete. 2024-09-05T07:29:43.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.537+0000 7f65fcb1f640 1 -- 172.21.15.17:0/736910624 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f65f00531d0 con 0x7f65f00dce90 2024-09-05T07:29:43.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.538+0000 7f8e6f3b9640 1 Processor -- start 2024-09-05T07:29:43.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.538+0000 7f8e6f3b9640 1 -- start start 2024-09-05T07:29:43.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.539+0000 7f8e6f3b9640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e680705b0 0x7f8e680c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.539+0000 7f8e6f3b9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e681516e0 0x7f8e680cc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.539+0000 7f8e6f3b9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e68151ac0 0x7f8e680cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.539+0000 7f8e6f3b9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6815ba30 con 0x7f8e681516e0 2024-09-05T07:29:43.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.539+0000 7f8e6f3b9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6815b750 con 0x7f8e68151ac0 2024-09-05T07:29:43.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.539+0000 7f8e6f3b9640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f8e6806f5f0 con 0x7f8e680705b0 2024-09-05T07:29:43.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.542+0000 7ff26f7fe640 1 -- 172.21.15.17:0/3408721903 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff260037040 con 0x7ff278073ee0 2024-09-05T07:29:43.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.542+0000 7ff26f7fe640 1 -- 172.21.15.17:0/3408721903 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff260042070 con 0x7ff278073ee0 2024-09-05T07:29:43.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.542+0000 7ff26f7fe640 1 -- 172.21.15.17:0/3408721903 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff260030bb0 con 0x7ff278073ee0 2024-09-05T07:29:43.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.542+0000 7f8e6c954640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e681516e0 0x7f8e680cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.542+0000 7ff27d447640 1 -- 172.21.15.17:0/3408721903 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff278151b30 con 0x7ff278073ee0 2024-09-05T07:29:43.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.543+0000 7f8e6c954640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e681516e0 0x7f8e680cc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60598/0 (socket says 172.21.15.17:60598) 2024-09-05T07:29:43.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.543+0000 7f8e6c954640 1 -- 172.21.15.17:0/1639107942 learned_addr learned my addr 172.21.15.17:0/1639107942 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:43.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.543+0000 7ff27d447640 1 -- 172.21.15.17:0/3408721903 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff278150910 con 0x7ff278073ee0 2024-09-05T07:29:43.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.544+0000 7ff27d447640 1 -- 172.21.15.17:0/3408721903 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff278072820 con 0x7ff278073ee0 2024-09-05T07:29:43.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.545+0000 7fc38f7fe640 1 -- 172.21.15.17:0/247626344 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0036050 con 0x7fc3a80c53d0 2024-09-05T07:29:43.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.545+0000 7fc38f7fe640 1 -- 172.21.15.17:0/247626344 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3a0042070 con 0x7fc3a80c53d0 2024-09-05T07:29:43.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.545+0000 7fc38f7fe640 1 -- 172.21.15.17:0/247626344 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0009510 con 0x7fc3a80c53d0 2024-09-05T07:29:43.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.546+0000 7fc3ad3e8640 1 -- 172.21.15.17:0/247626344 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3a80cfb10 con 0x7fc3a80c53d0 2024-09-05T07:29:43.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.546+0000 7fc3ad3e8640 1 -- 172.21.15.17:0/247626344 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3a81f8080 con 0x7fc3a80c53d0 2024-09-05T07:29:43.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.546+0000 7fc38d7fa640 1 -- 172.21.15.17:0/247626344 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc3a80cc510 con 0x7fc3a80c53d0 2024-09-05T07:29:43.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.547+0000 7f8e6c954640 1 -- 172.21.15.17:0/1639107942 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e680705b0 msgr2=0x7f8e680c74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.547+0000 7f8e6c954640 1 --2- 172.21.15.17:0/1639107942 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e680705b0 0x7f8e680c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.547+0000 7f8e6c954640 1 -- 172.21.15.17:0/1639107942 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e68151ac0 msgr2=0x7f8e680cc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.547+0000 7f8e6c954640 1 --2- 172.21.15.17:0/1639107942 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e68151ac0 0x7f8e680cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.547+0000 7f8e6c954640 1 -- 172.21.15.17:0/1639107942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e680c7f60 con 0x7f8e681516e0 2024-09-05T07:29:43.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.553+0000 7fe596ffd640 1 -- 172.21.15.17:0/1353233904 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe59c007400 con 0x7fe5a80c9580 2024-09-05T07:29:43.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.553+0000 7fe596ffd640 1 --2- 172.21.15.17:0/1353233904 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fe58806beb0 0x7fe58806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.554+0000 7fe5a659c640 1 --2- 172.21.15.17:0/1353233904 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fe58806beb0 0x7fe58806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.554+0000 7fe5a659c640 1 --2- 172.21.15.17:0/1353233904 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fe58806beb0 0x7fe58806e370 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0033000 tx=0x7fe5a002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.556+0000 7fe596ffd640 1 -- 172.21.15.17:0/1353233904 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe59c056e70 con 0x7fe5a80c9580 2024-09-05T07:29:43.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.556+0000 7fe596ffd640 1 --2- 172.21.15.17:0/1353233904 >> [v2:172.21.15.17:6808/363420609,v1:172.21.15.17:6809/363420609] conn(0x7fe588074050 0x7fe588076470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.556+0000 7fe596ffd640 1 -- 172.21.15.17:0/1353233904 --> [v2:172.21.15.17:6808/363420609,v1:172.21.15.17:6809/363420609] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe588076b20 con 0x7fe588074050 2024-09-05T07:29:43.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.556+0000 7fe596ffd640 1 -- 172.21.15.17:0/1353233904 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fe59c055070 con 0x7fe5a80c9580 2024-09-05T07:29:43.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.556+0000 7fe5a5d9b640 1 --2- 172.21.15.17:0/1353233904 >> [v2:172.21.15.17:6808/363420609,v1:172.21.15.17:6809/363420609] conn(0x7fe588074050 0x7fe588076470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.557+0000 7fe5a5d9b640 1 --2- 172.21.15.17:0/1353233904 >> [v2:172.21.15.17:6808/363420609,v1:172.21.15.17:6809/363420609] conn(0x7fe588074050 0x7fe588076470 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.558+0000 7fe596ffd640 1 -- 172.21.15.17:0/1353233904 <== osd.2 v2:172.21.15.17:6808/363420609 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe588076b20 con 0x7fe588074050 2024-09-05T07:29:43.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.562+0000 7fe6717fa640 1 -- 172.21.15.17:0/3413921702 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe664048020 con 0x7fe6740c2400 2024-09-05T07:29:43.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.563+0000 7fe6717fa640 1 --2- 172.21.15.17:0/3413921702 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fe66006beb0 0x7fe66006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.563+0000 7fe678be8640 1 --2- 172.21.15.17:0/3413921702 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fe66006beb0 0x7fe66006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.564+0000 7fe678be8640 1 --2- 172.21.15.17:0/3413921702 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fe66006beb0 0x7fe66006e370 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe6680098f0 tx=0x7fe668008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.566+0000 7fe6717fa640 1 -- 172.21.15.17:0/3413921702 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe664079460 con 0x7fe6740c2400 2024-09-05T07:29:43.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.566+0000 7fe6717fa640 1 --2- 172.21.15.17:0/3413921702 >> [v2:172.21.15.17:6800/3512342499,v1:172.21.15.17:6801/3512342499] conn(0x7fe660074050 0x7fe660076470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.567+0000 7fe6717fa640 1 -- 172.21.15.17:0/3413921702 --> [v2:172.21.15.17:6800/3512342499,v1:172.21.15.17:6801/3512342499] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe660076b20 con 0x7fe660074050 2024-09-05T07:29:43.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.567+0000 7fe6793e9640 1 --2- 172.21.15.17:0/3413921702 >> [v2:172.21.15.17:6800/3512342499,v1:172.21.15.17:6801/3512342499] conn(0x7fe660074050 0x7fe660076470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.567+0000 7fe6793e9640 1 --2- 172.21.15.17:0/3413921702 >> [v2:172.21.15.17:6800/3512342499,v1:172.21.15.17:6801/3512342499] conn(0x7fe660074050 0x7fe660076470 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.568+0000 7fe6717fa640 1 -- 172.21.15.17:0/3413921702 <== osd.3 v2:172.21.15.17:6800/3512342499 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe660076b20 con 0x7fe660074050 2024-09-05T07:29:43.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.576+0000 7faf9ffff640 1 -- 172.21.15.17:0/2125730718 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf98004030 con 0x7fafa8075650 2024-09-05T07:29:43.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.577+0000 7faf9ffff640 1 -- 172.21.15.17:0/2125730718 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf980041d0 con 0x7fafa8075650 2024-09-05T07:29:43.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.577+0000 7faf9ffff640 1 -- 172.21.15.17:0/2125730718 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf98003610 con 0x7fafa8075650 2024-09-05T07:29:43.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.578+0000 7fafaf359640 1 -- 172.21.15.17:0/2125730718 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fafa8075650 msgr2=0x7fafa8072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.578+0000 7fafaf359640 1 --2- 172.21.15.17:0/2125730718 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fafa8075650 0x7fafa8072fa0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fafa815de80 tx=0x7faf9802a270 comp rx=0 tx=0).stop 2024-09-05T07:29:43.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.578+0000 7fafaf359640 1 -- 172.21.15.17:0/2125730718 shutdown_connections 2024-09-05T07:29:43.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.578+0000 7fafaf359640 1 --2- 172.21.15.17:0/2125730718 >> v2:172.21.15.26:3300/0 conn(0x7fafa80734e0 0x7fafa806f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.578+0000 7fafaf359640 1 --2- 172.21.15.17:0/2125730718 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fafa8075650 0x7fafa8072fa0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.578+0000 7fafaf359640 1 -- 172.21.15.17:0/2125730718 >> 172.21.15.17:0/2125730718 conn(0x7fafa806bc10 msgr2=0x7fafa806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:43.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.578+0000 7fafaf359640 1 -- 172.21.15.17:0/2125730718 shutdown_connections 2024-09-05T07:29:43.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.578+0000 7fafaf359640 1 -- 172.21.15.17:0/2125730718 wait complete. 2024-09-05T07:29:43.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.578+0000 7fe5a759e640 1 -- 172.21.15.17:0/1353233904 --> [v2:172.21.15.17:6808/363420609,v1:172.21.15.17:6809/363420609] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe5a80c6650 con 0x7fe588074050 2024-09-05T07:29:43.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.579+0000 7fe596ffd640 1 -- 172.21.15.17:0/1353233904 <== osd.2 v2:172.21.15.17:6808/363420609 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe5a80c6650 con 0x7fe588074050 2024-09-05T07:29:43.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.579+0000 7f8e6c954640 1 --2- 172.21.15.17:0/1639107942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e681516e0 0x7f8e680cc160 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8e5802a820 tx=0x7f8e580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.579+0000 7ff26f7fe640 1 -- 172.21.15.17:0/3408721903 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff260047460 con 0x7ff278073ee0 2024-09-05T07:29:43.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.580+0000 7fe5a759e640 1 -- 172.21.15.17:0/1353233904 >> [v2:172.21.15.17:6808/363420609,v1:172.21.15.17:6809/363420609] conn(0x7fe588074050 msgr2=0x7fe588076470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.580+0000 7fe5a759e640 1 --2- 172.21.15.17:0/1353233904 >> [v2:172.21.15.17:6808/363420609,v1:172.21.15.17:6809/363420609] conn(0x7fe588074050 0x7fe588076470 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.580+0000 7fafaf359640 1 Processor -- start 2024-09-05T07:29:43.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.580+0000 7fafaf359640 1 -- start start 2024-09-05T07:29:43.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.580+0000 7fe5a759e640 1 -- 172.21.15.17:0/1353233904 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fe58806beb0 msgr2=0x7fe58806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.580+0000 7fe5a759e640 1 --2- 172.21.15.17:0/1353233904 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fe58806beb0 0x7fe58806e370 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0033000 tx=0x7fe5a002e000 comp rx=0 tx=0).stop 2024-09-05T07:29:43.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.580+0000 7fe5a759e640 1 -- 172.21.15.17:0/1353233904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5a80c9580 msgr2=0x7fe5a814a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.580+0000 7fe5a759e640 1 --2- 172.21.15.17:0/1353233904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5a80c9580 0x7fe5a814a080 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00c3f0 tx=0x7fe59c00c8b0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.580+0000 7fe5a6d9d640 1 -- 172.21.15.17:0/1353233904 reap_dead start 2024-09-05T07:29:43.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.580+0000 7fe5a759e640 1 -- 172.21.15.17:0/1353233904 shutdown_connections 2024-09-05T07:29:43.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.580+0000 7fe5a759e640 1 -- 172.21.15.17:0/1353233904 >> 172.21.15.17:0/1353233904 conn(0x7fe5a80c8a60 msgr2=0x7fe5a8146590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:43.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.579+0000 7f65e3fff640 1 -- 172.21.15.17:0/736910624 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f65f8073c80 con 0x7f65f00dce90 2024-09-05T07:29:43.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.580+0000 7f65e3fff640 1 --2- 172.21.15.17:0/736910624 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f65dc06be80 0x7f65dc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.580+0000 7f65f77fe640 1 --2- 172.21.15.17:0/736910624 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f65dc06be80 0x7f65dc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.580+0000 7ff26f7fe640 1 --2- 172.21.15.17:0/3408721903 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7ff25806beb0 0x7ff25806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.580+0000 7ff276ffd640 1 --2- 172.21.15.17:0/3408721903 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7ff25806beb0 0x7ff25806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.581+0000 7fe5a759e640 1 -- 172.21.15.17:0/1353233904 shutdown_connections 2024-09-05T07:29:43.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.581+0000 7fe5a759e640 1 -- 172.21.15.17:0/1353233904 wait complete. 2024-09-05T07:29:43.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.581+0000 7f65f77fe640 1 --2- 172.21.15.17:0/736910624 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f65dc06be80 0x7f65dc06e340 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f65ec033000 tx=0x7f65ec02c000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.581+0000 7ff276ffd640 1 --2- 172.21.15.17:0/3408721903 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7ff25806beb0 0x7ff25806e370 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff268009650 tx=0x7ff268006ba0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.582+0000 7fafaf359640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafa80734e0 0x7fafa815bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.582+0000 7fafaf359640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafa8075650 0x7fafa815d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.582+0000 7fafaf359640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fafa81549c0 0x7fafa814bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.582+0000 7fafaf359640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fafa815eab0 con 0x7fafa8075650 2024-09-05T07:29:43.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.582+0000 7fafaf359640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fafa815e7d0 con 0x7fafa80734e0 2024-09-05T07:29:43.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.582+0000 7fafaf359640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fafa8154da0 con 0x7fafa81549c0 2024-09-05T07:29:43.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.583+0000 7f65e3fff640 1 -- 172.21.15.17:0/736910624 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f65f80d3fe0 con 0x7f65f00dce90 2024-09-05T07:29:43.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.583+0000 7f65e3fff640 1 --2- 172.21.15.17:0/736910624 >> [v2:172.21.15.26:6810/158775588,v1:172.21.15.26:6811/158775588] conn(0x7f65dc073ff0 0x7f65dc076410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.583+0000 7f65e3fff640 1 -- 172.21.15.17:0/736910624 --> [v2:172.21.15.26:6810/158775588,v1:172.21.15.26:6811/158775588] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f65f8072fb0 con 0x7f65dc073ff0 2024-09-05T07:29:43.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.583+0000 7f65e3fff640 1 -- 172.21.15.17:0/736910624 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f65f80d21e0 con 0x7f65f00dce90 2024-09-05T07:29:43.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.585+0000 7f65f6ffd640 1 --2- 172.21.15.17:0/736910624 >> [v2:172.21.15.26:6810/158775588,v1:172.21.15.26:6811/158775588] conn(0x7f65dc073ff0 0x7f65dc076410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.585+0000 7f65f6ffd640 1 --2- 172.21.15.17:0/736910624 >> [v2:172.21.15.26:6810/158775588,v1:172.21.15.26:6811/158775588] conn(0x7f65dc073ff0 0x7f65dc076410 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.586+0000 7f65e3fff640 1 -- 172.21.15.17:0/736910624 <== osd.6 v2:172.21.15.26:6810/158775588 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f65f8072fb0 con 0x7f65dc073ff0 2024-09-05T07:29:43.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.587+0000 7fafad0f5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafa80734e0 0x7fafa815bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.589+0000 7fafad0f5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafa80734e0 0x7fafa815bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:36140/0 (socket says 172.21.15.17:36140) 2024-09-05T07:29:43.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.589+0000 7fafad0f5640 1 -- 172.21.15.17:0/2685658788 learned_addr learned my addr 172.21.15.17:0/2685658788 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:43.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.590+0000 7ff26f7fe640 1 -- 172.21.15.17:0/3408721903 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff260078930 con 0x7ff278073ee0 2024-09-05T07:29:43.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.591+0000 7ff26f7fe640 1 --2- 172.21.15.17:0/3408721903 >> [v2:172.21.15.26:6826/4176189153,v1:172.21.15.26:6827/4176189153] conn(0x7ff2580740b0 0x7ff2580764d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.591+0000 7ff26f7fe640 1 -- 172.21.15.17:0/3408721903 --> [v2:172.21.15.26:6826/4176189153,v1:172.21.15.26:6827/4176189153] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff260036e90 con 0x7ff2580740b0 2024-09-05T07:29:43.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.591+0000 7ff26f7fe640 1 -- 172.21.15.17:0/3408721903 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7ff260076b30 con 0x7ff278073ee0 2024-09-05T07:29:43.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.593+0000 7fafad0f5640 1 -- 172.21.15.17:0/2685658788 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fafa81549c0 msgr2=0x7fafa814bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.593+0000 7fafad0f5640 1 --2- 172.21.15.17:0/2685658788 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fafa81549c0 0x7fafa814bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.593+0000 7fafad0f5640 1 -- 172.21.15.17:0/2685658788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafa8075650 msgr2=0x7fafa815d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.593+0000 7fafad0f5640 1 --2- 172.21.15.17:0/2685658788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafa8075650 0x7fafa815d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.593+0000 7fafad0f5640 1 -- 172.21.15.17:0/2685658788 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafa815ca60 con 0x7fafa80734e0 2024-09-05T07:29:43.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.595+0000 7ff2777fe640 1 --2- 172.21.15.17:0/3408721903 >> [v2:172.21.15.26:6826/4176189153,v1:172.21.15.26:6827/4176189153] conn(0x7ff2580740b0 0x7ff2580764d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.595+0000 7f8e5dffb640 1 -- 172.21.15.17:0/1639107942 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e58037050 con 0x7f8e681516e0 2024-09-05T07:29:43.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.595+0000 7f8e5dffb640 1 -- 172.21.15.17:0/1639107942 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e58038040 con 0x7f8e681516e0 2024-09-05T07:29:43.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.595+0000 7f8e5dffb640 1 -- 172.21.15.17:0/1639107942 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e58030bd0 con 0x7f8e681516e0 2024-09-05T07:29:43.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.595+0000 7fafad0f5640 1 --2- 172.21.15.17:0/2685658788 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafa80734e0 0x7fafa815bcb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fafa400b440 tx=0x7fafa400b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.595+0000 7f8e6f3b9640 1 -- 172.21.15.17:0/1639107942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e681f0770 con 0x7f8e681516e0 2024-09-05T07:29:43.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.596+0000 7f8e6f3b9640 1 -- 172.21.15.17:0/1639107942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e680cb960 con 0x7f8e681516e0 2024-09-05T07:29:43.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.596+0000 7ff2777fe640 1 --2- 172.21.15.17:0/3408721903 >> [v2:172.21.15.26:6826/4176189153,v1:172.21.15.26:6827/4176189153] conn(0x7ff2580740b0 0x7ff2580764d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.597+0000 7ff26f7fe640 1 -- 172.21.15.17:0/3408721903 <== osd.7 v2:172.21.15.26:6826/4176189153 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff260036e90 con 0x7ff2580740b0 2024-09-05T07:29:43.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.596+0000 7fe67ae4c640 1 -- 172.21.15.17:0/3413921702 --> [v2:172.21.15.17:6800/3512342499,v1:172.21.15.17:6801/3512342499] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe6740ccd00 con 0x7fe660074050 2024-09-05T07:29:43.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.597+0000 7f8e6f3b9640 1 -- 172.21.15.17:0/1639107942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8e681f0520 con 0x7f8e681516e0 2024-09-05T07:29:43.599 INFO:teuthology.orchestra.run.smithi017.stdout:64424509451 2024-09-05T07:29:43.600 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-05T07:29:43.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.598+0000 7faf9dffb640 1 -- 172.21.15.17:0/2685658788 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa4015020 con 0x7fafa80734e0 2024-09-05T07:29:43.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.598+0000 7fc38f7fe640 1 -- 172.21.15.17:0/247626344 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc3a0007c30 con 0x7fc3a80c53d0 2024-09-05T07:29:43.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.598+0000 7fc38f7fe640 1 --2- 172.21.15.17:0/247626344 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc39406be80 0x7fc39406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.598+0000 7fafaf359640 1 -- 172.21.15.17:0/2685658788 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafa81f1530 con 0x7fafa80734e0 2024-09-05T07:29:43.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.598+0000 7fafaf359640 1 -- 172.21.15.17:0/2685658788 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafa81f1800 con 0x7fafa80734e0 2024-09-05T07:29:43.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.599+0000 7fe6717fa640 1 -- 172.21.15.17:0/3413921702 <== osd.3 v2:172.21.15.17:6800/3512342499 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe6740ccd00 con 0x7fe660074050 2024-09-05T07:29:43.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.599+0000 7fc3a67fc640 1 --2- 172.21.15.17:0/247626344 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc39406be80 0x7fc39406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.599+0000 7fc3a67fc640 1 --2- 172.21.15.17:0/247626344 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc39406be80 0x7fc39406e340 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc39c00b7f0 tx=0x7fc39c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.600+0000 7fe67ae4c640 1 -- 172.21.15.17:0/3413921702 >> [v2:172.21.15.17:6800/3512342499,v1:172.21.15.17:6801/3512342499] conn(0x7fe660074050 msgr2=0x7fe660076470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.600+0000 7fe67ae4c640 1 --2- 172.21.15.17:0/3413921702 >> [v2:172.21.15.17:6800/3512342499,v1:172.21.15.17:6801/3512342499] conn(0x7fe660074050 0x7fe660076470 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.601+0000 7fe67ae4c640 1 -- 172.21.15.17:0/3413921702 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fe66006beb0 msgr2=0x7fe66006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.601+0000 7fe67ae4c640 1 --2- 172.21.15.17:0/3413921702 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fe66006beb0 0x7fe66006e370 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe6680098f0 tx=0x7fe668008040 comp rx=0 tx=0).stop 2024-09-05T07:29:43.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.601+0000 7fe67ae4c640 1 -- 172.21.15.17:0/3413921702 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe6740c2400 msgr2=0x7fe6740cb210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.601+0000 7fe67ae4c640 1 --2- 172.21.15.17:0/3413921702 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe6740c2400 0x7fe6740cb210 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe664009c00 tx=0x7fe664004a40 comp rx=0 tx=0).stop 2024-09-05T07:29:43.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.601+0000 7fe6793e9640 1 -- 172.21.15.17:0/3413921702 reap_dead start 2024-09-05T07:29:43.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.601+0000 7faf9dffb640 1 -- 172.21.15.17:0/2685658788 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafa4011890 con 0x7fafa80734e0 2024-09-05T07:29:43.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.601+0000 7faf9dffb640 1 -- 172.21.15.17:0/2685658788 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa4011c40 con 0x7fafa80734e0 2024-09-05T07:29:43.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.601+0000 7fe67ae4c640 1 -- 172.21.15.17:0/3413921702 shutdown_connections 2024-09-05T07:29:43.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.601+0000 7fe67ae4c640 1 -- 172.21.15.17:0/3413921702 >> 172.21.15.17:0/3413921702 conn(0x7fe6740cc1e0 msgr2=0x7fe674159620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:43.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.602+0000 7fc38f7fe640 1 -- 172.21.15.17:0/247626344 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc3a00789f0 con 0x7fc3a80c53d0 2024-09-05T07:29:43.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.602+0000 7fafaf359640 1 -- 172.21.15.17:0/2685658788 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faf88001030 con 0x7fafa80734e0 2024-09-05T07:29:43.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.602+0000 7fe67ae4c640 1 -- 172.21.15.17:0/3413921702 shutdown_connections 2024-09-05T07:29:43.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.602+0000 7fc38f7fe640 1 --2- 172.21.15.17:0/247626344 >> [v2:172.21.15.17:6824/2731314060,v1:172.21.15.17:6825/2731314060] conn(0x7fc394074080 0x7fc3940764a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.602+0000 7fe67ae4c640 1 -- 172.21.15.17:0/3413921702 wait complete. 2024-09-05T07:29:43.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.602+0000 7fc38f7fe640 1 -- 172.21.15.17:0/247626344 --> [v2:172.21.15.17:6824/2731314060,v1:172.21.15.17:6825/2731314060] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc3a0006b90 con 0x7fc394074080 2024-09-05T07:29:43.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.603+0000 7fc3a77fe640 1 --2- 172.21.15.17:0/247626344 >> [v2:172.21.15.17:6824/2731314060,v1:172.21.15.17:6825/2731314060] conn(0x7fc394074080 0x7fc3940764a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.603+0000 7fc3a77fe640 1 --2- 172.21.15.17:0/247626344 >> [v2:172.21.15.17:6824/2731314060,v1:172.21.15.17:6825/2731314060] conn(0x7fc394074080 0x7fc3940764a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.604+0000 7fc38f7fe640 1 -- 172.21.15.17:0/247626344 <== osd.0 v2:172.21.15.17:6824/2731314060 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc3a0006b90 con 0x7fc394074080 2024-09-05T07:29:43.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.609+0000 7fc38f7fe640 1 -- 172.21.15.17:0/247626344 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fc3a0076bf0 con 0x7fc3a80c53d0 2024-09-05T07:29:43.622 INFO:teuthology.orchestra.run.smithi017.stdout:64424509451 2024-09-05T07:29:43.622 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-05T07:29:43.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.620+0000 7f65fcb1f640 1 -- 172.21.15.17:0/736910624 --> [v2:172.21.15.26:6810/158775588,v1:172.21.15.26:6811/158775588] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f65f00531d0 con 0x7f65dc073ff0 2024-09-05T07:29:43.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.620+0000 7f65e3fff640 1 -- 172.21.15.17:0/736910624 <== osd.6 v2:172.21.15.26:6810/158775588 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f65f00531d0 con 0x7f65dc073ff0 2024-09-05T07:29:43.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.621+0000 7f65fcb1f640 1 -- 172.21.15.17:0/736910624 >> [v2:172.21.15.26:6810/158775588,v1:172.21.15.26:6811/158775588] conn(0x7f65dc073ff0 msgr2=0x7f65dc076410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.621+0000 7f65fcb1f640 1 --2- 172.21.15.17:0/736910624 >> [v2:172.21.15.26:6810/158775588,v1:172.21.15.26:6811/158775588] conn(0x7f65dc073ff0 0x7f65dc076410 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.621+0000 7f65fcb1f640 1 -- 172.21.15.17:0/736910624 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f65dc06be80 msgr2=0x7f65dc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.621+0000 7f65fcb1f640 1 --2- 172.21.15.17:0/736910624 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f65dc06be80 0x7f65dc06e340 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f65ec033000 tx=0x7f65ec02c000 comp rx=0 tx=0).stop 2024-09-05T07:29:43.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.621+0000 7f65fcb1f640 1 -- 172.21.15.17:0/736910624 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f00dce90 msgr2=0x7f65f00cc0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.621+0000 7f65fcb1f640 1 --2- 172.21.15.17:0/736910624 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65f00dce90 0x7f65f00cc0b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f65f8051790 tx=0x7f65f8069810 comp rx=0 tx=0).stop 2024-09-05T07:29:43.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.621+0000 7f65fdd81640 1 -- 172.21.15.17:0/736910624 reap_dead start 2024-09-05T07:29:43.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.621+0000 7f417359e640 1 Processor -- start 2024-09-05T07:29:43.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.621+0000 7f65fcb1f640 1 -- 172.21.15.17:0/736910624 shutdown_connections 2024-09-05T07:29:43.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.621+0000 7f65fcb1f640 1 -- 172.21.15.17:0/736910624 >> 172.21.15.17:0/736910624 conn(0x7f65f0009b60 msgr2=0x7f65f004e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:43.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.622+0000 7f65fcb1f640 1 -- 172.21.15.17:0/736910624 shutdown_connections 2024-09-05T07:29:43.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.622+0000 7f65fcb1f640 1 -- 172.21.15.17:0/736910624 wait complete. 2024-09-05T07:29:43.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.622+0000 7f417359e640 1 -- start start 2024-09-05T07:29:43.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.623+0000 7f417359e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f416c04bf20 0x7f416c0e6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.623+0000 7f417359e640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f416c0e6b90 0x7f416c0dc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.623+0000 7f417359e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f416c04a960 con 0x7f416c0e6270 2024-09-05T07:29:43.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.623+0000 7f417359e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f416c005a50 con 0x7f416c04bf20 2024-09-05T07:29:43.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.623+0000 7f417359e640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f416c0e34b0 con 0x7f416c0e6b90 2024-09-05T07:29:43.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.624+0000 7f4172d9d640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f416c0e6b90 0x7f416c0dc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.624+0000 7f4172d9d640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f416c0e6b90 0x7f416c0dc8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:59886/0 (socket says 172.21.15.17:59886) 2024-09-05T07:29:43.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.624+0000 7f4172d9d640 1 -- 172.21.15.17:0/2138362872 learned_addr learned my addr 172.21.15.17:0/2138362872 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:43.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.625+0000 7ff27d447640 1 -- 172.21.15.17:0/3408721903 --> [v2:172.21.15.26:6826/4176189153,v1:172.21.15.26:6827/4176189153] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff2781f08a0 con 0x7ff2580740b0 2024-09-05T07:29:43.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.625+0000 7ff26f7fe640 1 -- 172.21.15.17:0/3408721903 <== osd.7 v2:172.21.15.26:6826/4176189153 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff2781f08a0 con 0x7ff2580740b0 2024-09-05T07:29:43.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.626+0000 7ff27d447640 1 -- 172.21.15.17:0/3408721903 >> [v2:172.21.15.26:6826/4176189153,v1:172.21.15.26:6827/4176189153] conn(0x7ff2580740b0 msgr2=0x7ff2580764d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.626+0000 7ff27d447640 1 --2- 172.21.15.17:0/3408721903 >> [v2:172.21.15.26:6826/4176189153,v1:172.21.15.26:6827/4176189153] conn(0x7ff2580740b0 0x7ff2580764d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.626+0000 7ff27d447640 1 -- 172.21.15.17:0/3408721903 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7ff25806beb0 msgr2=0x7ff25806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.626+0000 7ff27d447640 1 --2- 172.21.15.17:0/3408721903 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7ff25806beb0 0x7ff25806e370 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff268009650 tx=0x7ff268006ba0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.626+0000 7ff27d447640 1 -- 172.21.15.17:0/3408721903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff278073ee0 msgr2=0x7ff2781f0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.627+0000 7ff27d447640 1 --2- 172.21.15.17:0/3408721903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff278073ee0 0x7ff2781f0360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff260000c00 tx=0x7ff2600046c0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.627+0000 7ff2777fe640 1 -- 172.21.15.17:0/3408721903 reap_dead start 2024-09-05T07:29:43.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.627+0000 7ff27d447640 1 -- 172.21.15.17:0/3408721903 shutdown_connections 2024-09-05T07:29:43.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.627+0000 7ff27d447640 1 -- 172.21.15.17:0/3408721903 >> 172.21.15.17:0/3408721903 conn(0x7ff2780cd260 msgr2=0x7ff2780b2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:43.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.627+0000 7f4172d9d640 1 -- 172.21.15.17:0/2138362872 >> v2:172.21.15.17:3300/0 conn(0x7f416c04bf20 msgr2=0x7f416c0e6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:43.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.627+0000 7f4172d9d640 1 --2- 172.21.15.17:0/2138362872 >> v2:172.21.15.17:3300/0 conn(0x7f416c04bf20 0x7f416c0e6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.627+0000 7f4172d9d640 1 -- 172.21.15.17:0/2138362872 >> v1:172.21.15.17:6789/0 conn(0x7f416c0e6270 legacy=0x7f416c045c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:43.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.627+0000 7faf9dffb640 1 -- 172.21.15.17:0/2685658788 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fafa4018020 con 0x7fafa80734e0 2024-09-05T07:29:43.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.628+0000 7faf9dffb640 1 --2- 172.21.15.17:0/2685658788 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7faf8c06be30 0x7faf8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.628+0000 7fafac8f4640 1 --2- 172.21.15.17:0/2685658788 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7faf8c06be30 0x7faf8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.627+0000 7f4172d9d640 1 -- 172.21.15.17:0/2138362872 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f416c0e36e0 con 0x7f416c0e6b90 2024-09-05T07:29:43.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.628+0000 7ff27d447640 1 -- 172.21.15.17:0/3408721903 shutdown_connections 2024-09-05T07:29:43.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.628+0000 7ff27d447640 1 -- 172.21.15.17:0/3408721903 wait complete. 2024-09-05T07:29:43.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.629+0000 7fafac8f4640 1 --2- 172.21.15.17:0/2685658788 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7faf8c06be30 0x7faf8c06e2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faf98033000 tx=0x7faf9802c000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.629+0000 7f4172d9d640 1 --2- 172.21.15.17:0/2138362872 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f416c0e6b90 0x7f416c0dc8f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4168009870 tx=0x7f416802a2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6a51e70ea51fbea server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.630+0000 7faf9dffb640 1 -- 172.21.15.17:0/2685658788 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fafa4011de0 con 0x7fafa80734e0 2024-09-05T07:29:43.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.630+0000 7faf9dffb640 1 --2- 172.21.15.17:0/2685658788 >> [v2:172.21.15.17:6816/3327408852,v1:172.21.15.17:6817/3327408852] conn(0x7faf8c073fd0 0x7faf8c0763f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.630+0000 7faf9dffb640 1 -- 172.21.15.17:0/2685658788 --> [v2:172.21.15.17:6816/3327408852,v1:172.21.15.17:6817/3327408852] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fafa4006730 con 0x7faf8c073fd0 2024-09-05T07:29:43.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.630+0000 7fafad8f6640 1 --2- 172.21.15.17:0/2685658788 >> [v2:172.21.15.17:6816/3327408852,v1:172.21.15.17:6817/3327408852] conn(0x7faf8c073fd0 0x7faf8c0763f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.631+0000 7fafad8f6640 1 --2- 172.21.15.17:0/2685658788 >> [v2:172.21.15.17:6816/3327408852,v1:172.21.15.17:6817/3327408852] conn(0x7faf8c073fd0 0x7faf8c0763f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.632+0000 7faf9dffb640 1 -- 172.21.15.17:0/2685658788 <== osd.1 v2:172.21.15.17:6816/3327408852 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fafa4006730 con 0x7faf8c073fd0 2024-09-05T07:29:43.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.633+0000 7faf9dffb640 1 -- 172.21.15.17:0/2685658788 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fafa4055ab0 con 0x7fafa80734e0 2024-09-05T07:29:43.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.633+0000 7fc38d7fa640 1 -- 172.21.15.17:0/247626344 --> [v2:172.21.15.17:6824/2731314060,v1:172.21.15.17:6825/2731314060] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc3a80cb830 con 0x7fc394074080 2024-09-05T07:29:43.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.634+0000 7f417159a640 1 -- 172.21.15.17:0/2138362872 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4168037070 con 0x7f416c0e6b90 2024-09-05T07:29:43.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.634+0000 7f417159a640 1 -- 172.21.15.17:0/2138362872 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4168032440 con 0x7f416c0e6b90 2024-09-05T07:29:43.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.635+0000 7f417359e640 1 -- 172.21.15.17:0/2138362872 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f416c0e6b90 msgr2=0x7f416c0dc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.635+0000 7f417359e640 1 --2- 172.21.15.17:0/2138362872 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f416c0e6b90 0x7f416c0dc8f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4168009870 tx=0x7f416802a2c0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.636+0000 7f417359e640 1 -- 172.21.15.17:0/2138362872 shutdown_connections 2024-09-05T07:29:43.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.636+0000 7f417359e640 1 --2- 172.21.15.17:0/2138362872 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f416c0e6b90 0x7f416c0dc8f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.636+0000 7f417359e640 1 --2- 172.21.15.17:0/2138362872 >> v2:172.21.15.17:3300/0 conn(0x7f416c04bf20 0x7f416c0e6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.636+0000 7f417359e640 1 -- 172.21.15.17:0/2138362872 >> 172.21.15.17:0/2138362872 conn(0x7f416c04fc50 msgr2=0x7f416c050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:43.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.635+0000 7f8e5dffb640 1 -- 172.21.15.17:0/1639107942 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8e5803c440 con 0x7f8e681516e0 2024-09-05T07:29:43.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.636+0000 7f8e5dffb640 1 --2- 172.21.15.17:0/1639107942 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f8e4c06be80 0x7f8e4c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.636+0000 7fc38f7fe640 1 -- 172.21.15.17:0/247626344 <== osd.0 v2:172.21.15.17:6824/2731314060 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc3a80cb830 con 0x7fc394074080 2024-09-05T07:29:43.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.637+0000 7f8e6d155640 1 --2- 172.21.15.17:0/1639107942 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f8e4c06be80 0x7f8e4c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.637+0000 7fc38d7fa640 1 -- 172.21.15.17:0/247626344 >> [v2:172.21.15.17:6824/2731314060,v1:172.21.15.17:6825/2731314060] conn(0x7fc394074080 msgr2=0x7fc3940764a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.637+0000 7fc38d7fa640 1 --2- 172.21.15.17:0/247626344 >> [v2:172.21.15.17:6824/2731314060,v1:172.21.15.17:6825/2731314060] conn(0x7fc394074080 0x7fc3940764a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.637+0000 7f417359e640 1 -- 172.21.15.17:0/2138362872 shutdown_connections 2024-09-05T07:29:43.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.637+0000 7f417359e640 1 -- 172.21.15.17:0/2138362872 wait complete. 2024-09-05T07:29:43.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.638+0000 7f8e6d155640 1 --2- 172.21.15.17:0/1639107942 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f8e4c06be80 0x7f8e4c06e340 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8e64000f60 tx=0x7f8e640079b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.638+0000 7fc38d7fa640 1 -- 172.21.15.17:0/247626344 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc39406be80 msgr2=0x7fc39406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.638+0000 7fc38d7fa640 1 --2- 172.21.15.17:0/247626344 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc39406be80 0x7fc39406e340 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc39c00b7f0 tx=0x7fc39c008040 comp rx=0 tx=0).stop 2024-09-05T07:29:43.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.638+0000 7fc38d7fa640 1 -- 172.21.15.17:0/247626344 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc3a80c53d0 msgr2=0x7fc3a81f8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.638+0000 7fc38d7fa640 1 --2- 172.21.15.17:0/247626344 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc3a80c53d0 0x7fc3a81f8880 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0034040 tx=0x7fc3a0004a40 comp rx=0 tx=0).stop 2024-09-05T07:29:43.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.638+0000 7fc3a77fe640 1 -- 172.21.15.17:0/247626344 reap_dead start 2024-09-05T07:29:43.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.638+0000 7fc38d7fa640 1 -- 172.21.15.17:0/247626344 shutdown_connections 2024-09-05T07:29:43.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.638+0000 7fc38d7fa640 1 -- 172.21.15.17:0/247626344 >> 172.21.15.17:0/247626344 conn(0x7fc3a806bc10 msgr2=0x7fc3a8158510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:43.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.638+0000 7fc38d7fa640 1 -- 172.21.15.17:0/247626344 shutdown_connections 2024-09-05T07:29:43.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.638+0000 7fc38d7fa640 1 -- 172.21.15.17:0/247626344 wait complete. 2024-09-05T07:29:43.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.639+0000 7f417359e640 1 Processor -- start 2024-09-05T07:29:43.641 INFO:teuthology.orchestra.run.smithi017.stdout:60129542155 2024-09-05T07:29:43.642 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-05T07:29:43.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.639+0000 7f417359e640 1 -- start start 2024-09-05T07:29:43.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.641+0000 7f417359e640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f416c04bf20 0x7f416c04e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.641+0000 7f417359e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f416c0e6270 0x7f416c0e4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.641+0000 7f417359e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f416c0e6b90 0x7f416c0e5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.641+0000 7f417359e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f416c044e70 con 0x7f416c0e6270 2024-09-05T07:29:43.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.641+0000 7f417359e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f416c0457a0 con 0x7f416c0e6b90 2024-09-05T07:29:43.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.641+0000 7f417359e640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f416c045150 con 0x7f416c04bf20 2024-09-05T07:29:43.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.641+0000 7f417259c640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f416c04bf20 0x7f416c04e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.642+0000 7f4172d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f416c0e6b90 0x7f416c0e5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.642+0000 7f417259c640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f416c04bf20 0x7f416c04e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:59898/0 (socket says 172.21.15.17:59898) 2024-09-05T07:29:43.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.642+0000 7f417259c640 1 -- 172.21.15.17:0/765032364 learned_addr learned my addr 172.21.15.17:0/765032364 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:43.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.644+0000 7f4171d9b640 1 --2- 172.21.15.17:0/765032364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f416c0e6270 0x7f416c0e4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.646+0000 7f417259c640 1 -- 172.21.15.17:0/765032364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f416c0e6b90 msgr2=0x7f416c0e5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.646+0000 7f417259c640 1 --2- 172.21.15.17:0/765032364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f416c0e6b90 0x7f416c0e5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.646+0000 7f417259c640 1 -- 172.21.15.17:0/765032364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f416c0e6270 msgr2=0x7f416c0e4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.646+0000 7f417259c640 1 --2- 172.21.15.17:0/765032364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f416c0e6270 0x7f416c0e4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.646+0000 7f417259c640 1 -- 172.21.15.17:0/765032364 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f416c178bf0 con 0x7f416c04bf20 2024-09-05T07:29:43.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.648+0000 7f417259c640 1 --2- 172.21.15.17:0/765032364 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f416c04bf20 0x7f416c04e8d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f416400c440 tx=0x7f416400c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.652 INFO:teuthology.orchestra.run.smithi017.stdout:64424509451 2024-09-05T07:29:43.652 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-05T07:29:43.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.651+0000 7f4162ffd640 1 -- 172.21.15.17:0/765032364 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4164017070 con 0x7f416c04bf20 2024-09-05T07:29:43.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.651+0000 7f4162ffd640 1 -- 172.21.15.17:0/765032364 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41640035f0 con 0x7f416c04bf20 2024-09-05T07:29:43.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.651+0000 7f4162ffd640 1 -- 172.21.15.17:0/765032364 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41640039c0 con 0x7f416c04bf20 2024-09-05T07:29:43.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.652+0000 7f417359e640 1 -- 172.21.15.17:0/765032364 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f416c178e90 con 0x7f416c04bf20 2024-09-05T07:29:43.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.652+0000 7f417359e640 1 -- 172.21.15.17:0/765032364 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f416c179450 con 0x7f416c04bf20 2024-09-05T07:29:43.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.654+0000 7f417359e640 1 -- 172.21.15.17:0/765032364 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f416c0dc5b0 con 0x7f416c04bf20 2024-09-05T07:29:43.659 INFO:teuthology.orchestra.run.smithi017.stdout:64424509450 2024-09-05T07:29:43.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.657+0000 7f8e5dffb640 1 -- 172.21.15.17:0/1639107942 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8e58078650 con 0x7f8e681516e0 2024-09-05T07:29:43.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.657+0000 7f8e5dffb640 1 --2- 172.21.15.17:0/1639107942 >> [v2:172.21.15.26:6818/3020770750,v1:172.21.15.26:6819/3020770750] conn(0x7f8e4c074080 0x7f8e4c0764a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.657+0000 7f8e5dffb640 1 -- 172.21.15.17:0/1639107942 --> [v2:172.21.15.26:6818/3020770750,v1:172.21.15.26:6819/3020770750] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8e5804ae80 con 0x7f8e4c074080 2024-09-05T07:29:43.660 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-05T07:29:43.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.658+0000 7f8e6d956640 1 --2- 172.21.15.17:0/1639107942 >> [v2:172.21.15.26:6818/3020770750,v1:172.21.15.26:6819/3020770750] conn(0x7f8e4c074080 0x7f8e4c0764a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.658+0000 7f8e6d956640 1 --2- 172.21.15.17:0/1639107942 >> [v2:172.21.15.26:6818/3020770750,v1:172.21.15.26:6819/3020770750] conn(0x7f8e4c074080 0x7f8e4c0764a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.659+0000 7f8e5dffb640 1 -- 172.21.15.17:0/1639107942 <== osd.5 v2:172.21.15.26:6818/3020770750 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8e5804ae80 con 0x7f8e4c074080 2024-09-05T07:29:43.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.662+0000 7f8e5dffb640 1 -- 172.21.15.17:0/1639107942 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f8e58076850 con 0x7f8e681516e0 2024-09-05T07:29:43.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.665+0000 7fafaf359640 1 -- 172.21.15.17:0/2685658788 --> [v2:172.21.15.17:6816/3327408852,v1:172.21.15.17:6817/3327408852] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faf88002d10 con 0x7faf8c073fd0 2024-09-05T07:29:43.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.666+0000 7faf9dffb640 1 -- 172.21.15.17:0/2685658788 <== osd.1 v2:172.21.15.17:6816/3327408852 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7faf88002d10 con 0x7faf8c073fd0 2024-09-05T07:29:43.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.666+0000 7fafaf359640 1 -- 172.21.15.17:0/2685658788 >> [v2:172.21.15.17:6816/3327408852,v1:172.21.15.17:6817/3327408852] conn(0x7faf8c073fd0 msgr2=0x7faf8c0763f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.666+0000 7fafaf359640 1 --2- 172.21.15.17:0/2685658788 >> [v2:172.21.15.17:6816/3327408852,v1:172.21.15.17:6817/3327408852] conn(0x7faf8c073fd0 0x7faf8c0763f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.667+0000 7fafaf359640 1 -- 172.21.15.17:0/2685658788 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7faf8c06be30 msgr2=0x7faf8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.667+0000 7fafaf359640 1 --2- 172.21.15.17:0/2685658788 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7faf8c06be30 0x7faf8c06e2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faf98033000 tx=0x7faf9802c000 comp rx=0 tx=0).stop 2024-09-05T07:29:43.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.667+0000 7fafaf359640 1 -- 172.21.15.17:0/2685658788 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafa80734e0 msgr2=0x7fafa815bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.667+0000 7fafaf359640 1 --2- 172.21.15.17:0/2685658788 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafa80734e0 0x7fafa815bcb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fafa400b440 tx=0x7fafa400b900 comp rx=0 tx=0).stop 2024-09-05T07:29:43.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.667+0000 7fafad8f6640 1 -- 172.21.15.17:0/2685658788 reap_dead start 2024-09-05T07:29:43.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.668+0000 7fafaf359640 1 -- 172.21.15.17:0/2685658788 shutdown_connections 2024-09-05T07:29:43.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.668+0000 7fafaf359640 1 -- 172.21.15.17:0/2685658788 >> 172.21.15.17:0/2685658788 conn(0x7fafa806bc10 msgr2=0x7fafa806f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:43.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.668+0000 7fafaf359640 1 -- 172.21.15.17:0/2685658788 shutdown_connections 2024-09-05T07:29:43.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.668+0000 7fafaf359640 1 -- 172.21.15.17:0/2685658788 wait complete. 2024-09-05T07:29:43.687 INFO:teuthology.orchestra.run.smithi017.stdout:64424509450 2024-09-05T07:29:43.687 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-05T07:29:43.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.690+0000 7f8e6f3b9640 1 -- 172.21.15.17:0/1639107942 --> [v2:172.21.15.26:6818/3020770750,v1:172.21.15.26:6819/3020770750] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8e680c3d30 con 0x7f8e4c074080 2024-09-05T07:29:43.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.690+0000 7f8e5dffb640 1 -- 172.21.15.17:0/1639107942 <== osd.5 v2:172.21.15.26:6818/3020770750 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8e680c3d30 con 0x7f8e4c074080 2024-09-05T07:29:43.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.690+0000 7f8e6f3b9640 1 -- 172.21.15.17:0/1639107942 >> [v2:172.21.15.26:6818/3020770750,v1:172.21.15.26:6819/3020770750] conn(0x7f8e4c074080 msgr2=0x7f8e4c0764a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.690+0000 7f8e6f3b9640 1 --2- 172.21.15.17:0/1639107942 >> [v2:172.21.15.26:6818/3020770750,v1:172.21.15.26:6819/3020770750] conn(0x7f8e4c074080 0x7f8e4c0764a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.691+0000 7f8e6f3b9640 1 -- 172.21.15.17:0/1639107942 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f8e4c06be80 msgr2=0x7f8e4c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.691+0000 7f8e6f3b9640 1 --2- 172.21.15.17:0/1639107942 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f8e4c06be80 0x7f8e4c06e340 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8e64000f60 tx=0x7f8e640079b0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.691+0000 7f8e6f3b9640 1 -- 172.21.15.17:0/1639107942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e681516e0 msgr2=0x7f8e680cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.691+0000 7f8e6f3b9640 1 --2- 172.21.15.17:0/1639107942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e681516e0 0x7f8e680cc160 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8e5802a820 tx=0x7f8e580046c0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.691+0000 7f8e6d956640 1 -- 172.21.15.17:0/1639107942 reap_dead start 2024-09-05T07:29:43.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.693+0000 7f8e6f3b9640 1 -- 172.21.15.17:0/1639107942 shutdown_connections 2024-09-05T07:29:43.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.693+0000 7f8e6f3b9640 1 -- 172.21.15.17:0/1639107942 >> 172.21.15.17:0/1639107942 conn(0x7f8e6806fac0 msgr2=0x7f8e680c5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:43.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.693+0000 7f8e6f3b9640 1 -- 172.21.15.17:0/1639107942 shutdown_connections 2024-09-05T07:29:43.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.693+0000 7f8e6f3b9640 1 -- 172.21.15.17:0/1639107942 wait complete. 2024-09-05T07:29:43.713 INFO:teuthology.orchestra.run.smithi017.stdout:68719476748 2024-09-05T07:29:43.713 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-05T07:29:43.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.752+0000 7fc28819f640 1 Processor -- start 2024-09-05T07:29:43.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.752+0000 7fc28819f640 1 -- start start 2024-09-05T07:29:43.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.753+0000 7fc28819f640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc280067950 0x7fc280067d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.753+0000 7fc28819f640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc28015a9a0 con 0x7fc2800afde0 2024-09-05T07:29:43.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.753+0000 7fc28819f640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc28015ac80 con 0x7fc280072820 2024-09-05T07:29:43.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.753+0000 7fc28819f640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fc28015af60 con 0x7fc280067950 2024-09-05T07:29:43.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.754+0000 7fc28673c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc280072820 0x7fc28015de60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.17:44662/0 (socket says 172.21.15.17:44662) 2024-09-05T07:29:43.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.754+0000 7fc28673c640 1 -- 172.21.15.17:0/3015190713 learned_addr learned my addr 172.21.15.17:0/3015190713 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:29:43.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.756+0000 7fc284f39640 1 -- 172.21.15.17:0/3015190713 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3962531692 0 0) 0x7fc28015ac80 con 0x7fc280072820 2024-09-05T07:29:43.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.756+0000 7fc284f39640 1 -- 172.21.15.17:0/3015190713 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc26c003520 con 0x7fc280072820 2024-09-05T07:29:43.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.757+0000 7fc284f39640 1 -- 172.21.15.17:0/3015190713 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 305339899 0 0) 0x7fc28015a9a0 con 0x7fc2800afde0 2024-09-05T07:29:43.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.757+0000 7fc284f39640 1 -- 172.21.15.17:0/3015190713 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc28015ac80 con 0x7fc2800afde0 2024-09-05T07:29:43.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.760+0000 7fc284f39640 1 -- 172.21.15.17:0/3015190713 <== mon.1 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 159106879 0 0) 0x7fc26c003520 con 0x7fc280072820 2024-09-05T07:29:43.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.760+0000 7fc284f39640 1 -- 172.21.15.17:0/3015190713 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc280067950 msgr2=0x7fc280067d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:43.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.760+0000 7fc284f39640 1 --2- 172.21.15.17:0/3015190713 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc280067950 0x7fc280067d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.760+0000 7fc284f39640 1 -- 172.21.15.17:0/3015190713 >> v1:172.21.15.17:6789/0 conn(0x7fc2800afde0 legacy=0x7fc2800ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.760+0000 7fc284f39640 1 -- 172.21.15.17:0/3015190713 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc28015b240 con 0x7fc280072820 2024-09-05T07:29:43.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.760+0000 7fc284f39640 1 -- 172.21.15.17:0/3015190713 <== mon.1 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1460137602 0 0) 0x7fc2780019f0 con 0x7fc280072820 2024-09-05T07:29:43.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.760+0000 7fc284f39640 1 -- 172.21.15.17:0/3015190713 >> v1:172.21.15.26:6789/0 conn(0x7fc280072820 legacy=0x7fc28015de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.761+0000 7fc284f39640 1 --2- 172.21.15.17:0/3015190713 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc26c003b40 0x7fc26c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.761+0000 7fc284f39640 1 --2- 172.21.15.17:0/3015190713 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc280067950 0x7fc26c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.761+0000 7fc284f39640 1 --2- 172.21.15.17:0/3015190713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc26c004d90 0x7fc26c0051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.761+0000 7fc284f39640 1 -- 172.21.15.17:0/3015190713 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc28015af60 con 0x7fc26c004d90 2024-09-05T07:29:43.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.761+0000 7fc284f39640 1 -- 172.21.15.17:0/3015190713 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc26c00bb80 con 0x7fc26c003b40 2024-09-05T07:29:43.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.761+0000 7fc284f39640 1 -- 172.21.15.17:0/3015190713 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fc26c00bd80 con 0x7fc280067950 2024-09-05T07:29:43.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.762+0000 7fc285f3b640 1 --2- 172.21.15.17:0/3015190713 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc26c003b40 0x7fc26c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.763+0000 7fc28673c640 1 --2- 172.21.15.17:0/3015190713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc26c004d90 0x7fc26c0051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.765+0000 7fc285f3b640 1 -- 172.21.15.17:0/3015190713 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc280067950 msgr2=0x7fc26c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:43.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.765+0000 7fc285f3b640 1 --2- 172.21.15.17:0/3015190713 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc280067950 0x7fc26c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.765+0000 7fc285f3b640 1 -- 172.21.15.17:0/3015190713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc26c004d90 msgr2=0x7fc26c0051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:43.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.765+0000 7fc285f3b640 1 --2- 172.21.15.17:0/3015190713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc26c004d90 0x7fc26c0051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.765+0000 7fc285f3b640 1 -- 172.21.15.17:0/3015190713 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc28015b240 con 0x7fc26c003b40 2024-09-05T07:29:43.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.767+0000 7fc285f3b640 1 --2- 172.21.15.17:0/3015190713 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc26c003b40 0x7fc26c003f40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc27c009860 tx=0x7fc26c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d663ba93015093e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.774+0000 7fc284f39640 1 -- 172.21.15.17:0/3015190713 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc27c037070 con 0x7fc26c003b40 2024-09-05T07:29:43.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.774+0000 7fc284f39640 1 -- 172.21.15.17:0/3015190713 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc27c02aaa0 con 0x7fc26c003b40 2024-09-05T07:29:43.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.774+0000 7fc284f39640 1 -- 172.21.15.17:0/3015190713 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc27c009460 con 0x7fc26c003b40 2024-09-05T07:29:43.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.775+0000 7fc28819f640 1 -- 172.21.15.17:0/3015190713 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc26c003b40 msgr2=0x7fc26c003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.775+0000 7fc28819f640 1 --2- 172.21.15.17:0/3015190713 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc26c003b40 0x7fc26c003f40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc27c009860 tx=0x7fc26c005830 comp rx=0 tx=0).stop 2024-09-05T07:29:43.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.775+0000 7fc28673c640 1 -- 172.21.15.17:0/3015190713 reap_dead start 2024-09-05T07:29:43.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.775+0000 7fc28819f640 1 -- 172.21.15.17:0/3015190713 shutdown_connections 2024-09-05T07:29:43.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.775+0000 7fc28819f640 1 -- 172.21.15.17:0/3015190713 >> 172.21.15.17:0/3015190713 conn(0x7fc2800cd260 msgr2=0x7fc2800cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:43.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.775+0000 7fc28819f640 1 -- 172.21.15.17:0/3015190713 shutdown_connections 2024-09-05T07:29:43.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.775+0000 7fc28819f640 1 -- 172.21.15.17:0/3015190713 wait complete. 2024-09-05T07:29:43.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.777+0000 7fc28819f640 1 Processor -- start 2024-09-05T07:29:43.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.777+0000 7fc28819f640 1 -- start start 2024-09-05T07:29:43.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.777+0000 7fc28819f640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc28015c980 0x7fc28015cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.777+0000 7fc28819f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2800b0660 0x7fc2800b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.778+0000 7fc28819f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2801557a0 0x7fc280155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.778+0000 7fc28819f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc28015e6f0 con 0x7fc2800b0660 2024-09-05T07:29:43.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.778+0000 7fc28819f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc28015e570 con 0x7fc2801557a0 2024-09-05T07:29:43.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.778+0000 7fc28819f640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fc280156600 con 0x7fc28015c980 2024-09-05T07:29:43.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.778+0000 7fc28673c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2801557a0 0x7fc280155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.778+0000 7fc28673c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2801557a0 0x7fc280155c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:36162/0 (socket says 172.21.15.17:36162) 2024-09-05T07:29:43.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.778+0000 7fc28673c640 1 -- 172.21.15.17:0/1855809025 learned_addr learned my addr 172.21.15.17:0/1855809025 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:43.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.779+0000 7fc28573a640 1 --2- 172.21.15.17:0/1855809025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2800b0660 0x7fc2800b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.783+0000 7fc28673c640 1 -- 172.21.15.17:0/1855809025 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc28015c980 msgr2=0x7fc28015cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.783+0000 7fc28673c640 1 --2- 172.21.15.17:0/1855809025 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc28015c980 0x7fc28015cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.783+0000 7fc28673c640 1 -- 172.21.15.17:0/1855809025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2800b0660 msgr2=0x7fc2800b0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.783+0000 7fc28673c640 1 --2- 172.21.15.17:0/1855809025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2800b0660 0x7fc2800b0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.783+0000 7fc28673c640 1 -- 172.21.15.17:0/1855809025 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc280156850 con 0x7fc2801557a0 2024-09-05T07:29:43.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.784+0000 7fc28673c640 1 --2- 172.21.15.17:0/1855809025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2801557a0 0x7fc280155c50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc2800c7920 tx=0x7fc27800e390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.785+0000 7fd3ec4a6640 1 Processor -- start 2024-09-05T07:29:43.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.785+0000 7fd3ec4a6640 1 -- start start 2024-09-05T07:29:43.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.786+0000 7fd3ec4a6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd3e41517e0 0x7fd3e40c36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.786+0000 7fd3ec4a6640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd3e40c6200 0x7fd3e40723a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.786+0000 7fd3ec4a6640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3e40c66f0 con 0x7fd3e40c97e0 2024-09-05T07:29:43.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.786+0000 7fd3ec4a6640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fd3e40c5260 con 0x7fd3e40c6200 2024-09-05T07:29:43.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.786+0000 7fd3ec4a6640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fd3e40c5ac0 con 0x7fd3e41517e0 2024-09-05T07:29:43.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.787+0000 7fd3e9a41640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd3e40c6200 0x7fd3e40723a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.788+0000 7fc2767fc640 1 -- 172.21.15.17:0/1855809025 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc27800ec80 con 0x7fc2801557a0 2024-09-05T07:29:43.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.788+0000 7fc2767fc640 1 -- 172.21.15.17:0/1855809025 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc278018070 con 0x7fc2801557a0 2024-09-05T07:29:43.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.788+0000 7fc2767fc640 1 -- 172.21.15.17:0/1855809025 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc278013420 con 0x7fc2801557a0 2024-09-05T07:29:43.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.788+0000 7fc28819f640 1 -- 172.21.15.17:0/1855809025 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc280159520 con 0x7fc2801557a0 2024-09-05T07:29:43.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.788+0000 7fc28819f640 1 -- 172.21.15.17:0/1855809025 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc280159aa0 con 0x7fc2801557a0 2024-09-05T07:29:43.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.789+0000 7fd3ea242640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd3e41517e0 0x7fd3e40c36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.789+0000 7fd3ea242640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd3e41517e0 0x7fd3e40c36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:36172/0 (socket says 172.21.15.17:36172) 2024-09-05T07:29:43.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.789+0000 7fd3ea242640 1 -- 172.21.15.17:0/1489277960 learned_addr learned my addr 172.21.15.17:0/1489277960 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:43.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.790+0000 7fc28819f640 1 -- 172.21.15.17:0/1855809025 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc280067d30 con 0x7fc2801557a0 2024-09-05T07:29:43.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.794+0000 7fd3e9a41640 1 -- 172.21.15.17:0/1489277960 >> v2:172.21.15.26:3300/0 conn(0x7fd3e41517e0 msgr2=0x7fd3e40c36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:43.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.794+0000 7fd3e9a41640 1 --2- 172.21.15.17:0/1489277960 >> v2:172.21.15.26:3300/0 conn(0x7fd3e41517e0 0x7fd3e40c36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.794+0000 7fd3e9a41640 1 -- 172.21.15.17:0/1489277960 >> v1:172.21.15.26:6789/0 conn(0x7fd3e40c97e0 legacy=0x7fd3e415b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:43.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.794+0000 7fd3e9a41640 1 -- 172.21.15.17:0/1489277960 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e40c5500 con 0x7fd3e40c6200 2024-09-05T07:29:43.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.798+0000 7fd3e9a41640 1 --2- 172.21.15.17:0/1489277960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3e40c6200 0x7fd3e40723a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd3e406cb30 tx=0x7fd3dc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be8c2ef650908766 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.799+0000 7f308b7c4640 1 Processor -- start 2024-09-05T07:29:43.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.799+0000 7f308b7c4640 1 -- start start 2024-09-05T07:29:43.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.800+0000 7f308b7c4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3084154f10 0x7f3084075770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.800+0000 7f308b7c4640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f308415ec40 0x7f308415e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.800+0000 7f308b7c4640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f308415c000 con 0x7f308415e560 2024-09-05T07:29:43.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.800+0000 7f308b7c4640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f30840ca1f0 con 0x7f3084154f10 2024-09-05T07:29:43.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.800+0000 7f308b7c4640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f3084075cb0 con 0x7f308415ec40 2024-09-05T07:29:43.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.805+0000 7fd3e9240640 1 -- 172.21.15.17:0/1489277960 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc037070 con 0x7fd3e40c6200 2024-09-05T07:29:43.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.805+0000 7fd3e9240640 1 -- 172.21.15.17:0/1489277960 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3dc032440 con 0x7fd3e40c6200 2024-09-05T07:29:43.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.805+0000 7fd3e9240640 1 -- 172.21.15.17:0/1489277960 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc032850 con 0x7fd3e40c6200 2024-09-05T07:29:43.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.806+0000 7fd3ec4a6640 1 -- 172.21.15.17:0/1489277960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3e40c6200 msgr2=0x7fd3e40723a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.806+0000 7fd3ec4a6640 1 --2- 172.21.15.17:0/1489277960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3e40c6200 0x7fd3e40723a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd3e406cb30 tx=0x7fd3dc02a180 comp rx=0 tx=0).stop 2024-09-05T07:29:43.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.806+0000 7fd3ec4a6640 1 -- 172.21.15.17:0/1489277960 shutdown_connections 2024-09-05T07:29:43.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.806+0000 7fd3ec4a6640 1 --2- 172.21.15.17:0/1489277960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3e40c6200 0x7fd3e40723a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.806+0000 7fd3ec4a6640 1 --2- 172.21.15.17:0/1489277960 >> v2:172.21.15.26:3300/0 conn(0x7fd3e41517e0 0x7fd3e40c36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.806+0000 7fd3ec4a6640 1 -- 172.21.15.17:0/1489277960 >> 172.21.15.17:0/1489277960 conn(0x7fd3e40c8cf0 msgr2=0x7fd3e40c90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:43.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.806+0000 7fd3ec4a6640 1 -- 172.21.15.17:0/1489277960 shutdown_connections 2024-09-05T07:29:43.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.806+0000 7fd3ec4a6640 1 -- 172.21.15.17:0/1489277960 wait complete. 2024-09-05T07:29:43.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.808+0000 7fd3ec4a6640 1 Processor -- start 2024-09-05T07:29:43.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.808+0000 7fd3ec4a6640 1 -- start start 2024-09-05T07:29:43.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.810+0000 7fd3ec4a6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3e40c6200 0x7fd3e413b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.810+0000 7fd3ec4a6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3e40c97e0 0x7fd3e4150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.810+0000 7fd3ec4a6640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd3e41517e0 0x7fd3e413cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.810+0000 7fd3ec4a6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e4151bc0 con 0x7fd3e40c6200 2024-09-05T07:29:43.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.810+0000 7fd3ec4a6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e415ac30 con 0x7fd3e40c97e0 2024-09-05T07:29:43.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.810+0000 7fd3ec4a6640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fd3e4151d40 con 0x7fd3e41517e0 2024-09-05T07:29:43.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.811+0000 7fd3ea242640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3e40c6200 0x7fd3e413b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.811+0000 7fd3ea242640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3e40c6200 0x7fd3e413b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60656/0 (socket says 172.21.15.17:60656) 2024-09-05T07:29:43.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.811+0000 7fd3ea242640 1 -- 172.21.15.17:0/2727583148 learned_addr learned my addr 172.21.15.17:0/2727583148 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:43.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.815+0000 7fc2767fc640 1 -- 172.21.15.17:0/1855809025 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc2780135c0 con 0x7fc2801557a0 2024-09-05T07:29:43.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.815+0000 7fc2767fc640 1 --2- 172.21.15.17:0/1855809025 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc26406be80 0x7fc26406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.816+0000 7fd3ea242640 1 -- 172.21.15.17:0/2727583148 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd3e41517e0 msgr2=0x7fd3e413cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.816+0000 7fd3ea242640 1 --2- 172.21.15.17:0/2727583148 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd3e41517e0 0x7fd3e413cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.816+0000 7fd3ea242640 1 -- 172.21.15.17:0/2727583148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3e40c97e0 msgr2=0x7fd3e4150830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.816+0000 7fd3ea242640 1 --2- 172.21.15.17:0/2727583148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3e40c97e0 0x7fd3e4150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.816+0000 7fd3ea242640 1 -- 172.21.15.17:0/2727583148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e413c230 con 0x7fd3e40c6200 2024-09-05T07:29:43.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.816+0000 7fc285f3b640 1 --2- 172.21.15.17:0/1855809025 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc26406be80 0x7fc26406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.817+0000 7fc285f3b640 1 --2- 172.21.15.17:0/1855809025 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc26406be80 0x7fc26406e340 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc27c034000 tx=0x7fc27c02c000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.817+0000 7f8e5024c640 1 Processor -- start 2024-09-05T07:29:43.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.817+0000 7f8e5024c640 1 -- start start 2024-09-05T07:29:43.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.818+0000 7f8e5024c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8e480afde0 0x7f8e48067d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.818+0000 7f8e5024c640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e48072820 0x7f8e4815de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.818+0000 7f8e5024c640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e4815a9a0 con 0x7f8e48067950 2024-09-05T07:29:43.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.818+0000 7f8e5024c640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f8e4815ac80 con 0x7f8e480afde0 2024-09-05T07:29:43.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.818+0000 7f8e5024c640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f8e4815af60 con 0x7f8e48072820 2024-09-05T07:29:43.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.818+0000 7fc2767fc640 1 -- 172.21.15.17:0/1855809025 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc2780580c0 con 0x7fc2801557a0 2024-09-05T07:29:43.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.819+0000 7fd3ea242640 1 --2- 172.21.15.17:0/2727583148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3e40c6200 0x7fd3e413b7e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd3e000efc0 tx=0x7fd3e000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.820+0000 7f8e4d7e7640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8e480afde0 0x7f8e48067d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.820+0000 7f4997166640 1 Processor -- start 2024-09-05T07:29:43.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.820+0000 7f4997166640 1 -- start start 2024-09-05T07:29:43.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.822+0000 7f4997166640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4990073b00 0x7f499015ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.822+0000 7f4997166640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f49900c8e40 0x7f49901566e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.822+0000 7f4997166640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f499015b1a0 con 0x7f4990073ee0 2024-09-05T07:29:43.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.822+0000 7f4997166640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f4990073070 con 0x7f49900c8e40 2024-09-05T07:29:43.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.822+0000 7f4997166640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f4990073350 con 0x7f4990073b00 2024-09-05T07:29:43.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.824+0000 7fd3daffd640 1 -- 172.21.15.17:0/2727583148 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e000cda0 con 0x7fd3e40c6200 2024-09-05T07:29:43.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.824+0000 7fd3ec4a6640 1 -- 172.21.15.17:0/2727583148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3e414c830 con 0x7fd3e40c6200 2024-09-05T07:29:43.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.824+0000 7f8e4d7e7640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8e480afde0 0x7f8e48067d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60658/0 (socket says 172.21.15.17:60658) 2024-09-05T07:29:43.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.824+0000 7f8e4d7e7640 1 -- 172.21.15.17:0/3014206590 learned_addr learned my addr 172.21.15.17:0/3014206590 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:43.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.824+0000 7fd3ec4a6640 1 -- 172.21.15.17:0/2727583148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3e413c780 con 0x7fd3e40c6200 2024-09-05T07:29:43.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.824+0000 7fd3daffd640 1 -- 172.21.15.17:0/2727583148 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3e0019070 con 0x7fd3e40c6200 2024-09-05T07:29:43.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.824+0000 7fd3daffd640 1 -- 172.21.15.17:0/2727583148 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e0014680 con 0x7fd3e40c6200 2024-09-05T07:29:43.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.825+0000 7fd3ec4a6640 1 -- 172.21.15.17:0/2727583148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3e40c36f0 con 0x7fd3e40c6200 2024-09-05T07:29:43.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.827+0000 7f8e4d7e7640 1 -- 172.21.15.17:0/3014206590 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e48072820 msgr2=0x7f8e4815de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:43.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.827+0000 7f8e4d7e7640 1 --2- 172.21.15.17:0/3014206590 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e48072820 0x7f8e4815de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.827+0000 7f8e4d7e7640 1 -- 172.21.15.17:0/3014206590 >> v1:172.21.15.26:6789/0 conn(0x7f8e48067950 legacy=0x7f8e480ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:43.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.827+0000 7f8e4d7e7640 1 -- 172.21.15.17:0/3014206590 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e4815b240 con 0x7f8e480afde0 2024-09-05T07:29:43.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.842+0000 7fdad29d8640 1 Processor -- start 2024-09-05T07:29:43.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.842+0000 7fdad29d8640 1 -- start start 2024-09-05T07:29:43.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.843+0000 7fdad29d8640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdacc157f10 0x7fdacc15a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.843+0000 7fdad29d8640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdacc0b3b20 con 0x7fdacc0cd2d0 2024-09-05T07:29:43.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.843+0000 7fdad29d8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdacc15b590 con 0x7fdacc0ccef0 2024-09-05T07:29:43.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.843+0000 7fdad29d8640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fdacc0b2d60 con 0x7fdacc157f10 2024-09-05T07:29:43.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.877+0000 7f323c5d8640 1 Processor -- start 2024-09-05T07:29:43.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.877+0000 7f323c5d8640 1 -- start start 2024-09-05T07:29:43.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.878+0000 7f323c5d8640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3234073b00 0x7f323415ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.878+0000 7f323c5d8640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3234073ee0 0x7f323406f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.878+0000 7f323c5d8640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f323415b1a0 con 0x7f32340c8e40 2024-09-05T07:29:43.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.878+0000 7f323c5d8640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f3234073070 con 0x7f3234073ee0 2024-09-05T07:29:43.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.878+0000 7f323c5d8640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f3234073350 con 0x7f3234073b00 2024-09-05T07:29:43.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.927+0000 7f4162ffd640 1 -- 172.21.15.17:0/765032364 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4164003b60 con 0x7f416c04bf20 2024-09-05T07:29:43.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.928+0000 7f4162ffd640 1 --2- 172.21.15.17:0/765032364 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f415406be60 0x7f415406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.928+0000 7f4171d9b640 1 --2- 172.21.15.17:0/765032364 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f415406be60 0x7f415406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.928+0000 7f4171d9b640 1 --2- 172.21.15.17:0/765032364 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f415406be60 0x7f415406e320 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4174000b60 tx=0x7f417406e040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.931+0000 7f4162ffd640 1 -- 172.21.15.17:0/765032364 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f41640567b0 con 0x7f416c04bf20 2024-09-05T07:29:43.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.959+0000 7f4162ffd640 1 -- 172.21.15.17:0/765032364 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f416c0dc5b0 con 0x7f416c04bf20 2024-09-05T07:29:43.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.965+0000 7f3088d5f640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f308415ec40 0x7f308415e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.967+0000 7f3088d5f640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f308415ec40 0x7f308415e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:59942/0 (socket says 172.21.15.17:59942) 2024-09-05T07:29:43.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.967+0000 7f3088d5f640 1 -- 172.21.15.17:0/367385737 learned_addr learned my addr 172.21.15.17:0/367385737 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:43.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.974+0000 7f3088d5f640 1 -- 172.21.15.17:0/367385737 >> v2:172.21.15.26:3300/0 conn(0x7f3084154f10 msgr2=0x7f3084075770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:43.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.974+0000 7f3088d5f640 1 --2- 172.21.15.17:0/367385737 >> v2:172.21.15.26:3300/0 conn(0x7f3084154f10 0x7f3084075770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.974+0000 7f3088d5f640 1 -- 172.21.15.17:0/367385737 >> v1:172.21.15.26:6789/0 conn(0x7f308415e560 legacy=0x7f308415cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:43.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.974+0000 7f3088d5f640 1 -- 172.21.15.17:0/367385737 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3084073600 con 0x7f308415ec40 2024-09-05T07:29:43.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.977+0000 7fdad0f75640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdacc157f10 0x7fdacc15a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.978+0000 7f323a374640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3234073b00 0x7f323415ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:43.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.978+0000 7fdad0f75640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdacc157f10 0x7fdacc15a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:59964/0 (socket says 172.21.15.17:59964) 2024-09-05T07:29:43.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.978+0000 7fdad0f75640 1 -- 172.21.15.17:0/3029946427 learned_addr learned my addr 172.21.15.17:0/3029946427 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:43.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.978+0000 7f323a374640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3234073b00 0x7f323415ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:59966/0 (socket says 172.21.15.17:59966) 2024-09-05T07:29:43.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.978+0000 7f323a374640 1 -- 172.21.15.17:0/3481789451 learned_addr learned my addr 172.21.15.17:0/3481789451 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:43.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.982+0000 7fdad0f75640 1 -- 172.21.15.17:0/3029946427 >> v1:172.21.15.26:6789/0 conn(0x7fdacc0ccef0 legacy=0x7fdacc0b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:43.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.982+0000 7fdad0f75640 1 -- 172.21.15.17:0/3029946427 >> v1:172.21.15.17:6789/0 conn(0x7fdacc0cd2d0 legacy=0x7fdacc157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:43.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.982+0000 7fdad0f75640 1 -- 172.21.15.17:0/3029946427 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdacc0b3040 con 0x7fdacc157f10 2024-09-05T07:29:43.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.983+0000 7f323a374640 1 -- 172.21.15.17:0/3481789451 >> v2:172.21.15.17:3300/0 conn(0x7f3234073ee0 msgr2=0x7f323406f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:43.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.983+0000 7f323a374640 1 --2- 172.21.15.17:0/3481789451 >> v2:172.21.15.17:3300/0 conn(0x7f3234073ee0 0x7f323406f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.983+0000 7f323a374640 1 -- 172.21.15.17:0/3481789451 >> v1:172.21.15.17:6789/0 conn(0x7f32340c8e40 legacy=0x7f323406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:43.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.983+0000 7f323a374640 1 -- 172.21.15.17:0/3481789451 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3234073630 con 0x7f3234073b00 2024-09-05T07:29:43.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.986+0000 7f3088d5f640 1 --2- 172.21.15.17:0/367385737 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f308415ec40 0x7f308415e020 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3074009870 tx=0x7f307402a2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9942219f2454bf5b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.987+0000 7fdad0f75640 1 --2- 172.21.15.17:0/3029946427 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdacc157f10 0x7fdacc15a820 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdac4009eb0 tx=0x7fdac402a730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc396735886ba859 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.992+0000 7fdacaffd640 1 -- 172.21.15.17:0/3029946427 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac4036070 con 0x7fdacc157f10 2024-09-05T07:29:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.994+0000 7fdacaffd640 1 -- 172.21.15.17:0/3029946427 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdac4031600 con 0x7fdacc157f10 2024-09-05T07:29:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.994+0000 7fdacaffd640 1 -- 172.21.15.17:0/3029946427 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac40319d0 con 0x7fdacc157f10 2024-09-05T07:29:43.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.994+0000 7f323a374640 1 --2- 172.21.15.17:0/3481789451 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3234073b00 0x7f323415ac60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3230009870 tx=0x7f323002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa7d502768401dfd server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:43.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.995+0000 7fdad29d8640 1 -- 172.21.15.17:0/3029946427 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdacc157f10 msgr2=0x7fdacc15a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:43.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.995+0000 7fdad29d8640 1 --2- 172.21.15.17:0/3029946427 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdacc157f10 0x7fdacc15a820 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdac4009eb0 tx=0x7fdac402a730 comp rx=0 tx=0).stop 2024-09-05T07:29:43.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.995+0000 7fdad29d8640 1 -- 172.21.15.17:0/3029946427 shutdown_connections 2024-09-05T07:29:43.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.995+0000 7fdad29d8640 1 --2- 172.21.15.17:0/3029946427 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdacc157f10 0x7fdacc15a820 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:43.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.995+0000 7fdad29d8640 1 -- 172.21.15.17:0/3029946427 >> 172.21.15.17:0/3029946427 conn(0x7fdacc072230 msgr2=0x7fdacc072640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:43.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.995+0000 7fdad29d8640 1 -- 172.21.15.17:0/3029946427 shutdown_connections 2024-09-05T07:29:43.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.995+0000 7fdad29d8640 1 -- 172.21.15.17:0/3029946427 wait complete. 2024-09-05T07:29:43.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.996+0000 7fdad29d8640 1 Processor -- start 2024-09-05T07:29:43.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.996+0000 7fdad29d8640 1 -- start start 2024-09-05T07:29:43.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.997+0000 7fdad29d8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdacc0ccef0 0x7fdacc1e3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.997+0000 7fdad29d8640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdacc0cd2d0 0x7fdacc1f3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.997+0000 7fdad29d8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdacc157f10 0x7fdacc1f40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:43.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.997+0000 7fdad29d8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdacc0b4580 con 0x7fdacc157f10 2024-09-05T07:29:43.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.997+0000 7fdad29d8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fdacc0b3600 con 0x7fdacc0ccef0 2024-09-05T07:29:43.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.997+0000 7fdad29d8640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fdacc15dee0 con 0x7fdacc0cd2d0 2024-09-05T07:29:44.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.999+0000 7f307bfff640 1 -- 172.21.15.17:0/367385737 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3074037070 con 0x7f308415ec40 2024-09-05T07:29:44.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.999+0000 7f307bfff640 1 -- 172.21.15.17:0/367385737 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3074032440 con 0x7f308415ec40 2024-09-05T07:29:44.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.999+0000 7f307bfff640 1 -- 172.21.15.17:0/367385737 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3074032810 con 0x7f308415ec40 2024-09-05T07:29:44.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.999+0000 7f308b7c4640 1 -- 172.21.15.17:0/367385737 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f308415ec40 msgr2=0x7f308415e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:44.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:43.999+0000 7f308b7c4640 1 --2- 172.21.15.17:0/367385737 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f308415ec40 0x7f308415e020 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3074009870 tx=0x7f307402a2a0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.000+0000 7f308b7c4640 1 -- 172.21.15.17:0/367385737 shutdown_connections 2024-09-05T07:29:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.000+0000 7f308b7c4640 1 --2- 172.21.15.17:0/367385737 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f308415ec40 0x7f308415e020 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.000+0000 7f308b7c4640 1 --2- 172.21.15.17:0/367385737 >> v2:172.21.15.26:3300/0 conn(0x7f3084154f10 0x7f3084075770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.000+0000 7f308b7c4640 1 -- 172.21.15.17:0/367385737 >> 172.21.15.17:0/367385737 conn(0x7f308406fac0 msgr2=0x7f308406fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.000+0000 7f308b7c4640 1 -- 172.21.15.17:0/367385737 shutdown_connections 2024-09-05T07:29:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.000+0000 7f3239372640 1 -- 172.21.15.17:0/3481789451 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3230037070 con 0x7f3234073b00 2024-09-05T07:29:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.000+0000 7f308b7c4640 1 -- 172.21.15.17:0/367385737 wait complete. 2024-09-05T07:29:44.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.000+0000 7f3239372640 1 -- 172.21.15.17:0/3481789451 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3230032440 con 0x7f3234073b00 2024-09-05T07:29:44.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.000+0000 7f3239372640 1 -- 172.21.15.17:0/3481789451 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3230032810 con 0x7f3234073b00 2024-09-05T07:29:44.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.000+0000 7fdacb7fe640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdacc0cd2d0 0x7fdacc1f3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:44.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.000+0000 7f323c5d8640 1 -- 172.21.15.17:0/3481789451 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3234073b00 msgr2=0x7f323415ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:44.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.000+0000 7f323c5d8640 1 --2- 172.21.15.17:0/3481789451 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3234073b00 0x7f323415ac60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3230009870 tx=0x7f323002a180 comp rx=0 tx=0).stop 2024-09-05T07:29:44.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.001+0000 7f323c5d8640 1 -- 172.21.15.17:0/3481789451 shutdown_connections 2024-09-05T07:29:44.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.001+0000 7f323c5d8640 1 --2- 172.21.15.17:0/3481789451 >> v2:172.21.15.17:3300/0 conn(0x7f3234073ee0 0x7f323406f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.001+0000 7f323c5d8640 1 --2- 172.21.15.17:0/3481789451 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3234073b00 0x7f323415ac60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.001+0000 7f323c5d8640 1 -- 172.21.15.17:0/3481789451 >> 172.21.15.17:0/3481789451 conn(0x7f32340cd260 msgr2=0x7f32340cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:44.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.001+0000 7f323c5d8640 1 -- 172.21.15.17:0/3481789451 shutdown_connections 2024-09-05T07:29:44.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.001+0000 7f323c5d8640 1 -- 172.21.15.17:0/3481789451 wait complete. 2024-09-05T07:29:44.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.001+0000 7fdacb7fe640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdacc0cd2d0 0x7fdacc1f3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:59970/0 (socket says 172.21.15.17:59970) 2024-09-05T07:29:44.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.001+0000 7fdacb7fe640 1 -- 172.21.15.17:0/1922784232 learned_addr learned my addr 172.21.15.17:0/1922784232 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:44.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.001+0000 7f308b7c4640 1 Processor -- start 2024-09-05T07:29:44.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.001+0000 7f308b7c4640 1 -- start start 2024-09-05T07:29:44.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.002+0000 7f308b7c4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3084154f10 0x7f3084155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:44.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.002+0000 7f308b7c4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f308415e560 0x7f308414d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:44.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.002+0000 7f308b7c4640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f308415ec40 0x7f3084156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:44.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.002+0000 7f308b7c4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f308415c580 con 0x7f3084154f10 2024-09-05T07:29:44.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.002+0000 7f308b7c4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f30840c9c80 con 0x7f308415e560 2024-09-05T07:29:44.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.002+0000 7f308b7c4640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f308415c860 con 0x7f308415ec40 2024-09-05T07:29:44.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.002+0000 7f323c5d8640 1 Processor -- start 2024-09-05T07:29:44.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.003+0000 7f323c5d8640 1 -- start start 2024-09-05T07:29:44.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.003+0000 7f3089d61640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f308415ec40 0x7f3084156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:44.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.004+0000 7f323c5d8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3234073b00 0x7f32340c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:44.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.004+0000 7f323c5d8640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3234073ee0 0x7f3234153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:44.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.004+0000 7f323c5d8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32340c8e40 0x7f32341ee7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:44.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.004+0000 7f323c5d8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f32340c8940 con 0x7f3234073b00 2024-09-05T07:29:44.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.004+0000 7f323c5d8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f32340c8660 con 0x7f32340c8e40 2024-09-05T07:29:44.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.004+0000 7f323c5d8640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f323406fcc0 con 0x7f3234073ee0 2024-09-05T07:29:44.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.006+0000 7fdacb7fe640 1 -- 172.21.15.17:0/1922784232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdacc0ccef0 msgr2=0x7fdacc1e3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:44.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.006+0000 7fdacb7fe640 1 --2- 172.21.15.17:0/1922784232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdacc0ccef0 0x7fdacc1e3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.006+0000 7fdacb7fe640 1 -- 172.21.15.17:0/1922784232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdacc157f10 msgr2=0x7fdacc1f40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:44.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.006+0000 7fdacb7fe640 1 --2- 172.21.15.17:0/1922784232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdacc157f10 0x7fdacc1f40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.006+0000 7fdacb7fe640 1 -- 172.21.15.17:0/1922784232 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdacc1f4710 con 0x7fdacc0cd2d0 2024-09-05T07:29:44.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.009+0000 7f3089d61640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f308415ec40 0x7f3084156dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:59984/0 (socket says 172.21.15.17:59984) 2024-09-05T07:29:44.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.009+0000 7f3089d61640 1 -- 172.21.15.17:0/4003094634 learned_addr learned my addr 172.21.15.17:0/4003094634 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:44.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.009+0000 7f3239b73640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3234073ee0 0x7f3234153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:44.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.009+0000 7fdacb7fe640 1 --2- 172.21.15.17:0/1922784232 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdacc0cd2d0 0x7fdacc1f3bb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdab400c400 tx=0x7fdab400c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:44.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.011+0000 7f3239b73640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3234073ee0 0x7f3234153c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:59992/0 (socket says 172.21.15.17:59992) 2024-09-05T07:29:44.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.011+0000 7f3239b73640 1 -- 172.21.15.17:0/3016121293 learned_addr learned my addr 172.21.15.17:0/3016121293 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:44.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.013+0000 7f3089d61640 1 -- 172.21.15.17:0/4003094634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f308415e560 msgr2=0x7f308414d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:44.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.013+0000 7f3089d61640 1 --2- 172.21.15.17:0/4003094634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f308415e560 0x7f308414d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.013+0000 7f3089d61640 1 -- 172.21.15.17:0/4003094634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3084154f10 msgr2=0x7f3084155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:44.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.013+0000 7f3089d61640 1 --2- 172.21.15.17:0/4003094634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3084154f10 0x7f3084155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.013+0000 7f3089d61640 1 -- 172.21.15.17:0/4003094634 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30840c5cb0 con 0x7f308415ec40 2024-09-05T07:29:44.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.018+0000 7f3089d61640 1 --2- 172.21.15.17:0/4003094634 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f308415ec40 0x7f3084156dd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f307c00c7b0 tx=0x7f307c00cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:44.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.021+0000 7f3239b73640 1 -- 172.21.15.17:0/3016121293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32340c8e40 msgr2=0x7f32341ee7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:44.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.021+0000 7f3239b73640 1 --2- 172.21.15.17:0/3016121293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32340c8e40 0x7f32341ee7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.021+0000 7f3239b73640 1 -- 172.21.15.17:0/3016121293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3234073b00 msgr2=0x7f32340c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:44.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.021+0000 7f3239b73640 1 --2- 172.21.15.17:0/3016121293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3234073b00 0x7f32340c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.021+0000 7f3239b73640 1 -- 172.21.15.17:0/3016121293 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3234159880 con 0x7f3234073ee0 2024-09-05T07:29:44.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.025+0000 7fdac8ff9640 1 -- 172.21.15.17:0/1922784232 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab4017070 con 0x7fdacc0cd2d0 2024-09-05T07:29:44.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.025+0000 7fdac8ff9640 1 -- 172.21.15.17:0/1922784232 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdab40035f0 con 0x7fdacc0cd2d0 2024-09-05T07:29:44.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.025+0000 7fdad29d8640 1 -- 172.21.15.17:0/1922784232 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdacc1f1a70 con 0x7fdacc0cd2d0 2024-09-05T07:29:44.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.025+0000 7fdac8ff9640 1 -- 172.21.15.17:0/1922784232 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab40039e0 con 0x7fdacc0cd2d0 2024-09-05T07:29:44.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.025+0000 7fdad29d8640 1 -- 172.21.15.17:0/1922784232 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdacc1f2030 con 0x7fdacc0cd2d0 2024-09-05T07:29:44.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.026+0000 7fdad29d8640 1 -- 172.21.15.17:0/1922784232 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdacc0b3e70 con 0x7fdacc0cd2d0 2024-09-05T07:29:44.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.046+0000 7fdac8ff9640 1 -- 172.21.15.17:0/1922784232 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdab401a070 con 0x7fdacc0cd2d0 2024-09-05T07:29:44.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.046+0000 7fdac8ff9640 1 --2- 172.21.15.17:0/1922784232 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fdaac06be80 0x7fdaac06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:44.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.047+0000 7fdacbfff640 1 --2- 172.21.15.17:0/1922784232 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fdaac06be80 0x7fdaac06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:44.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.047+0000 7fdacbfff640 1 --2- 172.21.15.17:0/1922784232 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fdaac06be80 0x7fdaac06e340 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdabc001560 tx=0x7fdabc007990 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:44.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.093+0000 7fc2767fc640 1 -- 172.21.15.17:0/1855809025 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc27805a720 con 0x7fc2801557a0 2024-09-05T07:29:44.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.094+0000 7f498ffff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4990073ee0 0x7f499006f780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.17:44710/0 (socket says 172.21.15.17:44710) 2024-09-05T07:29:44.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.094+0000 7f498ffff640 1 -- 172.21.15.17:0/2648936643 learned_addr learned my addr 172.21.15.17:0/2648936643 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:29:44.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.095+0000 7f4994f02640 1 --2- 172.21.15.17:0/2648936643 >> v2:172.21.15.26:3300/0 conn(0x7f4990073b00 0x7f499015ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:44.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.102+0000 7f498f7fe640 1 -- 172.21.15.17:0/2648936643 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3536194222 0 0) 0x7f499015b1a0 con 0x7f4990073ee0 2024-09-05T07:29:44.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.103+0000 7f498f7fe640 1 -- 172.21.15.17:0/2648936643 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4980005730 con 0x7f4990073ee0 2024-09-05T07:29:44.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.104+0000 7f4994f02640 1 -- 172.21.15.17:0/2648936643 >> v2:172.21.15.17:3300/0 conn(0x7f49900c8e40 msgr2=0x7f49901566e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:44.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.104+0000 7f4994f02640 1 --2- 172.21.15.17:0/2648936643 >> v2:172.21.15.17:3300/0 conn(0x7f49900c8e40 0x7f49901566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.104+0000 7f4994f02640 1 -- 172.21.15.17:0/2648936643 >> v1:172.21.15.26:6789/0 conn(0x7f4990073ee0 legacy=0x7f499006f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:44.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.104+0000 7f4994f02640 1 -- 172.21.15.17:0/2648936643 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4990073630 con 0x7f4990073b00 2024-09-05T07:29:44.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.112+0000 7f4994f02640 1 --2- 172.21.15.17:0/2648936643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4990073b00 0x7f499015ac60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f49900ce100 tx=0x7f498402a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ae1ff4fcafbd57b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:44.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.115+0000 7f498f7fe640 1 -- 172.21.15.17:0/2648936643 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4984037070 con 0x7f4990073b00 2024-09-05T07:29:44.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.115+0000 7f498f7fe640 1 -- 172.21.15.17:0/2648936643 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4984032440 con 0x7f4990073b00 2024-09-05T07:29:44.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.115+0000 7f498f7fe640 1 -- 172.21.15.17:0/2648936643 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f498402ae60 con 0x7f4990073b00 2024-09-05T07:29:44.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.116+0000 7f4997166640 1 -- 172.21.15.17:0/2648936643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4990073b00 msgr2=0x7f499015ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:44.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.116+0000 7f4997166640 1 --2- 172.21.15.17:0/2648936643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4990073b00 0x7f499015ac60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f49900ce100 tx=0x7f498402a110 comp rx=0 tx=0).stop 2024-09-05T07:29:44.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.116+0000 7f4997166640 1 -- 172.21.15.17:0/2648936643 shutdown_connections 2024-09-05T07:29:44.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.116+0000 7f4997166640 1 --2- 172.21.15.17:0/2648936643 >> v2:172.21.15.17:3300/0 conn(0x7f49900c8e40 0x7f49901566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.116+0000 7f4997166640 1 --2- 172.21.15.17:0/2648936643 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4990073b00 0x7f499015ac60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.116+0000 7f4997166640 1 -- 172.21.15.17:0/2648936643 >> 172.21.15.17:0/2648936643 conn(0x7f49900cd260 msgr2=0x7f49900cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:44.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.117+0000 7f4997166640 1 -- 172.21.15.17:0/2648936643 shutdown_connections 2024-09-05T07:29:44.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.117+0000 7f4997166640 1 -- 172.21.15.17:0/2648936643 wait complete. 2024-09-05T07:29:44.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.118+0000 7f4997166640 1 Processor -- start 2024-09-05T07:29:44.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.119+0000 7f4997166640 1 -- start start 2024-09-05T07:29:44.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.120+0000 7f4997166640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4990073b00 0x7f49900c4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:44.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.120+0000 7f4997166640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4990073ee0 0x7f499015b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:44.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.120+0000 7f4997166640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49900c8e40 0x7f49900c6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:44.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.120+0000 7f4997166640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f49900c8940 con 0x7f49900c8e40 2024-09-05T07:29:44.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.120+0000 7f4997166640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f49900c8660 con 0x7f4990073b00 2024-09-05T07:29:44.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.120+0000 7f4997166640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f499006fe90 con 0x7f4990073ee0 2024-09-05T07:29:44.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.120+0000 7f4994f02640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4990073b00 0x7f49900c4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:44.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.121+0000 7f4994f02640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4990073b00 0x7f49900c4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:36240/0 (socket says 172.21.15.17:36240) 2024-09-05T07:29:44.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.121+0000 7f4994f02640 1 -- 172.21.15.17:0/92992852 learned_addr learned my addr 172.21.15.17:0/92992852 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:44.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.124+0000 7fd3daffd640 1 -- 172.21.15.17:0/2727583148 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd3e0005d10 con 0x7fd3e40c6200 2024-09-05T07:29:44.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.124+0000 7fd3daffd640 1 --2- 172.21.15.17:0/2727583148 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd3c806be80 0x7fd3c806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:44.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.124+0000 7f4994f02640 1 -- 172.21.15.17:0/92992852 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4990073ee0 msgr2=0x7f499015b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:44.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.124+0000 7f4994f02640 1 --2- 172.21.15.17:0/92992852 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4990073ee0 0x7f499015b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.124+0000 7f4994f02640 1 -- 172.21.15.17:0/92992852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49900c8e40 msgr2=0x7f49900c6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:44.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.124+0000 7f4994f02640 1 --2- 172.21.15.17:0/92992852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49900c8e40 0x7f49900c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.124+0000 7f4994f02640 1 -- 172.21.15.17:0/92992852 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f499015aec0 con 0x7f4990073b00 2024-09-05T07:29:44.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.124+0000 7fd3e9a41640 1 --2- 172.21.15.17:0/2727583148 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd3c806be80 0x7fd3c806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:44.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.125+0000 7fd3e9a41640 1 --2- 172.21.15.17:0/2727583148 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd3c806be80 0x7fd3c806e340 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc034000 tx=0x7fd3dc02c000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:44.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.126+0000 7f4994f02640 1 --2- 172.21.15.17:0/92992852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4990073b00 0x7f49900c4280 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4984009890 tx=0x7f49840046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:44.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.130+0000 7f498d7fa640 1 -- 172.21.15.17:0/92992852 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4984042020 con 0x7f4990073b00 2024-09-05T07:29:44.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.130+0000 7f498d7fa640 1 -- 172.21.15.17:0/92992852 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4984030780 con 0x7f4990073b00 2024-09-05T07:29:44.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.130+0000 7f4997166640 1 -- 172.21.15.17:0/92992852 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49900c76e0 con 0x7f4990073b00 2024-09-05T07:29:44.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.130+0000 7f498d7fa640 1 -- 172.21.15.17:0/92992852 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4984037040 con 0x7f4990073b00 2024-09-05T07:29:44.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.130+0000 7f4997166640 1 -- 172.21.15.17:0/92992852 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49900c7140 con 0x7f4990073b00 2024-09-05T07:29:44.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.131+0000 7f4997166640 1 -- 172.21.15.17:0/92992852 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49900c7400 con 0x7f4990073b00 2024-09-05T07:29:44.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.139+0000 7fd3daffd640 1 -- 172.21.15.17:0/2727583148 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd3e0058210 con 0x7fd3e40c6200 2024-09-05T07:29:44.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.139+0000 7fd3daffd640 1 -- 172.21.15.17:0/2727583148 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd3e0010040 con 0x7fd3e40c6200 2024-09-05T07:29:44.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.142+0000 7f8e4d7e7640 1 --2- 172.21.15.17:0/3014206590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e480afde0 0x7f8e48067d30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8e38009870 tx=0x7f8e3802a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4afb18832a217260 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:44.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.142+0000 7f417359e640 1 -- 172.21.15.17:0/765032364 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f416c046380 con 0x7f416c04bf20 2024-09-05T07:29:44.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.210+0000 7f8e4cfe6640 1 -- 172.21.15.17:0/3014206590 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e38037070 con 0x7f8e480afde0 2024-09-05T07:29:44.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.210+0000 7f8e4cfe6640 1 -- 172.21.15.17:0/3014206590 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e38032440 con 0x7f8e480afde0 2024-09-05T07:29:44.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.210+0000 7f8e4cfe6640 1 -- 172.21.15.17:0/3014206590 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e38032810 con 0x7f8e480afde0 2024-09-05T07:29:44.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.211+0000 7f8e5024c640 1 -- 172.21.15.17:0/3014206590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e480afde0 msgr2=0x7f8e48067d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:44.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.211+0000 7f8e5024c640 1 --2- 172.21.15.17:0/3014206590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e480afde0 0x7f8e48067d30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8e38009870 tx=0x7f8e3802a200 comp rx=0 tx=0).stop 2024-09-05T07:29:44.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.211+0000 7f8e5024c640 1 -- 172.21.15.17:0/3014206590 shutdown_connections 2024-09-05T07:29:44.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.211+0000 7f8e5024c640 1 --2- 172.21.15.17:0/3014206590 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e48072820 0x7f8e4815de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.211+0000 7f8e5024c640 1 --2- 172.21.15.17:0/3014206590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e480afde0 0x7f8e48067d30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.211+0000 7f8e5024c640 1 -- 172.21.15.17:0/3014206590 >> 172.21.15.17:0/3014206590 conn(0x7f8e480cd260 msgr2=0x7f8e480cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:44.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.211+0000 7f8e5024c640 1 -- 172.21.15.17:0/3014206590 shutdown_connections 2024-09-05T07:29:44.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.211+0000 7f8e5024c640 1 -- 172.21.15.17:0/3014206590 wait complete. 2024-09-05T07:29:44.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.213+0000 7f8e5024c640 1 Processor -- start 2024-09-05T07:29:44.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.213+0000 7f8e5024c640 1 -- start start 2024-09-05T07:29:44.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.214+0000 7f8e5024c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e48067950 0x7f8e4814b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:44.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.214+0000 7f8e5024c640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e48072820 0x7f8e4814d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:44.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.214+0000 7f8e5024c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e480afde0 0x7f8e4814d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:44.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.214+0000 7f8e5024c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4815e520 con 0x7f8e480afde0 2024-09-05T07:29:44.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.214+0000 7f8e5024c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4815e3a0 con 0x7f8e48067950 2024-09-05T07:29:44.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.214+0000 7f8e5024c640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f8e4815e6a0 con 0x7f8e48072820 2024-09-05T07:29:44.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.226+0000 7f8e4e7e9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e480afde0 0x7f8e4814d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:44.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.226+0000 7f8e4e7e9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e480afde0 0x7f8e4814d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60728/0 (socket says 172.21.15.17:60728) 2024-09-05T07:29:44.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.226+0000 7f8e4e7e9640 1 -- 172.21.15.17:0/617796423 learned_addr learned my addr 172.21.15.17:0/617796423 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:44.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.230+0000 7f8e4e7e9640 1 -- 172.21.15.17:0/617796423 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e48072820 msgr2=0x7f8e4814d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:44.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.230+0000 7f8e4e7e9640 1 --2- 172.21.15.17:0/617796423 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e48072820 0x7f8e4814d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.230+0000 7f8e4e7e9640 1 -- 172.21.15.17:0/617796423 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e48067950 msgr2=0x7f8e4814b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:44.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.230+0000 7f8e4e7e9640 1 --2- 172.21.15.17:0/617796423 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e48067950 0x7f8e4814b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.230+0000 7f8e4e7e9640 1 -- 172.21.15.17:0/617796423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e481587c0 con 0x7f8e480afde0 2024-09-05T07:29:44.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.232+0000 7f3079ffb640 1 -- 172.21.15.17:0/4003094634 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307c017070 con 0x7f308415ec40 2024-09-05T07:29:44.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.232+0000 7f3079ffb640 1 -- 172.21.15.17:0/4003094634 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f307c003da0 con 0x7f308415ec40 2024-09-05T07:29:44.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.232+0000 7f308b7c4640 1 -- 172.21.15.17:0/4003094634 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30841f4b30 con 0x7f308415ec40 2024-09-05T07:29:44.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.232+0000 7f308b7c4640 1 -- 172.21.15.17:0/4003094634 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f30840c52a0 con 0x7f308415ec40 2024-09-05T07:29:44.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.232+0000 7f8e4e7e9640 1 --2- 172.21.15.17:0/617796423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e480afde0 0x7f8e4814d850 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8e4000b9a0 tx=0x7f8e4000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:44.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.233+0000 7f308b7c4640 1 -- 172.21.15.17:0/4003094634 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30840732a0 con 0x7f308415ec40 2024-09-05T07:29:44.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.238+0000 7f8e3e7fc640 1 -- 172.21.15.17:0/617796423 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e40019070 con 0x7f8e480afde0 2024-09-05T07:29:44.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.238+0000 7f8e3e7fc640 1 -- 172.21.15.17:0/617796423 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e4000cbc0 con 0x7f8e480afde0 2024-09-05T07:29:44.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.238+0000 7f8e5024c640 1 -- 172.21.15.17:0/617796423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e48158aa0 con 0x7f8e480afde0 2024-09-05T07:29:44.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.238+0000 7f8e3e7fc640 1 -- 172.21.15.17:0/617796423 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e40014440 con 0x7f8e480afde0 2024-09-05T07:29:44.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.238+0000 7f8e5024c640 1 -- 172.21.15.17:0/617796423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e48159060 con 0x7f8e480afde0 2024-09-05T07:29:44.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.239+0000 7f8e5024c640 1 -- 172.21.15.17:0/617796423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e480736f0 con 0x7f8e480afde0 2024-09-05T07:29:44.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.303+0000 7fdac8ff9640 1 -- 172.21.15.17:0/1922784232 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fdab4056e10 con 0x7fdacc0cd2d0 2024-09-05T07:29:44.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.315+0000 7f3239b73640 1 --2- 172.21.15.17:0/3016121293 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3234073ee0 0x7f3234153c10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f322800b480 tx=0x7f322800b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:44.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.315+0000 7f3079ffb640 1 -- 172.21.15.17:0/4003094634 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307c021060 con 0x7f308415ec40 2024-09-05T07:29:44.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.315+0000 7fdac8ff9640 1 -- 172.21.15.17:0/1922784232 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdab40010c0 con 0x7fdacc0cd2d0 2024-09-05T07:29:44.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.324+0000 7fc28819f640 1 -- 172.21.15.17:0/1855809025 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fc2800af560 con 0x7fc2801557a0 2024-09-05T07:29:44.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.325+0000 7fd3ec4a6640 1 -- 172.21.15.17:0/2727583148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fd3e4158150 con 0x7fd3e40c6200 2024-09-05T07:29:44.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.405+0000 7f498d7fa640 1 -- 172.21.15.17:0/92992852 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4984045020 con 0x7f4990073b00 2024-09-05T07:29:44.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.405+0000 7f498d7fa640 1 --2- 172.21.15.17:0/92992852 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f497406be80 0x7f497406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:44.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.405+0000 7f498ffff640 1 --2- 172.21.15.17:0/92992852 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f497406be80 0x7f497406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:44.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.406+0000 7f498ffff640 1 --2- 172.21.15.17:0/92992852 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f497406be80 0x7f497406e340 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f49901eca60 tx=0x7f497c007930 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:44.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.409+0000 7f498d7fa640 1 -- 172.21.15.17:0/92992852 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f498403bde0 con 0x7f4990073b00 2024-09-05T07:29:44.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.420+0000 7f498d7fa640 1 -- 172.21.15.17:0/92992852 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f498404c030 con 0x7f4990073b00 2024-09-05T07:29:44.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.433+0000 7fc2767fc640 1 -- 172.21.15.17:0/1855809025 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc27805a020 con 0x7fc2801557a0 2024-09-05T07:29:44.434 INFO:teuthology.orchestra.run.smithi017.stdout:64424509450 2024-09-05T07:29:44.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.435+0000 7fc28819f640 1 -- 172.21.15.17:0/1855809025 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc26406be80 msgr2=0x7fc26406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:44.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.436+0000 7fc28819f640 1 --2- 172.21.15.17:0/1855809025 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc26406be80 0x7fc26406e340 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc27c034000 tx=0x7fc27c02c000 comp rx=0 tx=0).stop 2024-09-05T07:29:44.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.436+0000 7fc28819f640 1 -- 172.21.15.17:0/1855809025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2801557a0 msgr2=0x7fc280155c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:44.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.436+0000 7fc28819f640 1 --2- 172.21.15.17:0/1855809025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2801557a0 0x7fc280155c50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc2800c7920 tx=0x7fc27800e390 comp rx=0 tx=0).stop 2024-09-05T07:29:44.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.436+0000 7fc28819f640 1 -- 172.21.15.17:0/1855809025 shutdown_connections 2024-09-05T07:29:44.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.436+0000 7fc28819f640 1 --2- 172.21.15.17:0/1855809025 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc26406be80 0x7fc26406e340 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.436+0000 7fc28819f640 1 --2- 172.21.15.17:0/1855809025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2801557a0 0x7fc280155c50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.436+0000 7fc28819f640 1 --2- 172.21.15.17:0/1855809025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2800b0660 0x7fc2800b0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.436+0000 7fc28819f640 1 --2- 172.21.15.17:0/1855809025 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc28015c980 0x7fc28015cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.436+0000 7fc28819f640 1 -- 172.21.15.17:0/1855809025 >> 172.21.15.17:0/1855809025 conn(0x7fc2800cd260 msgr2=0x7fc28015dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:44.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.436+0000 7fc28819f640 1 -- 172.21.15.17:0/1855809025 shutdown_connections 2024-09-05T07:29:44.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.436+0000 7fc28819f640 1 -- 172.21.15.17:0/1855809025 wait complete. 2024-09-05T07:29:44.451 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.2 2024-09-05T07:29:44.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.511+0000 7fdad29d8640 1 -- 172.21.15.17:0/1922784232 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fdacc072990 con 0x7fdacc0cd2d0 2024-09-05T07:29:44.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.564+0000 7f8e3e7fc640 1 -- 172.21.15.17:0/617796423 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8e4001c070 con 0x7f8e480afde0 2024-09-05T07:29:44.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.566+0000 7f8e3e7fc640 1 --2- 172.21.15.17:0/617796423 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f8e2c06be30 0x7f8e2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:44.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.566+0000 7f8e4dfe8640 1 --2- 172.21.15.17:0/617796423 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f8e2c06be30 0x7f8e2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:44.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.566+0000 7f8e4dfe8640 1 --2- 172.21.15.17:0/617796423 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f8e2c06be30 0x7f8e2c06e2f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8e44001560 tx=0x7f8e44007990 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:44.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.578+0000 7f8e3e7fc640 1 -- 172.21.15.17:0/617796423 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8e40057410 con 0x7f8e480afde0 2024-09-05T07:29:44.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.580+0000 7f8e3e7fc640 1 -- 172.21.15.17:0/617796423 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8e480736f0 con 0x7f8e480afde0 2024-09-05T07:29:44.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.592+0000 7f3079ffb640 1 -- 172.21.15.17:0/4003094634 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f307c01a070 con 0x7f308415ec40 2024-09-05T07:29:44.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.592+0000 7f3079ffb640 1 --2- 172.21.15.17:0/4003094634 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f306806be80 0x7f306806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:44.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.593+0000 7f3089560640 1 --2- 172.21.15.17:0/4003094634 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f306806be80 0x7f306806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:44.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.593+0000 7f3089560640 1 --2- 172.21.15.17:0/4003094634 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f306806be80 0x7f306806e340 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3080009710 tx=0x7f3080006c90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:44.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.597+0000 7f3079ffb640 1 -- 172.21.15.17:0/4003094634 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f307c056d50 con 0x7f308415ec40 2024-09-05T07:29:44.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.600+0000 7fd3daffd640 1 -- 172.21.15.17:0/2727583148 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd3e005a870 con 0x7fd3e40c6200 2024-09-05T07:29:44.601 INFO:teuthology.orchestra.run.smithi017.stdout:60129542154 2024-09-05T07:29:44.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.602+0000 7fd3ec4a6640 1 -- 172.21.15.17:0/2727583148 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd3c806be80 msgr2=0x7fd3c806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:44.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.602+0000 7fd3ec4a6640 1 --2- 172.21.15.17:0/2727583148 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd3c806be80 0x7fd3c806e340 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc034000 tx=0x7fd3dc02c000 comp rx=0 tx=0).stop 2024-09-05T07:29:44.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.602+0000 7fd3ec4a6640 1 -- 172.21.15.17:0/2727583148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3e40c6200 msgr2=0x7fd3e413b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:44.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.602+0000 7fd3ec4a6640 1 --2- 172.21.15.17:0/2727583148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3e40c6200 0x7fd3e413b7e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd3e000efc0 tx=0x7fd3e000c490 comp rx=0 tx=0).stop 2024-09-05T07:29:44.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.603+0000 7fd3ec4a6640 1 -- 172.21.15.17:0/2727583148 shutdown_connections 2024-09-05T07:29:44.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.603+0000 7fd3ec4a6640 1 --2- 172.21.15.17:0/2727583148 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd3c806be80 0x7fd3c806e340 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.603+0000 7fd3ec4a6640 1 --2- 172.21.15.17:0/2727583148 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd3e41517e0 0x7fd3e413cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.603+0000 7fd3ec4a6640 1 --2- 172.21.15.17:0/2727583148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3e40c97e0 0x7fd3e4150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.603+0000 7fd3ec4a6640 1 --2- 172.21.15.17:0/2727583148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3e40c6200 0x7fd3e413b7e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.603+0000 7fd3ec4a6640 1 -- 172.21.15.17:0/2727583148 >> 172.21.15.17:0/2727583148 conn(0x7fd3e40c8cf0 msgr2=0x7fd3e4073730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:44.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.603+0000 7fd3ec4a6640 1 -- 172.21.15.17:0/2727583148 shutdown_connections 2024-09-05T07:29:44.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.603+0000 7fd3ec4a6640 1 -- 172.21.15.17:0/2727583148 wait complete. 2024-09-05T07:29:44.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.608+0000 7f3079ffb640 1 -- 172.21.15.17:0/4003094634 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f307c058cb0 con 0x7f308415ec40 2024-09-05T07:29:44.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.608+0000 7f4997166640 1 -- 172.21.15.17:0/92992852 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f49900ccd60 con 0x7f4990073b00 2024-09-05T07:29:44.615 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.6 2024-09-05T07:29:44.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.615+0000 7f498d7fa640 1 -- 172.21.15.17:0/92992852 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f499015aec0 con 0x7f4990073b00 2024-09-05T07:29:44.616 INFO:teuthology.orchestra.run.smithi017.stdout:64424509450 2024-09-05T07:29:44.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.617+0000 7f4997166640 1 -- 172.21.15.17:0/92992852 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f497406be80 msgr2=0x7f497406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:44.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.617+0000 7f4997166640 1 --2- 172.21.15.17:0/92992852 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f497406be80 0x7f497406e340 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f49901eca60 tx=0x7f497c007930 comp rx=0 tx=0).stop 2024-09-05T07:29:44.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.617+0000 7f4997166640 1 -- 172.21.15.17:0/92992852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4990073b00 msgr2=0x7f49900c4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:44.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.617+0000 7f4997166640 1 --2- 172.21.15.17:0/92992852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4990073b00 0x7f49900c4280 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4984009890 tx=0x7f49840046c0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.617+0000 7f4997166640 1 -- 172.21.15.17:0/92992852 shutdown_connections 2024-09-05T07:29:44.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.617+0000 7f4997166640 1 --2- 172.21.15.17:0/92992852 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f497406be80 0x7f497406e340 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.617+0000 7f4997166640 1 --2- 172.21.15.17:0/92992852 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4990073ee0 0x7f499015b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.617+0000 7f4997166640 1 --2- 172.21.15.17:0/92992852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49900c8e40 0x7f49900c6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.617+0000 7f4997166640 1 --2- 172.21.15.17:0/92992852 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4990073b00 0x7f49900c4280 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.617+0000 7f4997166640 1 -- 172.21.15.17:0/92992852 >> 172.21.15.17:0/92992852 conn(0x7f49900cd260 msgr2=0x7f4990067950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:44.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.617+0000 7f4997166640 1 -- 172.21.15.17:0/92992852 shutdown_connections 2024-09-05T07:29:44.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.617+0000 7f4997166640 1 -- 172.21.15.17:0/92992852 wait complete. 2024-09-05T07:29:44.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.627+0000 7f3226ffd640 1 -- 172.21.15.17:0/3016121293 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3228014070 con 0x7f3234073ee0 2024-09-05T07:29:44.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.627+0000 7f3226ffd640 1 -- 172.21.15.17:0/3016121293 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3228010870 con 0x7f3234073ee0 2024-09-05T07:29:44.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.627+0000 7f3226ffd640 1 -- 172.21.15.17:0/3016121293 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3228010c60 con 0x7f3234073ee0 2024-09-05T07:29:44.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.627+0000 7f323c5d8640 1 -- 172.21.15.17:0/3016121293 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3234159b20 con 0x7f3234073ee0 2024-09-05T07:29:44.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.627+0000 7f323c5d8640 1 -- 172.21.15.17:0/3016121293 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f323415a0e0 con 0x7f3234073ee0 2024-09-05T07:29:44.629 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.7 2024-09-05T07:29:44.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.628+0000 7f323c5d8640 1 -- 172.21.15.17:0/3016121293 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32340caba0 con 0x7f3234073ee0 2024-09-05T07:29:44.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.778+0000 7f8e5024c640 1 -- 172.21.15.17:0/617796423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f8e4815de60 con 0x7f8e480afde0 2024-09-05T07:29:44.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.782+0000 7f8e3e7fc640 1 -- 172.21.15.17:0/617796423 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8e40023020 con 0x7f8e480afde0 2024-09-05T07:29:44.783 INFO:teuthology.orchestra.run.smithi017.stdout:64424509449 2024-09-05T07:29:44.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.785+0000 7f8e5024c640 1 -- 172.21.15.17:0/617796423 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f8e2c06be30 msgr2=0x7f8e2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:44.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.785+0000 7f8e5024c640 1 --2- 172.21.15.17:0/617796423 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f8e2c06be30 0x7f8e2c06e2f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8e44001560 tx=0x7f8e44007990 comp rx=0 tx=0).stop 2024-09-05T07:29:44.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.785+0000 7f8e5024c640 1 -- 172.21.15.17:0/617796423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e480afde0 msgr2=0x7f8e4814d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:44.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.785+0000 7f8e5024c640 1 --2- 172.21.15.17:0/617796423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e480afde0 0x7f8e4814d850 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8e4000b9a0 tx=0x7f8e4000be60 comp rx=0 tx=0).stop 2024-09-05T07:29:44.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.785+0000 7f8e5024c640 1 -- 172.21.15.17:0/617796423 shutdown_connections 2024-09-05T07:29:44.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.785+0000 7f8e5024c640 1 --2- 172.21.15.17:0/617796423 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f8e2c06be30 0x7f8e2c06e2f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.785+0000 7f8e5024c640 1 --2- 172.21.15.17:0/617796423 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8e48072820 0x7f8e4814d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.785+0000 7f8e5024c640 1 --2- 172.21.15.17:0/617796423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e480afde0 0x7f8e4814d850 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.785+0000 7f8e5024c640 1 --2- 172.21.15.17:0/617796423 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e48067950 0x7f8e4814b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:44.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.785+0000 7f8e5024c640 1 -- 172.21.15.17:0/617796423 >> 172.21.15.17:0/617796423 conn(0x7f8e480cd260 msgr2=0x7f8e480cc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:44.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.785+0000 7f8e5024c640 1 -- 172.21.15.17:0/617796423 shutdown_connections 2024-09-05T07:29:44.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.785+0000 7f8e5024c640 1 -- 172.21.15.17:0/617796423 wait complete. 2024-09-05T07:29:44.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.795+0000 7f308b7c4640 1 -- 172.21.15.17:0/4003094634 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f30840c7390 con 0x7f308415ec40 2024-09-05T07:29:44.797 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.0 2024-09-05T07:29:44.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.903+0000 7fdac8ff9640 1 -- 172.21.15.17:0/1922784232 <== mon.2 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdab4058d70 con 0x7fdacc0cd2d0 2024-09-05T07:29:45.205 INFO:teuthology.orchestra.run.smithi017.stdout:64424509449 2024-09-05T07:29:45.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.905+0000 7fdad29d8640 1 -- 172.21.15.17:0/1922784232 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fdaac06be80 msgr2=0x7fdaac06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:45.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.905+0000 7fdad29d8640 1 --2- 172.21.15.17:0/1922784232 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fdaac06be80 0x7fdaac06e340 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdabc001560 tx=0x7fdabc007990 comp rx=0 tx=0).stop 2024-09-05T07:29:45.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.905+0000 7fdad29d8640 1 -- 172.21.15.17:0/1922784232 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdacc0cd2d0 msgr2=0x7fdacc1f3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:45.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.905+0000 7fdad29d8640 1 --2- 172.21.15.17:0/1922784232 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdacc0cd2d0 0x7fdacc1f3bb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdab400c400 tx=0x7fdab400c8c0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.905+0000 7fdad29d8640 1 -- 172.21.15.17:0/1922784232 shutdown_connections 2024-09-05T07:29:45.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.905+0000 7fdad29d8640 1 --2- 172.21.15.17:0/1922784232 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fdaac06be80 0x7fdaac06e340 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.905+0000 7fdad29d8640 1 --2- 172.21.15.17:0/1922784232 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdacc0cd2d0 0x7fdacc1f3bb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.905+0000 7fdad29d8640 1 --2- 172.21.15.17:0/1922784232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdacc157f10 0x7fdacc1f40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.905+0000 7fdad29d8640 1 --2- 172.21.15.17:0/1922784232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdacc0ccef0 0x7fdacc1e3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.905+0000 7fdad29d8640 1 -- 172.21.15.17:0/1922784232 >> 172.21.15.17:0/1922784232 conn(0x7fdacc072230 msgr2=0x7fdacc155b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:45.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.905+0000 7fdad29d8640 1 -- 172.21.15.17:0/1922784232 shutdown_connections 2024-09-05T07:29:45.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.905+0000 7fdad29d8640 1 -- 172.21.15.17:0/1922784232 wait complete. 2024-09-05T07:29:45.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.905+0000 7f4162ffd640 1 -- 172.21.15.17:0/765032364 <== mon.2 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f416c046380 con 0x7f416c04bf20 2024-09-05T07:29:45.210 INFO:teuthology.orchestra.run.smithi017.stdout:60129542153 2024-09-05T07:29:45.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.908+0000 7f417359e640 1 -- 172.21.15.17:0/765032364 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f415406be60 msgr2=0x7f415406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:45.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.908+0000 7f417359e640 1 --2- 172.21.15.17:0/765032364 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f415406be60 0x7f415406e320 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4174000b60 tx=0x7f417406e040 comp rx=0 tx=0).stop 2024-09-05T07:29:45.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.908+0000 7f417359e640 1 -- 172.21.15.17:0/765032364 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f416c04bf20 msgr2=0x7f416c04e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:45.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.908+0000 7f417359e640 1 --2- 172.21.15.17:0/765032364 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f416c04bf20 0x7f416c04e8d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f416400c440 tx=0x7f416400c900 comp rx=0 tx=0).stop 2024-09-05T07:29:45.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.908+0000 7f417359e640 1 -- 172.21.15.17:0/765032364 shutdown_connections 2024-09-05T07:29:45.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.908+0000 7f417359e640 1 --2- 172.21.15.17:0/765032364 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f415406be60 0x7f415406e320 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.908+0000 7f417359e640 1 --2- 172.21.15.17:0/765032364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f416c0e6b90 0x7f416c0e5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.908+0000 7f417359e640 1 --2- 172.21.15.17:0/765032364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f416c0e6270 0x7f416c0e4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.908+0000 7f417359e640 1 --2- 172.21.15.17:0/765032364 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f416c04bf20 0x7f416c04e8d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.908+0000 7f417359e640 1 -- 172.21.15.17:0/765032364 >> 172.21.15.17:0/765032364 conn(0x7f416c04fc50 msgr2=0x7f416c0dbea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:45.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.908+0000 7f417359e640 1 -- 172.21.15.17:0/765032364 shutdown_connections 2024-09-05T07:29:45.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.908+0000 7f417359e640 1 -- 172.21.15.17:0/765032364 wait complete. 2024-09-05T07:29:45.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.909+0000 7f3079ffb640 1 -- 172.21.15.17:0/4003094634 <== mon.2 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f307c05cfb0 con 0x7f308415ec40 2024-09-05T07:29:45.214 INFO:teuthology.orchestra.run.smithi017.stdout:64424509450 2024-09-05T07:29:45.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.912+0000 7f308b7c4640 1 -- 172.21.15.17:0/4003094634 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f306806be80 msgr2=0x7f306806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:45.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.912+0000 7f308b7c4640 1 --2- 172.21.15.17:0/4003094634 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f306806be80 0x7f306806e340 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3080009710 tx=0x7f3080006c90 comp rx=0 tx=0).stop 2024-09-05T07:29:45.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.912+0000 7f308b7c4640 1 -- 172.21.15.17:0/4003094634 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f308415ec40 msgr2=0x7f3084156dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:45.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.912+0000 7f308b7c4640 1 --2- 172.21.15.17:0/4003094634 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f308415ec40 0x7f3084156dd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f307c00c7b0 tx=0x7f307c00cc70 comp rx=0 tx=0).stop 2024-09-05T07:29:45.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.912+0000 7f308b7c4640 1 -- 172.21.15.17:0/4003094634 shutdown_connections 2024-09-05T07:29:45.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.912+0000 7f308b7c4640 1 --2- 172.21.15.17:0/4003094634 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f306806be80 0x7f306806e340 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.912+0000 7f308b7c4640 1 --2- 172.21.15.17:0/4003094634 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f308415ec40 0x7f3084156dd0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.912+0000 7f308b7c4640 1 --2- 172.21.15.17:0/4003094634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f308415e560 0x7f308414d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.912+0000 7f308b7c4640 1 --2- 172.21.15.17:0/4003094634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3084154f10 0x7f3084155b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.912+0000 7f308b7c4640 1 -- 172.21.15.17:0/4003094634 >> 172.21.15.17:0/4003094634 conn(0x7f308406fac0 msgr2=0x7f30840c7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:45.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.912+0000 7f308b7c4640 1 -- 172.21.15.17:0/4003094634 shutdown_connections 2024-09-05T07:29:45.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.912+0000 7f308b7c4640 1 -- 172.21.15.17:0/4003094634 wait complete. 2024-09-05T07:29:45.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.1 2024-09-05T07:29:45.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.4 2024-09-05T07:29:45.219 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.3 2024-09-05T07:29:45.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.927+0000 7f3226ffd640 1 -- 172.21.15.17:0/3016121293 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3228017070 con 0x7f3234073ee0 2024-09-05T07:29:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.927+0000 7f3226ffd640 1 --2- 172.21.15.17:0/3016121293 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f321806be80 0x7f321806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.928+0000 7f323a374640 1 --2- 172.21.15.17:0/3016121293 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f321806be80 0x7f321806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.928+0000 7f323a374640 1 --2- 172.21.15.17:0/3016121293 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f321806be80 0x7f321806e340 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3230034000 tx=0x7f323002c000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.931+0000 7f3226ffd640 1 -- 172.21.15.17:0/3016121293 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f3228057460 con 0x7f3234073ee0 2024-09-05T07:29:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:44.943+0000 7f3226ffd640 1 -- 172.21.15.17:0/3016121293 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3228059ac0 con 0x7f3234073ee0 2024-09-05T07:29:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.154+0000 7f323c5d8640 1 -- 172.21.15.17:0/3016121293 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f3234072800 con 0x7f3234073ee0 2024-09-05T07:29:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.158+0000 7f3226ffd640 1 -- 172.21.15.17:0/3016121293 <== mon.2 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f32280593c0 con 0x7f3234073ee0 2024-09-05T07:29:45.222 INFO:teuthology.orchestra.run.smithi017.stdout:68719476748 2024-09-05T07:29:45.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.160+0000 7f323c5d8640 1 -- 172.21.15.17:0/3016121293 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f321806be80 msgr2=0x7f321806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:45.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.160+0000 7f323c5d8640 1 --2- 172.21.15.17:0/3016121293 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f321806be80 0x7f321806e340 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3230034000 tx=0x7f323002c000 comp rx=0 tx=0).stop 2024-09-05T07:29:45.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.160+0000 7f323c5d8640 1 -- 172.21.15.17:0/3016121293 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3234073ee0 msgr2=0x7f3234153c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:45.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.160+0000 7f323c5d8640 1 --2- 172.21.15.17:0/3016121293 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3234073ee0 0x7f3234153c10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f322800b480 tx=0x7f322800b940 comp rx=0 tx=0).stop 2024-09-05T07:29:45.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.160+0000 7f323c5d8640 1 -- 172.21.15.17:0/3016121293 shutdown_connections 2024-09-05T07:29:45.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.160+0000 7f323c5d8640 1 --2- 172.21.15.17:0/3016121293 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f321806be80 0x7f321806e340 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.160+0000 7f323c5d8640 1 --2- 172.21.15.17:0/3016121293 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3234073ee0 0x7f3234153c10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.160+0000 7f323c5d8640 1 --2- 172.21.15.17:0/3016121293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32340c8e40 0x7f32341ee7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.160+0000 7f323c5d8640 1 --2- 172.21.15.17:0/3016121293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3234073b00 0x7f32340c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.160+0000 7f323c5d8640 1 -- 172.21.15.17:0/3016121293 >> 172.21.15.17:0/3016121293 conn(0x7f32340cd260 msgr2=0x7f3234156e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:45.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.160+0000 7f323c5d8640 1 -- 172.21.15.17:0/3016121293 shutdown_connections 2024-09-05T07:29:45.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.160+0000 7f323c5d8640 1 -- 172.21.15.17:0/3016121293 wait complete. 2024-09-05T07:29:45.224 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476748 got 68719476748 for osd.5 2024-09-05T07:29:45.225 DEBUG:teuthology.parallel:result is None 2024-09-05T07:29:45.452 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-05T07:29:45.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.556+0000 7fd5c37e8640 1 Processor -- start 2024-09-05T07:29:45.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.556+0000 7fd5c37e8640 1 -- start start 2024-09-05T07:29:45.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.557+0000 7fd5c37e8640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd5bc0d07a0 0x7fd5bc0cb870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:45.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.557+0000 7fd5c37e8640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd5bc0d0b80 0x7fd5bc1546a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:45.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.557+0000 7fd5c37e8640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5bc0cbdb0 con 0x7fd5bc0cabb0 2024-09-05T07:29:45.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.557+0000 7fd5c37e8640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fd5bc0cb160 con 0x7fd5bc0d07a0 2024-09-05T07:29:45.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.557+0000 7fd5c37e8640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fd5bc15a9a0 con 0x7fd5bc0d0b80 2024-09-05T07:29:45.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.557+0000 7fd5c0d83640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd5bc0d0b80 0x7fd5bc1546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:45.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.557+0000 7fd5c1584640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd5bc0d07a0 0x7fd5bc0cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:45.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.558+0000 7fd5c0d83640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd5bc0d0b80 0x7fd5bc1546a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:60024/0 (socket says 172.21.15.17:60024) 2024-09-05T07:29:45.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.558+0000 7fd5c0d83640 1 -- 172.21.15.17:0/756146546 learned_addr learned my addr 172.21.15.17:0/756146546 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:45.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.560+0000 7fd5c0d83640 1 -- 172.21.15.17:0/756146546 >> v2:172.21.15.17:3300/0 conn(0x7fd5bc0d07a0 msgr2=0x7fd5bc0cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:45.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.560+0000 7fd5c0d83640 1 --2- 172.21.15.17:0/756146546 >> v2:172.21.15.17:3300/0 conn(0x7fd5bc0d07a0 0x7fd5bc0cb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.560+0000 7fd5c0d83640 1 -- 172.21.15.17:0/756146546 >> v1:172.21.15.17:6789/0 conn(0x7fd5bc0cabb0 legacy=0x7fd5bc15de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:45.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.560+0000 7fd5c0d83640 1 -- 172.21.15.17:0/756146546 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5bc15ac80 con 0x7fd5bc0d0b80 2024-09-05T07:29:45.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.562+0000 7fd5c0d83640 1 --2- 172.21.15.17:0/756146546 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd5bc0d0b80 0x7fd5bc1546a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc0cb2e0 tx=0x7fd5ac02a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4824b2c5a2180e30 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:45.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.566+0000 7fd5b3fff640 1 -- 172.21.15.17:0/756146546 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac037070 con 0x7fd5bc0d0b80 2024-09-05T07:29:45.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.566+0000 7fd5b3fff640 1 -- 172.21.15.17:0/756146546 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5ac032440 con 0x7fd5bc0d0b80 2024-09-05T07:29:45.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.566+0000 7fd5b3fff640 1 -- 172.21.15.17:0/756146546 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac032810 con 0x7fd5bc0d0b80 2024-09-05T07:29:45.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.567+0000 7fd5c37e8640 1 -- 172.21.15.17:0/756146546 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd5bc0d0b80 msgr2=0x7fd5bc1546a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:45.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.567+0000 7fd5c37e8640 1 --2- 172.21.15.17:0/756146546 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd5bc0d0b80 0x7fd5bc1546a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc0cb2e0 tx=0x7fd5ac02a250 comp rx=0 tx=0).stop 2024-09-05T07:29:45.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.567+0000 7fd5c37e8640 1 -- 172.21.15.17:0/756146546 shutdown_connections 2024-09-05T07:29:45.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.567+0000 7fd5c37e8640 1 --2- 172.21.15.17:0/756146546 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd5bc0d0b80 0x7fd5bc1546a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.567+0000 7fd5c37e8640 1 --2- 172.21.15.17:0/756146546 >> v2:172.21.15.17:3300/0 conn(0x7fd5bc0d07a0 0x7fd5bc0cb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.567+0000 7fd5c37e8640 1 -- 172.21.15.17:0/756146546 >> 172.21.15.17:0/756146546 conn(0x7fd5bc073710 msgr2=0x7fd5bc073b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:45.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.567+0000 7fd5c37e8640 1 -- 172.21.15.17:0/756146546 shutdown_connections 2024-09-05T07:29:45.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.567+0000 7fd5c37e8640 1 -- 172.21.15.17:0/756146546 wait complete. 2024-09-05T07:29:45.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.568+0000 7fd5c37e8640 1 Processor -- start 2024-09-05T07:29:45.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.568+0000 7fd5c37e8640 1 -- start start 2024-09-05T07:29:45.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.568+0000 7fd5c37e8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5bc0cabb0 0x7fd5bc0c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:45.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.568+0000 7fd5c37e8640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd5bc0d07a0 0x7fd5bc0c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:45.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.568+0000 7fd5c37e8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5bc0d0b80 0x7fd5bc14db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:45.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.568+0000 7fd5c37e8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd5bc06c9b0 con 0x7fd5bc0cabb0 2024-09-05T07:29:45.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.569+0000 7fd5c37e8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd5bc15b240 con 0x7fd5bc0d0b80 2024-09-05T07:29:45.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.569+0000 7fd5c37e8640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fd5bc06cb30 con 0x7fd5bc0d07a0 2024-09-05T07:29:45.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.569+0000 7fd5c1584640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5bc0cabb0 0x7fd5bc0c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:45.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.569+0000 7fd5c0d83640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd5bc0d07a0 0x7fd5bc0c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:45.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.569+0000 7fd5c1d85640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5bc0d0b80 0x7fd5bc14db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:45.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.569+0000 7fd5c1584640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5bc0cabb0 0x7fd5bc0c8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60736/0 (socket says 172.21.15.17:60736) 2024-09-05T07:29:45.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.569+0000 7fd5c1584640 1 -- 172.21.15.17:0/4259232280 learned_addr learned my addr 172.21.15.17:0/4259232280 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:45.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.573+0000 7fd5c1584640 1 -- 172.21.15.17:0/4259232280 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd5bc0d07a0 msgr2=0x7fd5bc0c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:45.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.573+0000 7fd5c1584640 1 --2- 172.21.15.17:0/4259232280 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd5bc0d07a0 0x7fd5bc0c8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.573+0000 7fd5c1584640 1 -- 172.21.15.17:0/4259232280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5bc0d0b80 msgr2=0x7fd5bc14db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:45.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.573+0000 7fd5c1584640 1 --2- 172.21.15.17:0/4259232280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5bc0d0b80 0x7fd5bc14db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.573+0000 7fd5c1584640 1 -- 172.21.15.17:0/4259232280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5bc1f08e0 con 0x7fd5bc0cabb0 2024-09-05T07:29:45.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.575+0000 7fd5c1584640 1 --2- 172.21.15.17:0/4259232280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5bc0cabb0 0x7fd5bc0c8140 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd5b800e9b0 tx=0x7fd5b800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:45.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.579+0000 7fd5b1ffb640 1 -- 172.21.15.17:0/4259232280 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b8017070 con 0x7fd5bc0cabb0 2024-09-05T07:29:45.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.579+0000 7fd5b1ffb640 1 -- 172.21.15.17:0/4259232280 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5b800c9a0 con 0x7fd5bc0cabb0 2024-09-05T07:29:45.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.579+0000 7fd5b1ffb640 1 -- 172.21.15.17:0/4259232280 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b800cd90 con 0x7fd5bc0cabb0 2024-09-05T07:29:45.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.579+0000 7fd5c37e8640 1 -- 172.21.15.17:0/4259232280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5bc151170 con 0x7fd5bc0cabb0 2024-09-05T07:29:45.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.579+0000 7fd5c37e8640 1 -- 172.21.15.17:0/4259232280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5bc151730 con 0x7fd5bc0cabb0 2024-09-05T07:29:45.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.580+0000 7fd5c37e8640 1 -- 172.21.15.17:0/4259232280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5bc0cb870 con 0x7fd5bc0cabb0 2024-09-05T07:29:45.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.601+0000 7fd5b1ffb640 1 -- 172.21.15.17:0/4259232280 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd5b801a070 con 0x7fd5bc0cabb0 2024-09-05T07:29:45.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.601+0000 7fd5b1ffb640 1 --2- 172.21.15.17:0/4259232280 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd5a006be80 0x7fd5a006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:45.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.601+0000 7fd5c0d83640 1 --2- 172.21.15.17:0/4259232280 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd5a006be80 0x7fd5a006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:45.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.602+0000 7fd5c0d83640 1 --2- 172.21.15.17:0/4259232280 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd5a006be80 0x7fd5a006e340 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac034000 tx=0x7fd5ac02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:45.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.605+0000 7fd5b1ffb640 1 -- 172.21.15.17:0/4259232280 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd5b80579a0 con 0x7fd5bc0cabb0 2024-09-05T07:29:45.617 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-05T07:29:45.629 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-05T07:29:45.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.718+0000 7f9cd64e4640 1 Processor -- start 2024-09-05T07:29:45.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.718+0000 7f9cd64e4640 1 -- start start 2024-09-05T07:29:45.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.719+0000 7f9cd64e4640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9cd00ccef0 0x7f9cd00b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:45.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.719+0000 7f9cd64e4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9cd00cd2d0 0x7f9cd0157f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:45.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.719+0000 7f9cd64e4640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cd00b3b20 con 0x7f9cd00b43b0 2024-09-05T07:29:45.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.719+0000 7f9cd64e4640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f9cd015b590 con 0x7f9cd00ccef0 2024-09-05T07:29:45.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.719+0000 7f9cd64e4640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f9cd00b2d60 con 0x7f9cd00cd2d0 2024-09-05T07:29:45.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.720+0000 7f9ccf7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9cd00b43b0 0x7f9cd0157800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.17:44724/0 (socket says 172.21.15.17:44724) 2024-09-05T07:29:45.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.720+0000 7f9ccf7fe640 1 -- 172.21.15.17:0/1495819228 learned_addr learned my addr 172.21.15.17:0/1495819228 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:29:45.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.720+0000 7f9cd4a81640 1 --2- 172.21.15.17:0/1495819228 >> v2:172.21.15.26:3300/0 conn(0x7f9cd00cd2d0 0x7f9cd0157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:45.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.723+0000 7f9cceffd640 1 -- 172.21.15.17:0/1495819228 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3928075953 0 0) 0x7f9cd00b3b20 con 0x7f9cd00b43b0 2024-09-05T07:29:45.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.723+0000 7f9cceffd640 1 -- 172.21.15.17:0/1495819228 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cb8003520 con 0x7f9cd00b43b0 2024-09-05T07:29:45.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.727+0000 7f9cceffd640 1 -- 172.21.15.17:0/1495819228 <== mon.1 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4284947056 0 0) 0x7f9cb8003520 con 0x7f9cd00b43b0 2024-09-05T07:29:45.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.727+0000 7f9cceffd640 1 -- 172.21.15.17:0/1495819228 >> v2:172.21.15.26:3300/0 conn(0x7f9cd00cd2d0 msgr2=0x7f9cd0157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:45.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.727+0000 7f9cceffd640 1 --2- 172.21.15.17:0/1495819228 >> v2:172.21.15.26:3300/0 conn(0x7f9cd00cd2d0 0x7f9cd0157f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.727+0000 7f9cceffd640 1 -- 172.21.15.17:0/1495819228 >> v2:172.21.15.17:3300/0 conn(0x7f9cd00ccef0 msgr2=0x7f9cd00b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:45.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.727+0000 7f9cceffd640 1 --2- 172.21.15.17:0/1495819228 >> v2:172.21.15.17:3300/0 conn(0x7f9cd00ccef0 0x7f9cd00b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.727+0000 7f9cceffd640 1 -- 172.21.15.17:0/1495819228 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd00b3040 con 0x7f9cd00b43b0 2024-09-05T07:29:45.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.727+0000 7f9cceffd640 1 -- 172.21.15.17:0/1495819228 <== mon.1 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1460137602 0 0) 0x7f9cc4001670 con 0x7f9cd00b43b0 2024-09-05T07:29:45.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.727+0000 7f9cceffd640 1 -- 172.21.15.17:0/1495819228 >> v1:172.21.15.26:6789/0 conn(0x7f9cd00b43b0 legacy=0x7f9cd0157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:45.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.727+0000 7f9cceffd640 1 --2- 172.21.15.17:0/1495819228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cb8003a00 0x7f9cb8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:45.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.727+0000 7f9cceffd640 1 --2- 172.21.15.17:0/1495819228 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9cb8004800 0x7f9cb8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:45.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.727+0000 7f9cceffd640 1 --2- 172.21.15.17:0/1495819228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cb80051c0 0x7f9cb800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:45.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.727+0000 7f9cceffd640 1 -- 172.21.15.17:0/1495819228 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd015b590 con 0x7f9cb8003a00 2024-09-05T07:29:45.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.727+0000 7f9cceffd640 1 -- 172.21.15.17:0/1495819228 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd00b2d60 con 0x7f9cb80051c0 2024-09-05T07:29:45.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.727+0000 7f9cceffd640 1 -- 172.21.15.17:0/1495819228 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f9cb800c140 con 0x7f9cb8004800 2024-09-05T07:29:45.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.728+0000 7f9ccf7fe640 1 --2- 172.21.15.17:0/1495819228 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9cb8004800 0x7f9cb8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:45.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.731+0000 7f9ccf7fe640 1 -- 172.21.15.17:0/1495819228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cb80051c0 msgr2=0x7f9cb800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:45.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.731+0000 7f9ccf7fe640 1 --2- 172.21.15.17:0/1495819228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cb80051c0 0x7f9cb800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.731+0000 7f9ccf7fe640 1 -- 172.21.15.17:0/1495819228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cb8003a00 msgr2=0x7f9cb8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:45.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.731+0000 7f9ccf7fe640 1 --2- 172.21.15.17:0/1495819228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cb8003a00 0x7f9cb8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.731+0000 7f9ccf7fe640 1 -- 172.21.15.17:0/1495819228 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb8003520 con 0x7f9cb8004800 2024-09-05T07:29:45.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.731+0000 7f9cd4a81640 1 -- 172.21.15.17:0/1495819228 reap_dead start 2024-09-05T07:29:45.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.733+0000 7f9ccf7fe640 1 --2- 172.21.15.17:0/1495819228 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9cb8004800 0x7f9cb8004c80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9cc400c190 tx=0x7f9cb8005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8f181858b1a9294 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:45.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.737+0000 7f9cceffd640 1 -- 172.21.15.17:0/1495819228 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4007c60 con 0x7f9cb8004800 2024-09-05T07:29:45.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.737+0000 7f9cceffd640 1 -- 172.21.15.17:0/1495819228 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc4005ad0 con 0x7f9cb8004800 2024-09-05T07:29:45.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.737+0000 7f9cceffd640 1 -- 172.21.15.17:0/1495819228 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4007070 con 0x7f9cb8004800 2024-09-05T07:29:45.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.737+0000 7f9cd64e4640 1 -- 172.21.15.17:0/1495819228 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9cb8004800 msgr2=0x7f9cb8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:45.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.737+0000 7f9cd64e4640 1 --2- 172.21.15.17:0/1495819228 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9cb8004800 0x7f9cb8004c80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9cc400c190 tx=0x7f9cb8005830 comp rx=0 tx=0).stop 2024-09-05T07:29:45.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.737+0000 7f9cd64e4640 1 -- 172.21.15.17:0/1495819228 shutdown_connections 2024-09-05T07:29:45.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.737+0000 7f9cd64e4640 1 --2- 172.21.15.17:0/1495819228 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9cb8004800 0x7f9cb8004c80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.737+0000 7f9cd64e4640 1 -- 172.21.15.17:0/1495819228 >> 172.21.15.17:0/1495819228 conn(0x7f9cd0072230 msgr2=0x7f9cd0072640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:45.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.737+0000 7f9cd64e4640 1 -- 172.21.15.17:0/1495819228 shutdown_connections 2024-09-05T07:29:45.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.737+0000 7f9cd64e4640 1 -- 172.21.15.17:0/1495819228 wait complete. 2024-09-05T07:29:45.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.739+0000 7f9cd64e4640 1 Processor -- start 2024-09-05T07:29:45.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.739+0000 7f9cd64e4640 1 -- start start 2024-09-05T07:29:45.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.739+0000 7f9cd64e4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cb8004800 0x7f9cd00abb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:45.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.739+0000 7f9cd64e4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cd00ad3a0 0x7f9cd00ac080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:45.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.740+0000 7f9cd64e4640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9cd00ca340 0x7f9cd00c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:45.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.740+0000 7f9cd64e4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd015dee0 con 0x7f9cd00ad3a0 2024-09-05T07:29:45.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.740+0000 7f9cd64e4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd00b3600 con 0x7f9cb8004800 2024-09-05T07:29:45.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.740+0000 7f9cd64e4640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd015e060 con 0x7f9cd00ca340 2024-09-05T07:29:45.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.740+0000 7f9cd4a81640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9cd00ca340 0x7f9cd00c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:45.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.740+0000 7f9ccffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cb8004800 0x7f9cd00abb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:45.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.740+0000 7f9cd4a81640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9cd00ca340 0x7f9cd00c3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:60052/0 (socket says 172.21.15.17:60052) 2024-09-05T07:29:45.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.740+0000 7f9cd4a81640 1 -- 172.21.15.17:0/4215210934 learned_addr learned my addr 172.21.15.17:0/4215210934 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:45.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.744+0000 7f9cd4a81640 1 -- 172.21.15.17:0/4215210934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cb8004800 msgr2=0x7f9cd00abb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:45.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.744+0000 7f9cd4a81640 1 --2- 172.21.15.17:0/4215210934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cb8004800 0x7f9cd00abb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.744+0000 7f9cd4a81640 1 -- 172.21.15.17:0/4215210934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cd00ad3a0 msgr2=0x7f9cd00ac080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:45.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.744+0000 7f9cd4a81640 1 --2- 172.21.15.17:0/4215210934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cd00ad3a0 0x7f9cd00ac080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.744+0000 7f9cd4a81640 1 -- 172.21.15.17:0/4215210934 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd00c3960 con 0x7f9cd00ca340 2024-09-05T07:29:45.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.746+0000 7f9cd4a81640 1 --2- 172.21.15.17:0/4215210934 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9cd00ca340 0x7f9cd00c3e40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9cd00cd6e0 tx=0x7f9cc8009750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:45.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.751+0000 7f9cccff9640 1 -- 172.21.15.17:0/4215210934 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc800ba10 con 0x7f9cd00ca340 2024-09-05T07:29:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.751+0000 7f9cccff9640 1 -- 172.21.15.17:0/4215210934 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc801a070 con 0x7f9cd00ca340 2024-09-05T07:29:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.751+0000 7f9cd64e4640 1 -- 172.21.15.17:0/4215210934 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cd01efe90 con 0x7f9cd00ca340 2024-09-05T07:29:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.751+0000 7f9cccff9640 1 -- 172.21.15.17:0/4215210934 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc800be10 con 0x7f9cd00ca340 2024-09-05T07:29:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.751+0000 7f9cd64e4640 1 -- 172.21.15.17:0/4215210934 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cd01f0450 con 0x7f9cd00ca340 2024-09-05T07:29:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.752+0000 7f9cd64e4640 1 -- 172.21.15.17:0/4215210934 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cd00c3b30 con 0x7f9cd00ca340 2024-09-05T07:29:45.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.761+0000 7fc1a3027640 1 Processor -- start 2024-09-05T07:29:45.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.761+0000 7fc1a3027640 1 -- start start 2024-09-05T07:29:45.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.762+0000 7fc1a3027640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc19c14f420 0x7fc19c0c3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:45.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.762+0000 7fc1a3027640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc19c0c82d0 0x7fc19c0c35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:45.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.762+0000 7fc1a3027640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc19c14f800 con 0x7fc19c0c4f90 2024-09-05T07:29:45.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.762+0000 7fc1a3027640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fc19c0c9410 con 0x7fc19c0c82d0 2024-09-05T07:29:45.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.762+0000 7fc1a3027640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fc19c0c9660 con 0x7fc19c14f420 2024-09-05T07:29:45.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.763+0000 7fc1a15c4640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc19c0c4f90 0x7fc19c158a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.17:44738/0 (socket says 172.21.15.17:44738) 2024-09-05T07:29:45.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.763+0000 7fc1a15c4640 1 -- 172.21.15.17:0/3748308144 learned_addr learned my addr 172.21.15.17:0/3748308144 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:29:45.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.765+0000 7fc19b7fe640 1 -- 172.21.15.17:0/3748308144 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3172121278 0 0) 0x7fc19c14f800 con 0x7fc19c0c4f90 2024-09-05T07:29:45.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.765+0000 7fc19b7fe640 1 -- 172.21.15.17:0/3748308144 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc18c003520 con 0x7fc19c0c4f90 2024-09-05T07:29:45.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.768+0000 7fc19b7fe640 1 -- 172.21.15.17:0/3748308144 <== mon.1 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1887526585 0 0) 0x7fc18c003520 con 0x7fc19c0c4f90 2024-09-05T07:29:45.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.768+0000 7fc19b7fe640 1 -- 172.21.15.17:0/3748308144 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc19c14f420 msgr2=0x7fc19c0c3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:45.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.768+0000 7fc19b7fe640 1 --2- 172.21.15.17:0/3748308144 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc19c14f420 0x7fc19c0c3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.768+0000 7fc19b7fe640 1 -- 172.21.15.17:0/3748308144 >> v2:172.21.15.17:3300/0 conn(0x7fc19c0c82d0 msgr2=0x7fc19c0c35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:45.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.768+0000 7fc19b7fe640 1 --2- 172.21.15.17:0/3748308144 >> v2:172.21.15.17:3300/0 conn(0x7fc19c0c82d0 0x7fc19c0c35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.768+0000 7fc19b7fe640 1 -- 172.21.15.17:0/3748308144 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc19c0c9940 con 0x7fc19c0c4f90 2024-09-05T07:29:45.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.768+0000 7fc19b7fe640 1 -- 172.21.15.17:0/3748308144 <== mon.1 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1460137602 0 0) 0x7fc1940019f0 con 0x7fc19c0c4f90 2024-09-05T07:29:45.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.768+0000 7fc19b7fe640 1 -- 172.21.15.17:0/3748308144 >> v1:172.21.15.26:6789/0 conn(0x7fc19c0c4f90 legacy=0x7fc19c158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:45.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.768+0000 7fc19b7fe640 1 --2- 172.21.15.17:0/3748308144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc18c0039b0 0x7fc18c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:45.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.768+0000 7fc19b7fe640 1 --2- 172.21.15.17:0/3748308144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc18c004800 0x7fc18c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:45.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.768+0000 7fc19b7fe640 1 --2- 172.21.15.17:0/3748308144 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc19c14f420 0x7fc18c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:45.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.769+0000 7fc19b7fe640 1 -- 172.21.15.17:0/3748308144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc19c0c9410 con 0x7fc18c004800 2024-09-05T07:29:45.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.769+0000 7fc19b7fe640 1 -- 172.21.15.17:0/3748308144 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc19c0c9660 con 0x7fc18c0039b0 2024-09-05T07:29:45.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.769+0000 7fc19b7fe640 1 -- 172.21.15.17:0/3748308144 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fc18c0055b0 con 0x7fc19c14f420 2024-09-05T07:29:45.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.772+0000 7fc1a0dc3640 1 --2- 172.21.15.17:0/3748308144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc18c0039b0 0x7fc18c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:45.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.775+0000 7fc1a0dc3640 1 -- 172.21.15.17:0/3748308144 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc19c14f420 msgr2=0x7fc18c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:45.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.775+0000 7fc1a0dc3640 1 --2- 172.21.15.17:0/3748308144 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc19c14f420 0x7fc18c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.775+0000 7fc1a0dc3640 1 -- 172.21.15.17:0/3748308144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc18c004800 msgr2=0x7fc18c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:45.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.775+0000 7fc1a0dc3640 1 --2- 172.21.15.17:0/3748308144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc18c004800 0x7fc18c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.775+0000 7fc1a0dc3640 1 -- 172.21.15.17:0/3748308144 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc18c003520 con 0x7fc18c0039b0 2024-09-05T07:29:45.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.777+0000 7fc1a0dc3640 1 --2- 172.21.15.17:0/3748308144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc18c0039b0 0x7fc18c003dd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc190009860 tx=0x7fc18c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4073e5456fd3dda7 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:45.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.780+0000 7fc19b7fe640 1 -- 172.21.15.17:0/3748308144 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc190037070 con 0x7fc18c0039b0 2024-09-05T07:29:45.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.781+0000 7fc19b7fe640 1 -- 172.21.15.17:0/3748308144 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc19002aaa0 con 0x7fc18c0039b0 2024-09-05T07:29:45.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.781+0000 7fc19b7fe640 1 -- 172.21.15.17:0/3748308144 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc190009460 con 0x7fc18c0039b0 2024-09-05T07:29:45.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.781+0000 7fc1a3027640 1 -- 172.21.15.17:0/3748308144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc18c0039b0 msgr2=0x7fc18c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:45.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.781+0000 7fc1a3027640 1 --2- 172.21.15.17:0/3748308144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc18c0039b0 0x7fc18c003dd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc190009860 tx=0x7fc18c005830 comp rx=0 tx=0).stop 2024-09-05T07:29:45.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.781+0000 7fc1a15c4640 1 -- 172.21.15.17:0/3748308144 reap_dead start 2024-09-05T07:29:45.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.781+0000 7fc1a3027640 1 -- 172.21.15.17:0/3748308144 shutdown_connections 2024-09-05T07:29:45.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.781+0000 7fc1a3027640 1 -- 172.21.15.17:0/3748308144 >> 172.21.15.17:0/3748308144 conn(0x7fc19c071450 msgr2=0x7fc19c071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:45.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.781+0000 7fc1a3027640 1 -- 172.21.15.17:0/3748308144 shutdown_connections 2024-09-05T07:29:45.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.781+0000 7fc1a3027640 1 -- 172.21.15.17:0/3748308144 wait complete. 2024-09-05T07:29:45.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.782+0000 7fc1a3027640 1 Processor -- start 2024-09-05T07:29:45.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.782+0000 7fc1a3027640 1 -- start start 2024-09-05T07:29:45.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.783+0000 7fc1a3027640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc18c0039b0 0x7fc19c1f35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:45.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.783+0000 7fc1a3027640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc19c0ccd90 0x7fc19c0cd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:45.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.783+0000 7fc1a3027640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc19c06d1f0 0x7fc19c06d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:45.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.783+0000 7fc1a3027640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc19c0701b0 con 0x7fc19c06d1f0 2024-09-05T07:29:45.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.783+0000 7fc1a3027640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc19c0c9f00 con 0x7fc19c0ccd90 2024-09-05T07:29:45.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.783+0000 7fc1a3027640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fc19c070330 con 0x7fc18c0039b0 2024-09-05T07:29:45.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.784+0000 7fc19bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc19c0ccd90 0x7fc19c0cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:45.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.784+0000 7fc19bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc19c0ccd90 0x7fc19c0cd210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:36308/0 (socket says 172.21.15.17:36308) 2024-09-05T07:29:45.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.784+0000 7fc19bfff640 1 -- 172.21.15.17:0/3316036336 learned_addr learned my addr 172.21.15.17:0/3316036336 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:45.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.789+0000 7fc19bfff640 1 -- 172.21.15.17:0/3316036336 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc18c0039b0 msgr2=0x7fc19c1f35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:45.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.789+0000 7fc19bfff640 1 --2- 172.21.15.17:0/3316036336 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc18c0039b0 0x7fc19c1f35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.789+0000 7fc19bfff640 1 -- 172.21.15.17:0/3316036336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc19c06d1f0 msgr2=0x7fc19c06d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:45.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.789+0000 7fc19bfff640 1 --2- 172.21.15.17:0/3316036336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc19c06d1f0 0x7fc19c06d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.789+0000 7fc19bfff640 1 -- 172.21.15.17:0/3316036336 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc19c1f3e60 con 0x7fc19c0ccd90 2024-09-05T07:29:45.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.792+0000 7fc19bfff640 1 --2- 172.21.15.17:0/3316036336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc19c0ccd90 0x7fc19c0cd210 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc18800b530 tx=0x7fc18800b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:45.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.796+0000 7fc1997fa640 1 -- 172.21.15.17:0/3316036336 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc188014070 con 0x7fc19c0ccd90 2024-09-05T07:29:45.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.796+0000 7fc1997fa640 1 -- 172.21.15.17:0/3316036336 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1880108b0 con 0x7fc19c0ccd90 2024-09-05T07:29:45.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.796+0000 7fc1997fa640 1 -- 172.21.15.17:0/3316036336 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc188010ca0 con 0x7fc19c0ccd90 2024-09-05T07:29:45.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.796+0000 7fc1a3027640 1 -- 172.21.15.17:0/3316036336 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc19c0cd750 con 0x7fc19c0ccd90 2024-09-05T07:29:45.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.796+0000 7fc1a3027640 1 -- 172.21.15.17:0/3316036336 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc19c1f40d0 con 0x7fc19c0ccd90 2024-09-05T07:29:45.797 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-05T07:29:45.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.797+0000 7fc1a3027640 1 -- 172.21.15.17:0/3316036336 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc19c14f800 con 0x7fc19c0ccd90 2024-09-05T07:29:45.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.880+0000 7fd5b1ffb640 1 -- 172.21.15.17:0/4259232280 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd5b8059900 con 0x7fd5bc0cabb0 2024-09-05T07:29:45.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.902+0000 7f8dacbfd640 1 Processor -- start 2024-09-05T07:29:45.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.902+0000 7f8dacbfd640 1 -- start start 2024-09-05T07:29:45.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.904+0000 7f8dacbfd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8da81580f0 0x7f8da8067950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:45.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.904+0000 7f8dacbfd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8da80c95b0 0x7f8da8067e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:45.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.904+0000 7f8dacbfd640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8da80c8ba0 0x7f8da806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:45.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.904+0000 7f8dacbfd640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f8da8072eb0 con 0x7f8da81580f0 2024-09-05T07:29:45.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.904+0000 7f8dacbfd640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f8da8073190 con 0x7f8da80c95b0 2024-09-05T07:29:45.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.904+0000 7f8dacbfd640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f8da8073ca0 con 0x7f8da80c8ba0 2024-09-05T07:29:45.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.980+0000 7f8da659c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8da81580f0 0x7f8da8067950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:45.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.983+0000 7f8da659c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8da81580f0 0x7f8da8067950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60800/0 (socket says 172.21.15.17:60800) 2024-09-05T07:29:45.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.983+0000 7f8da659c640 1 -- 172.21.15.17:0/223738033 learned_addr learned my addr 172.21.15.17:0/223738033 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:45.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.986+0000 7f8da659c640 1 -- 172.21.15.17:0/223738033 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8da80c8ba0 msgr2=0x7f8da806e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:45.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.986+0000 7f8da659c640 1 --2- 172.21.15.17:0/223738033 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8da80c8ba0 0x7f8da806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.986+0000 7f8da659c640 1 -- 172.21.15.17:0/223738033 >> v2:172.21.15.26:3300/0 conn(0x7f8da80c95b0 msgr2=0x7f8da8067e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:45.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.986+0000 7f8da659c640 1 --2- 172.21.15.17:0/223738033 >> v2:172.21.15.26:3300/0 conn(0x7f8da80c95b0 0x7f8da8067e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.986+0000 7f8da659c640 1 -- 172.21.15.17:0/223738033 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da8073f80 con 0x7f8da81580f0 2024-09-05T07:29:45.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.990+0000 7f8da659c640 1 --2- 172.21.15.17:0/223738033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8da81580f0 0x7f8da8067950 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8da80c8ac0 tx=0x7f8d9802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a79f698b073070b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:45.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.993+0000 7f8da559a640 1 -- 172.21.15.17:0/223738033 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d98037070 con 0x7f8da81580f0 2024-09-05T07:29:45.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.995+0000 7f8da559a640 1 -- 172.21.15.17:0/223738033 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d9802ae00 con 0x7f8da81580f0 2024-09-05T07:29:45.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.995+0000 7f8da559a640 1 -- 172.21.15.17:0/223738033 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d98032660 con 0x7f8da81580f0 2024-09-05T07:29:45.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.996+0000 7f8dacbfd640 1 -- 172.21.15.17:0/223738033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8da81580f0 msgr2=0x7f8da8067950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:45.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.996+0000 7f8dacbfd640 1 --2- 172.21.15.17:0/223738033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8da81580f0 0x7f8da8067950 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8da80c8ac0 tx=0x7f8d9802a0b0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.996+0000 7f8dacbfd640 1 -- 172.21.15.17:0/223738033 shutdown_connections 2024-09-05T07:29:45.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.996+0000 7f8dacbfd640 1 --2- 172.21.15.17:0/223738033 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8da80c8ba0 0x7f8da806e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.996+0000 7f8dacbfd640 1 --2- 172.21.15.17:0/223738033 >> v2:172.21.15.26:3300/0 conn(0x7f8da80c95b0 0x7f8da8067e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.996+0000 7f8dacbfd640 1 --2- 172.21.15.17:0/223738033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8da81580f0 0x7f8da8067950 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:45.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.996+0000 7f8dacbfd640 1 -- 172.21.15.17:0/223738033 >> 172.21.15.17:0/223738033 conn(0x7f8da80cd440 msgr2=0x7f8da80cd850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:45.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.996+0000 7f8dacbfd640 1 -- 172.21.15.17:0/223738033 shutdown_connections 2024-09-05T07:29:45.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.996+0000 7f8dacbfd640 1 -- 172.21.15.17:0/223738033 wait complete. 2024-09-05T07:29:46.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.997+0000 7f8dacbfd640 1 Processor -- start 2024-09-05T07:29:46.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.997+0000 7f8dacbfd640 1 -- start start 2024-09-05T07:29:46.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.998+0000 7f8dacbfd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8da80c8ba0 0x7f8da80cc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:46.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.998+0000 7f8dacbfd640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8da80c95b0 0x7f8da81e44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:46.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.998+0000 7f8dacbfd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8da81580f0 0x7f8da81e4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:46.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.998+0000 7f8dacbfd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8da80c7a50 con 0x7f8da81580f0 2024-09-05T07:29:46.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.998+0000 7f8dacbfd640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8da8073610 con 0x7f8da80c8ba0 2024-09-05T07:29:46.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.998+0000 7f8dacbfd640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f8da80c7bd0 con 0x7f8da80c95b0 2024-09-05T07:29:46.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.998+0000 7f8da6d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8da81580f0 0x7f8da81e4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:46.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.999+0000 7f8da6d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8da81580f0 0x7f8da81e4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60814/0 (socket says 172.21.15.17:60814) 2024-09-05T07:29:46.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:45.999+0000 7f8da6d9d640 1 -- 172.21.15.17:0/3772361389 learned_addr learned my addr 172.21.15.17:0/3772361389 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:46.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.002+0000 7f8da6d9d640 1 -- 172.21.15.17:0/3772361389 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8da80c95b0 msgr2=0x7f8da81e44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:46.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.002+0000 7f8da6d9d640 1 --2- 172.21.15.17:0/3772361389 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8da80c95b0 0x7f8da81e44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.002+0000 7f8da6d9d640 1 -- 172.21.15.17:0/3772361389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8da80c8ba0 msgr2=0x7f8da80cc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:46.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.002+0000 7f8da6d9d640 1 --2- 172.21.15.17:0/3772361389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8da80c8ba0 0x7f8da80cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.002+0000 7f8da6d9d640 1 -- 172.21.15.17:0/3772361389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da81f1bf0 con 0x7f8da81580f0 2024-09-05T07:29:46.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.005+0000 7f8da6d9d640 1 --2- 172.21.15.17:0/3772361389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8da81580f0 0x7f8da81e4a30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8da000b9d0 tx=0x7f8da000be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:46.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.009+0000 7f8d96ffd640 1 -- 172.21.15.17:0/3772361389 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da0019070 con 0x7f8da81580f0 2024-09-05T07:29:46.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.009+0000 7f8d96ffd640 1 -- 172.21.15.17:0/3772361389 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8da000cbf0 con 0x7f8da81580f0 2024-09-05T07:29:46.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.009+0000 7f8dacbfd640 1 -- 172.21.15.17:0/3772361389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8da80ae8b0 con 0x7f8da81580f0 2024-09-05T07:29:46.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.009+0000 7f8d96ffd640 1 -- 172.21.15.17:0/3772361389 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da0014440 con 0x7f8da81580f0 2024-09-05T07:29:46.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.009+0000 7f8dacbfd640 1 -- 172.21.15.17:0/3772361389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8da80aee10 con 0x7f8da81580f0 2024-09-05T07:29:46.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.010+0000 7f8dacbfd640 1 -- 172.21.15.17:0/3772361389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8da8067950 con 0x7f8da81580f0 2024-09-05T07:29:46.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.029+0000 7f8d96ffd640 1 -- 172.21.15.17:0/3772361389 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8da001c070 con 0x7f8da81580f0 2024-09-05T07:29:46.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.030+0000 7f8d96ffd640 1 --2- 172.21.15.17:0/3772361389 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f8d8806be80 0x7f8d8806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:46.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.030+0000 7f8da659c640 1 --2- 172.21.15.17:0/3772361389 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f8d8806be80 0x7f8d8806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:46.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.030+0000 7f8da659c640 1 --2- 172.21.15.17:0/3772361389 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f8d8806be80 0x7f8d8806e340 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8d98034000 tx=0x7f8d9802c000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:46.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.035+0000 7f8d96ffd640 1 -- 172.21.15.17:0/3772361389 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8da0057380 con 0x7f8da81580f0 2024-09-05T07:29:46.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.045+0000 7f9cccff9640 1 -- 172.21.15.17:0/4215210934 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9cc8013070 con 0x7f9cd00ca340 2024-09-05T07:29:46.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.045+0000 7f9cccff9640 1 --2- 172.21.15.17:0/4215210934 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f9cbc06be60 0x7f9cbc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:46.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.045+0000 7f9ccffff640 1 --2- 172.21.15.17:0/4215210934 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f9cbc06be60 0x7f9cbc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:46.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.046+0000 7f9ccffff640 1 --2- 172.21.15.17:0/4215210934 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f9cbc06be60 0x7f9cbc06e320 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0004810 tx=0x7f9cc0009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:46.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.052+0000 7f9cccff9640 1 -- 172.21.15.17:0/4215210934 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f9cc8057d40 con 0x7f9cd00ca340 2024-09-05T07:29:46.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.069+0000 7f9cccff9640 1 -- 172.21.15.17:0/4215210934 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9cc805a3a0 con 0x7f9cd00ca340 2024-09-05T07:29:46.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.077+0000 7fd5c37e8640 1 -- 172.21.15.17:0/4259232280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fd5bc0b29e0 con 0x7fd5bc0cabb0 2024-09-05T07:29:46.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.112+0000 7fc1997fa640 1 -- 172.21.15.17:0/3316036336 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc188017070 con 0x7fc19c0ccd90 2024-09-05T07:29:46.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.112+0000 7fc1997fa640 1 --2- 172.21.15.17:0/3316036336 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc18006be80 0x7fc18006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:46.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.113+0000 7fc1a0dc3640 1 --2- 172.21.15.17:0/3316036336 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc18006be80 0x7fc18006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:46.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.113+0000 7fc1a0dc3640 1 --2- 172.21.15.17:0/3316036336 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc18006be80 0x7fc18006e340 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc190034000 tx=0x7fc19002c000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:46.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.116+0000 7fc1997fa640 1 -- 172.21.15.17:0/3316036336 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc188057460 con 0x7fc19c0ccd90 2024-09-05T07:29:46.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.128+0000 7fc1997fa640 1 -- 172.21.15.17:0/3316036336 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc19c0cd750 con 0x7fc19c0ccd90 2024-09-05T07:29:46.218 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-05T07:29:46.219 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-05T07:29:46.220 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-05T07:29:46.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.315+0000 7f9cd64e4640 1 -- 172.21.15.17:0/4215210934 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f9cd00b3e70 con 0x7f9cd00ca340 2024-09-05T07:29:46.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.318+0000 7f9cccff9640 1 -- 172.21.15.17:0/4215210934 <== mon.2 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9cc8059ca0 con 0x7f9cd00ca340 2024-09-05T07:29:46.319 INFO:teuthology.orchestra.run.smithi017.stdout:60129542155 2024-09-05T07:29:46.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.321+0000 7f9cd64e4640 1 -- 172.21.15.17:0/4215210934 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f9cbc06be60 msgr2=0x7f9cbc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:46.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.321+0000 7f9cd64e4640 1 --2- 172.21.15.17:0/4215210934 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f9cbc06be60 0x7f9cbc06e320 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0004810 tx=0x7f9cc0009190 comp rx=0 tx=0).stop 2024-09-05T07:29:46.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.321+0000 7f9cd64e4640 1 -- 172.21.15.17:0/4215210934 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9cd00ca340 msgr2=0x7f9cd00c3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:46.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.321+0000 7f9cd64e4640 1 --2- 172.21.15.17:0/4215210934 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9cd00ca340 0x7f9cd00c3e40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9cd00cd6e0 tx=0x7f9cc8009750 comp rx=0 tx=0).stop 2024-09-05T07:29:46.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.321+0000 7f9cd64e4640 1 -- 172.21.15.17:0/4215210934 shutdown_connections 2024-09-05T07:29:46.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.321+0000 7f9cd64e4640 1 --2- 172.21.15.17:0/4215210934 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f9cbc06be60 0x7f9cbc06e320 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.321+0000 7f9cd64e4640 1 --2- 172.21.15.17:0/4215210934 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9cd00ca340 0x7f9cd00c3e40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.321+0000 7f9cd64e4640 1 --2- 172.21.15.17:0/4215210934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cd00ad3a0 0x7f9cd00ac080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.321+0000 7f9cd64e4640 1 --2- 172.21.15.17:0/4215210934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9cb8004800 0x7f9cd00abb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.321+0000 7f9cd64e4640 1 -- 172.21.15.17:0/4215210934 >> 172.21.15.17:0/4215210934 conn(0x7f9cd0072230 msgr2=0x7f9cd01575d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:46.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.321+0000 7f9cd64e4640 1 -- 172.21.15.17:0/4215210934 shutdown_connections 2024-09-05T07:29:46.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.321+0000 7f9cd64e4640 1 -- 172.21.15.17:0/4215210934 wait complete. 2024-09-05T07:29:46.336 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.6 2024-09-05T07:29:46.336 DEBUG:teuthology.parallel:result is None 2024-09-05T07:29:46.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.341+0000 7f3254ff6640 1 Processor -- start 2024-09-05T07:29:46.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.341+0000 7f3254ff6640 1 -- start start 2024-09-05T07:29:46.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.342+0000 7f3254ff6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f32500c8ae0 0x7f325006d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:46.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.342+0000 7f3254ff6640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f325006d8b0 con 0x7f3250151720 2024-09-05T07:29:46.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.342+0000 7f3254ff6640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32501576f0 con 0x7f32500ca060 2024-09-05T07:29:46.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.342+0000 7f3254ff6640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f32501582c0 con 0x7f32500c8ae0 2024-09-05T07:29:46.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.343+0000 7f324ed9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f32500c8ae0 0x7f325006d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:46.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.344+0000 7f324ed9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f32500c8ae0 0x7f325006d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:36332/0 (socket says 172.21.15.17:36332) 2024-09-05T07:29:46.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.344+0000 7f324ed9d640 1 -- 172.21.15.17:0/2762468524 learned_addr learned my addr 172.21.15.17:0/2762468524 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:46.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.347+0000 7f324ed9d640 1 -- 172.21.15.17:0/2762468524 >> v1:172.21.15.26:6789/0 conn(0x7f32500ca060 legacy=0x7f32500c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:46.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.347+0000 7f324ed9d640 1 -- 172.21.15.17:0/2762468524 >> v1:172.21.15.17:6789/0 conn(0x7f3250151720 legacy=0x7f32500c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:46.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.347+0000 7f324ed9d640 1 -- 172.21.15.17:0/2762468524 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3250074030 con 0x7f32500c8ae0 2024-09-05T07:29:46.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.349+0000 7f324ed9d640 1 --2- 172.21.15.17:0/2762468524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32500c8ae0 0x7f325006d200 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f32501578c0 tx=0x7f324802ca00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fbc620c92a160f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:46.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.355+0000 7f324d59a640 1 -- 172.21.15.17:0/2762468524 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3248035020 con 0x7f32500c8ae0 2024-09-05T07:29:46.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.355+0000 7f324d59a640 1 -- 172.21.15.17:0/2762468524 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f324800b2d0 con 0x7f32500c8ae0 2024-09-05T07:29:46.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.355+0000 7f324d59a640 1 -- 172.21.15.17:0/2762468524 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f324800b480 con 0x7f32500c8ae0 2024-09-05T07:29:46.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.356+0000 7f3254ff6640 1 -- 172.21.15.17:0/2762468524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32500c8ae0 msgr2=0x7f325006d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:46.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.356+0000 7f3254ff6640 1 --2- 172.21.15.17:0/2762468524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32500c8ae0 0x7f325006d200 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f32501578c0 tx=0x7f324802ca00 comp rx=0 tx=0).stop 2024-09-05T07:29:46.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.356+0000 7f3254ff6640 1 -- 172.21.15.17:0/2762468524 shutdown_connections 2024-09-05T07:29:46.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.356+0000 7f3254ff6640 1 --2- 172.21.15.17:0/2762468524 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32500c8ae0 0x7f325006d200 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.356+0000 7f3254ff6640 1 -- 172.21.15.17:0/2762468524 >> 172.21.15.17:0/2762468524 conn(0x7f3250070250 msgr2=0x7f3250070630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:46.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.356+0000 7f3254ff6640 1 -- 172.21.15.17:0/2762468524 shutdown_connections 2024-09-05T07:29:46.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.356+0000 7f3254ff6640 1 -- 172.21.15.17:0/2762468524 wait complete. 2024-09-05T07:29:46.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.358+0000 7f3254ff6640 1 Processor -- start 2024-09-05T07:29:46.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.358+0000 7f3254ff6640 1 -- start start 2024-09-05T07:29:46.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.358+0000 7f3254ff6640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f32500c8ae0 0x7f3250156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:46.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.358+0000 7f3254ff6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32500ca060 0x7f32501526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:46.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.358+0000 7f3254ff6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3250151720 0x7f3250152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:46.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.358+0000 7f3254ff6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3250157f50 con 0x7f32500ca060 2024-09-05T07:29:46.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.358+0000 7f3254ff6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f3250157c70 con 0x7f3250151720 2024-09-05T07:29:46.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.358+0000 7f3254ff6640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f32500c79e0 con 0x7f32500c8ae0 2024-09-05T07:29:46.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.359+0000 7f324e59c640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f32500c8ae0 0x7f3250156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:46.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.359+0000 7f324ed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3250151720 0x7f3250152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:46.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.359+0000 7f324e59c640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f32500c8ae0 0x7f3250156dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:60112/0 (socket says 172.21.15.17:60112) 2024-09-05T07:29:46.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.359+0000 7f324e59c640 1 -- 172.21.15.17:0/3906271333 learned_addr learned my addr 172.21.15.17:0/3906271333 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:46.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.363+0000 7f324e59c640 1 -- 172.21.15.17:0/3906271333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3250151720 msgr2=0x7f3250152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:46.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.363+0000 7f324e59c640 1 --2- 172.21.15.17:0/3906271333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3250151720 0x7f3250152c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.363+0000 7f324e59c640 1 -- 172.21.15.17:0/3906271333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32500ca060 msgr2=0x7f32501526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:46.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.363+0000 7f324e59c640 1 --2- 172.21.15.17:0/3906271333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32500ca060 0x7f32501526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.363+0000 7f324e59c640 1 -- 172.21.15.17:0/3906271333 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32500cbb50 con 0x7f32500c8ae0 2024-09-05T07:29:46.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.365+0000 7f324e59c640 1 --2- 172.21.15.17:0/3906271333 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f32500c8ae0 0x7f3250156dd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f324000b410 tx=0x7f324000b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:46.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.368+0000 7fc1a3027640 1 -- 172.21.15.17:0/3316036336 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fc19c14bf40 con 0x7fc19c0ccd90 2024-09-05T07:29:46.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.368+0000 7f323effd640 1 -- 172.21.15.17:0/3906271333 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3240015020 con 0x7f32500c8ae0 2024-09-05T07:29:46.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.369+0000 7f323effd640 1 -- 172.21.15.17:0/3906271333 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3240011830 con 0x7f32500c8ae0 2024-09-05T07:29:46.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.369+0000 7f3254ff6640 1 -- 172.21.15.17:0/3906271333 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32500cbe30 con 0x7f32500c8ae0 2024-09-05T07:29:46.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.369+0000 7f3254ff6640 1 -- 172.21.15.17:0/3906271333 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f32500cc3f0 con 0x7f32500c8ae0 2024-09-05T07:29:46.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.369+0000 7f323effd640 1 -- 172.21.15.17:0/3906271333 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3240011c20 con 0x7f32500c8ae0 2024-09-05T07:29:46.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.370+0000 7f3254ff6640 1 -- 172.21.15.17:0/3906271333 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32500c76b0 con 0x7f32500c8ae0 2024-09-05T07:29:46.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.373+0000 7fc1997fa640 1 -- 172.21.15.17:0/3316036336 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc188059ac0 con 0x7fc19c0ccd90 2024-09-05T07:29:46.374 INFO:teuthology.orchestra.run.smithi017.stdout:64424509451 2024-09-05T07:29:46.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.376+0000 7fc1a3027640 1 -- 172.21.15.17:0/3316036336 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc18006be80 msgr2=0x7fc18006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:46.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.376+0000 7fc1a3027640 1 --2- 172.21.15.17:0/3316036336 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc18006be80 0x7fc18006e340 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc190034000 tx=0x7fc19002c000 comp rx=0 tx=0).stop 2024-09-05T07:29:46.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.376+0000 7fc1a3027640 1 -- 172.21.15.17:0/3316036336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc19c0ccd90 msgr2=0x7fc19c0cd210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:46.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.376+0000 7fc1a3027640 1 --2- 172.21.15.17:0/3316036336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc19c0ccd90 0x7fc19c0cd210 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc18800b530 tx=0x7fc18800b9f0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.376+0000 7fc1a3027640 1 -- 172.21.15.17:0/3316036336 shutdown_connections 2024-09-05T07:29:46.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.376+0000 7fc1a3027640 1 --2- 172.21.15.17:0/3316036336 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc18006be80 0x7fc18006e340 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.376+0000 7fc1a3027640 1 --2- 172.21.15.17:0/3316036336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc19c06d1f0 0x7fc19c06d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.376+0000 7fc1a3027640 1 --2- 172.21.15.17:0/3316036336 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc19c0ccd90 0x7fc19c0cd210 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.376+0000 7fc1a3027640 1 --2- 172.21.15.17:0/3316036336 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc18c0039b0 0x7fc19c1f35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.376+0000 7fc1a3027640 1 -- 172.21.15.17:0/3316036336 >> 172.21.15.17:0/3316036336 conn(0x7fc19c071450 msgr2=0x7fc19c0c3080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:46.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.376+0000 7fc1a3027640 1 -- 172.21.15.17:0/3316036336 shutdown_connections 2024-09-05T07:29:46.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.376+0000 7fc1a3027640 1 -- 172.21.15.17:0/3316036336 wait complete. 2024-09-05T07:29:46.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.379+0000 7f9aeb9e4640 1 Processor -- start 2024-09-05T07:29:46.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.379+0000 7f9aeb9e4640 1 -- start start 2024-09-05T07:29:46.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.380+0000 7f43b1be8640 1 Processor -- start 2024-09-05T07:29:46.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.380+0000 7f43b1be8640 1 -- start start 2024-09-05T07:29:46.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.380+0000 7f9aeb9e4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9ae40afde0 0x7f9ae4067d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:46.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.380+0000 7f9aeb9e4640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ae415a9a0 con 0x7f9ae4072820 2024-09-05T07:29:46.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.380+0000 7f9aeb9e4640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ae415ac80 con 0x7f9ae4067950 2024-09-05T07:29:46.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.380+0000 7f9aeb9e4640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f9ae415af60 con 0x7f9ae40afde0 2024-09-05T07:29:46.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.381+0000 7f43b1be8640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f43ac073b00 0x7f43ac15ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:46.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.381+0000 7f43b1be8640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43ac0c8e40 0x7f43ac1566e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:46.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.381+0000 7f43b1be8640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43ac15b1a0 con 0x7f43ac073ee0 2024-09-05T07:29:46.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.381+0000 7f43b1be8640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f43ac073070 con 0x7f43ac073b00 2024-09-05T07:29:46.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.381+0000 7f43b1be8640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f43ac073350 con 0x7f43ac0c8e40 2024-09-05T07:29:46.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.383+0000 7f9ae9780640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9ae4067950 0x7f9ae40ae8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.17:44752/0 (socket says 172.21.15.17:44752) 2024-09-05T07:29:46.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.383+0000 7f9ae9780640 1 -- 172.21.15.17:0/2370256530 learned_addr learned my addr 172.21.15.17:0/2370256530 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:29:46.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.383+0000 7f9ae8f7f640 1 --2- 172.21.15.17:0/2370256530 >> v2:172.21.15.26:3300/0 conn(0x7f9ae40afde0 0x7f9ae4067d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:46.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.387+0000 7f9ae8f7f640 1 -- 172.21.15.17:0/2370256530 >> v1:172.21.15.26:6789/0 conn(0x7f9ae4067950 legacy=0x7f9ae40ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:46.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.387+0000 7f9ae8f7f640 1 -- 172.21.15.17:0/2370256530 >> v1:172.21.15.17:6789/0 conn(0x7f9ae4072820 legacy=0x7f9ae415de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:46.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.387+0000 7f9ae8f7f640 1 -- 172.21.15.17:0/2370256530 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ae415b240 con 0x7f9ae40afde0 2024-09-05T07:29:46.389 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.7 2024-09-05T07:29:46.389 DEBUG:teuthology.parallel:result is None 2024-09-05T07:29:46.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.390+0000 7f9ae8f7f640 1 --2- 172.21.15.17:0/2370256530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ae40afde0 0x7f9ae4067d30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9ad40097a0 tx=0x7f9ad402a140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8234f5aabd0793e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:46.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.390+0000 7f323effd640 1 -- 172.21.15.17:0/3906271333 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3240018020 con 0x7f32500c8ae0 2024-09-05T07:29:46.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.391+0000 7f323effd640 1 --2- 172.21.15.17:0/3906271333 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f323006be80 0x7f323006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:46.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.391+0000 7f324dd9b640 1 --2- 172.21.15.17:0/3906271333 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f323006be80 0x7f323006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:46.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.392+0000 7f324dd9b640 1 --2- 172.21.15.17:0/3906271333 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f323006be80 0x7f323006e340 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3244000f60 tx=0x7f32440079d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:46.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.392+0000 7f9adbfff640 1 -- 172.21.15.17:0/2370256530 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad4037070 con 0x7f9ae40afde0 2024-09-05T07:29:46.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.394+0000 7f323effd640 1 -- 172.21.15.17:0/3906271333 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f32400576f0 con 0x7f32500c8ae0 2024-09-05T07:29:46.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.394+0000 7f9adbfff640 1 -- 172.21.15.17:0/2370256530 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ad402ae50 con 0x7f9ae40afde0 2024-09-05T07:29:46.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.394+0000 7f9adbfff640 1 -- 172.21.15.17:0/2370256530 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad4032660 con 0x7f9ae40afde0 2024-09-05T07:29:46.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.395+0000 7f9aeb9e4640 1 -- 172.21.15.17:0/2370256530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ae40afde0 msgr2=0x7f9ae4067d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:46.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.395+0000 7f9aeb9e4640 1 --2- 172.21.15.17:0/2370256530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ae40afde0 0x7f9ae4067d30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9ad40097a0 tx=0x7f9ad402a140 comp rx=0 tx=0).stop 2024-09-05T07:29:46.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.395+0000 7f9aeb9e4640 1 -- 172.21.15.17:0/2370256530 shutdown_connections 2024-09-05T07:29:46.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.395+0000 7f9aeb9e4640 1 --2- 172.21.15.17:0/2370256530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ae40afde0 0x7f9ae4067d30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.395+0000 7f9aeb9e4640 1 -- 172.21.15.17:0/2370256530 >> 172.21.15.17:0/2370256530 conn(0x7f9ae40cd260 msgr2=0x7f9ae40cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:46.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.395+0000 7f9aeb9e4640 1 -- 172.21.15.17:0/2370256530 shutdown_connections 2024-09-05T07:29:46.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.395+0000 7f9aeb9e4640 1 -- 172.21.15.17:0/2370256530 wait complete. 2024-09-05T07:29:46.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.396+0000 7f8d96ffd640 1 -- 172.21.15.17:0/3772361389 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8da0023020 con 0x7f8da81580f0 2024-09-05T07:29:46.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.396+0000 7f9aeb9e4640 1 Processor -- start 2024-09-05T07:29:46.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.396+0000 7f9aeb9e4640 1 -- start start 2024-09-05T07:29:46.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.397+0000 7f9aeb9e4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ae4067950 0x7f9ae41f1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:46.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.398+0000 7f9aeb9e4640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ae4072820 0x7f9ae40b1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:46.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.398+0000 7f9aeb9e4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ae40afde0 0x7f9ae4152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:46.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.398+0000 7f9aeb9e4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae415e6f0 con 0x7f9ae4067950 2024-09-05T07:29:46.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.398+0000 7f9aeb9e4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae415e570 con 0x7f9ae40afde0 2024-09-05T07:29:46.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.398+0000 7f9aeb9e4640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f9ae4150dc0 con 0x7f9ae4072820 2024-09-05T07:29:46.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.398+0000 7f9ae9f81640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ae40afde0 0x7f9ae4152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:46.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.398+0000 7f9ae9f81640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ae40afde0 0x7f9ae4152c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:36362/0 (socket says 172.21.15.17:36362) 2024-09-05T07:29:46.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.398+0000 7f9ae9f81640 1 -- 172.21.15.17:0/3273453989 learned_addr learned my addr 172.21.15.17:0/3273453989 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:46.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.402+0000 7f9ae9f81640 1 -- 172.21.15.17:0/3273453989 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ae4072820 msgr2=0x7f9ae40b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:46.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.402+0000 7f9ae9f81640 1 --2- 172.21.15.17:0/3273453989 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ae4072820 0x7f9ae40b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.402+0000 7f9ae9f81640 1 -- 172.21.15.17:0/3273453989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ae4067950 msgr2=0x7f9ae41f1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:46.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.402+0000 7f9ae9f81640 1 --2- 172.21.15.17:0/3273453989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ae4067950 0x7f9ae41f1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.402+0000 7f9ae9f81640 1 -- 172.21.15.17:0/3273453989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ae4150ae0 con 0x7f9ae40afde0 2024-09-05T07:29:46.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.404+0000 7f9ae9f81640 1 --2- 172.21.15.17:0/3273453989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ae40afde0 0x7f9ae4152c10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9adc00c7b0 tx=0x7f9adc00cc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:46.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.406+0000 7f9ad9ffb640 1 -- 172.21.15.17:0/3273453989 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc017070 con 0x7f9ae40afde0 2024-09-05T07:29:46.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.406+0000 7f9aeb9e4640 1 -- 172.21.15.17:0/3273453989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ae41f0890 con 0x7f9ae40afde0 2024-09-05T07:29:46.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.407+0000 7f9aeb9e4640 1 -- 172.21.15.17:0/3273453989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ae41e4b40 con 0x7f9ae40afde0 2024-09-05T07:29:46.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.408+0000 7f9aeb9e4640 1 -- 172.21.15.17:0/3273453989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ae40c8ba0 con 0x7f9ae40afde0 2024-09-05T07:29:46.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.415+0000 7fd5b1ffb640 1 -- 172.21.15.17:0/4259232280 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd5b805dc00 con 0x7fd5bc0cabb0 2024-09-05T07:29:46.415 INFO:teuthology.orchestra.run.smithi017.stdout:64424509451 2024-09-05T07:29:46.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.417+0000 7fd5c37e8640 1 -- 172.21.15.17:0/4259232280 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd5a006be80 msgr2=0x7fd5a006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:46.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.417+0000 7fd5c37e8640 1 --2- 172.21.15.17:0/4259232280 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd5a006be80 0x7fd5a006e340 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac034000 tx=0x7fd5ac02e000 comp rx=0 tx=0).stop 2024-09-05T07:29:46.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.417+0000 7fd5c37e8640 1 -- 172.21.15.17:0/4259232280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5bc0cabb0 msgr2=0x7fd5bc0c8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:46.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.417+0000 7fd5c37e8640 1 --2- 172.21.15.17:0/4259232280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5bc0cabb0 0x7fd5bc0c8140 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd5b800e9b0 tx=0x7fd5b800ee70 comp rx=0 tx=0).stop 2024-09-05T07:29:46.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.417+0000 7fd5c37e8640 1 -- 172.21.15.17:0/4259232280 shutdown_connections 2024-09-05T07:29:46.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.417+0000 7fd5c37e8640 1 --2- 172.21.15.17:0/4259232280 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd5a006be80 0x7fd5a006e340 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.417+0000 7fd5c37e8640 1 --2- 172.21.15.17:0/4259232280 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd5bc0d07a0 0x7fd5bc0c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.417+0000 7fd5c37e8640 1 --2- 172.21.15.17:0/4259232280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5bc0d0b80 0x7fd5bc14db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.417+0000 7fd5c37e8640 1 --2- 172.21.15.17:0/4259232280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5bc0cabb0 0x7fd5bc0c8140 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.417+0000 7fd5c37e8640 1 -- 172.21.15.17:0/4259232280 >> 172.21.15.17:0/4259232280 conn(0x7fd5bc073710 msgr2=0x7fd5bc073af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:46.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.417+0000 7fd5c37e8640 1 -- 172.21.15.17:0/4259232280 shutdown_connections 2024-09-05T07:29:46.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.417+0000 7fd5c37e8640 1 -- 172.21.15.17:0/4259232280 wait complete. 2024-09-05T07:29:46.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.420+0000 7f43ab7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f43ac073b00 0x7f43ac15ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:46.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.421+0000 7f43ab7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f43ac073b00 0x7f43ac15ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60826/0 (socket says 172.21.15.17:60826) 2024-09-05T07:29:46.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.421+0000 7f43ab7fe640 1 -- 172.21.15.17:0/582795785 learned_addr learned my addr 172.21.15.17:0/582795785 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:46.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.425+0000 7f43ab7fe640 1 -- 172.21.15.17:0/582795785 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43ac0c8e40 msgr2=0x7f43ac1566e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:46.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.425+0000 7f43ab7fe640 1 --2- 172.21.15.17:0/582795785 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43ac0c8e40 0x7f43ac1566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.425+0000 7f43ab7fe640 1 -- 172.21.15.17:0/582795785 >> v1:172.21.15.17:6789/0 conn(0x7f43ac073ee0 legacy=0x7f43ac06f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:46.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.425+0000 7f43ab7fe640 1 -- 172.21.15.17:0/582795785 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43ac073630 con 0x7f43ac073b00 2024-09-05T07:29:46.429 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.2 2024-09-05T07:29:46.429 DEBUG:teuthology.parallel:result is None 2024-09-05T07:29:46.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.429+0000 7f43ab7fe640 1 --2- 172.21.15.17:0/582795785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43ac073b00 0x7f43ac15ac60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f439c009870 tx=0x7f439c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96eb5b5b8fcaa14c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:46.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.439+0000 7f43aa7fc640 1 -- 172.21.15.17:0/582795785 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439c037070 con 0x7f43ac073b00 2024-09-05T07:29:46.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.439+0000 7f43aa7fc640 1 -- 172.21.15.17:0/582795785 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f439c032440 con 0x7f43ac073b00 2024-09-05T07:29:46.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.439+0000 7f43aa7fc640 1 -- 172.21.15.17:0/582795785 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439c032810 con 0x7f43ac073b00 2024-09-05T07:29:46.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.439+0000 7f43b1be8640 1 -- 172.21.15.17:0/582795785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43ac073b00 msgr2=0x7f43ac15ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:46.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.439+0000 7f43b1be8640 1 --2- 172.21.15.17:0/582795785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43ac073b00 0x7f43ac15ac60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f439c009870 tx=0x7f439c02a180 comp rx=0 tx=0).stop 2024-09-05T07:29:46.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.439+0000 7f43b1be8640 1 -- 172.21.15.17:0/582795785 shutdown_connections 2024-09-05T07:29:46.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.439+0000 7f43b1be8640 1 --2- 172.21.15.17:0/582795785 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43ac0c8e40 0x7f43ac1566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.439+0000 7f43b1be8640 1 --2- 172.21.15.17:0/582795785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43ac073b00 0x7f43ac15ac60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.439+0000 7f43b1be8640 1 -- 172.21.15.17:0/582795785 >> 172.21.15.17:0/582795785 conn(0x7f43ac0cd260 msgr2=0x7f43ac0cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:46.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.439+0000 7f43b1be8640 1 -- 172.21.15.17:0/582795785 shutdown_connections 2024-09-05T07:29:46.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.439+0000 7f43b1be8640 1 -- 172.21.15.17:0/582795785 wait complete. 2024-09-05T07:29:46.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.441+0000 7f43b1be8640 1 Processor -- start 2024-09-05T07:29:46.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.441+0000 7f43b1be8640 1 -- start start 2024-09-05T07:29:46.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.441+0000 7f43b1be8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43ac073b00 0x7f43ac151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:46.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.442+0000 7f43b1be8640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43ac073ee0 0x7f43ac154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:46.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.442+0000 7f43b1be8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43ac0c8e40 0x7f43ac154c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:46.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.442+0000 7f43b1be8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac0c8940 con 0x7f43ac073b00 2024-09-05T07:29:46.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.442+0000 7f43b1be8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac0c8660 con 0x7f43ac0c8e40 2024-09-05T07:29:46.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.442+0000 7f43b1be8640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f43ac06fe90 con 0x7f43ac073ee0 2024-09-05T07:29:46.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.442+0000 7f43ab7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43ac073b00 0x7f43ac151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:46.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.443+0000 7f43ab7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43ac073b00 0x7f43ac151b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60844/0 (socket says 172.21.15.17:60844) 2024-09-05T07:29:46.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.443+0000 7f43ab7fe640 1 -- 172.21.15.17:0/259428282 learned_addr learned my addr 172.21.15.17:0/259428282 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:46.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.448+0000 7f43ab7fe640 1 -- 172.21.15.17:0/259428282 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43ac073ee0 msgr2=0x7f43ac154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:46.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.448+0000 7f43ab7fe640 1 --2- 172.21.15.17:0/259428282 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43ac073ee0 0x7f43ac154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.448+0000 7f43ab7fe640 1 -- 172.21.15.17:0/259428282 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43ac0c8e40 msgr2=0x7f43ac154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:46.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.448+0000 7f43ab7fe640 1 --2- 172.21.15.17:0/259428282 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43ac0c8e40 0x7f43ac154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.448+0000 7f43ab7fe640 1 -- 172.21.15.17:0/259428282 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43ac152930 con 0x7f43ac073b00 2024-09-05T07:29:46.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.451+0000 7f43ab7fe640 1 --2- 172.21.15.17:0/259428282 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43ac073b00 0x7f43ac151b40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f439c000c00 tx=0x7f439c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:46.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.455+0000 7f4393fff640 1 -- 172.21.15.17:0/259428282 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439c041070 con 0x7f43ac073b00 2024-09-05T07:29:46.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.455+0000 7f4393fff640 1 -- 172.21.15.17:0/259428282 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f439c03c870 con 0x7f43ac073b00 2024-09-05T07:29:46.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.455+0000 7f4393fff640 1 -- 172.21.15.17:0/259428282 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439c037040 con 0x7f43ac073b00 2024-09-05T07:29:46.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.455+0000 7f43b1be8640 1 -- 172.21.15.17:0/259428282 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43ac153620 con 0x7f43ac073b00 2024-09-05T07:29:46.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.455+0000 7f43b1be8640 1 -- 172.21.15.17:0/259428282 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43ac068820 con 0x7f43ac073b00 2024-09-05T07:29:46.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.456+0000 7f43b1be8640 1 -- 172.21.15.17:0/259428282 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43ac072800 con 0x7f43ac073b00 2024-09-05T07:29:46.523 INFO:tasks.ceph.mds.f.smithi026.stderr:2024-09-05T07:29:46.520+0000 f741640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-05T07:29:46.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.587+0000 7f8dacbfd640 1 -- 172.21.15.17:0/3772361389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f8da80c8810 con 0x7f8da81580f0 2024-09-05T07:29:46.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.662+0000 7f323effd640 1 -- 172.21.15.17:0/3906271333 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f32500c76b0 con 0x7f32500c8ae0 2024-09-05T07:29:46.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.687+0000 7f9ad9ffb640 1 -- 172.21.15.17:0/3273453989 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9adc003d80 con 0x7f9ae40afde0 2024-09-05T07:29:46.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.687+0000 7f9ad9ffb640 1 -- 172.21.15.17:0/3273453989 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc021060 con 0x7f9ae40afde0 2024-09-05T07:29:46.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.687+0000 7f9ad9ffb640 1 -- 172.21.15.17:0/3273453989 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9adc01a070 con 0x7f9ae40afde0 2024-09-05T07:29:46.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.688+0000 7f9ad9ffb640 1 --2- 172.21.15.17:0/3273453989 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f9ac806be30 0x7f9ac806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:46.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.688+0000 7f9ae9780640 1 --2- 172.21.15.17:0/3273453989 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f9ac806be30 0x7f9ac806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:46.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.688+0000 7f9ae9780640 1 --2- 172.21.15.17:0/3273453989 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f9ac806be30 0x7f9ac806e2f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0000f60 tx=0x7f9ae0007a80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:46.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.691+0000 7f9ad9ffb640 1 -- 172.21.15.17:0/3273453989 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f9adc056d10 con 0x7f9ae40afde0 2024-09-05T07:29:46.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.706+0000 7f9ad9ffb640 1 -- 172.21.15.17:0/3273453989 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9ae40c8ba0 con 0x7f9ae40afde0 2024-09-05T07:29:46.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.735+0000 7f4393fff640 1 -- 172.21.15.17:0/259428282 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f439c044070 con 0x7f43ac073b00 2024-09-05T07:29:46.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.735+0000 7f4393fff640 1 --2- 172.21.15.17:0/259428282 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f439806be30 0x7f439806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:46.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.736+0000 7f43aaffd640 1 --2- 172.21.15.17:0/259428282 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f439806be30 0x7f439806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:46.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.736+0000 7f43aaffd640 1 --2- 172.21.15.17:0/259428282 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f439806be30 0x7f439806e2f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f43ac1f2720 tx=0x7f43a0006ba0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:46.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.751+0000 7f4393fff640 1 -- 172.21.15.17:0/259428282 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f439c0780f0 con 0x7f43ac073b00 2024-09-05T07:29:46.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.751+0000 7f4393fff640 1 -- 172.21.15.17:0/259428282 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f439c07a750 con 0x7f43ac073b00 2024-09-05T07:29:46.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.775+0000 7f8d96ffd640 1 -- 172.21.15.17:0/3772361389 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8da00599e0 con 0x7f8da81580f0 2024-09-05T07:29:46.776 INFO:teuthology.orchestra.run.smithi017.stdout:64424509450 2024-09-05T07:29:46.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.777+0000 7f8dacbfd640 1 -- 172.21.15.17:0/3772361389 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f8d8806be80 msgr2=0x7f8d8806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:46.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.777+0000 7f8dacbfd640 1 --2- 172.21.15.17:0/3772361389 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f8d8806be80 0x7f8d8806e340 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8d98034000 tx=0x7f8d9802c000 comp rx=0 tx=0).stop 2024-09-05T07:29:46.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.777+0000 7f8dacbfd640 1 -- 172.21.15.17:0/3772361389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8da81580f0 msgr2=0x7f8da81e4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:46.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.777+0000 7f8dacbfd640 1 --2- 172.21.15.17:0/3772361389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8da81580f0 0x7f8da81e4a30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8da000b9d0 tx=0x7f8da000be90 comp rx=0 tx=0).stop 2024-09-05T07:29:46.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.778+0000 7f8dacbfd640 1 -- 172.21.15.17:0/3772361389 shutdown_connections 2024-09-05T07:29:46.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.778+0000 7f8dacbfd640 1 --2- 172.21.15.17:0/3772361389 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f8d8806be80 0x7f8d8806e340 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.778+0000 7f8dacbfd640 1 --2- 172.21.15.17:0/3772361389 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8da80c95b0 0x7f8da81e44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.778+0000 7f8dacbfd640 1 --2- 172.21.15.17:0/3772361389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8da81580f0 0x7f8da81e4a30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.778+0000 7f8dacbfd640 1 --2- 172.21.15.17:0/3772361389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8da80c8ba0 0x7f8da80cc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.778+0000 7f8dacbfd640 1 -- 172.21.15.17:0/3772361389 >> 172.21.15.17:0/3772361389 conn(0x7f8da80cd440 msgr2=0x7f8da80c9ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:46.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.778+0000 7f8dacbfd640 1 -- 172.21.15.17:0/3772361389 shutdown_connections 2024-09-05T07:29:46.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.778+0000 7f8dacbfd640 1 -- 172.21.15.17:0/3772361389 wait complete. 2024-09-05T07:29:46.794 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.0 2024-09-05T07:29:46.794 DEBUG:teuthology.parallel:result is None 2024-09-05T07:29:46.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.871+0000 7f3254ff6640 1 -- 172.21.15.17:0/3906271333 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f3250151b00 con 0x7f32500c8ae0 2024-09-05T07:29:46.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.895+0000 7f323effd640 1 -- 172.21.15.17:0/3906271333 <== mon.2 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f324001f020 con 0x7f32500c8ae0 2024-09-05T07:29:46.896 INFO:teuthology.orchestra.run.smithi017.stdout:60129542155 2024-09-05T07:29:46.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.898+0000 7f3254ff6640 1 -- 172.21.15.17:0/3906271333 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f323006be80 msgr2=0x7f323006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:46.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.898+0000 7f3254ff6640 1 --2- 172.21.15.17:0/3906271333 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f323006be80 0x7f323006e340 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3244000f60 tx=0x7f32440079d0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.898+0000 7f3254ff6640 1 -- 172.21.15.17:0/3906271333 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f32500c8ae0 msgr2=0x7f3250156dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:46.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.898+0000 7f3254ff6640 1 --2- 172.21.15.17:0/3906271333 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f32500c8ae0 0x7f3250156dd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f324000b410 tx=0x7f324000b8d0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.898+0000 7f3254ff6640 1 -- 172.21.15.17:0/3906271333 shutdown_connections 2024-09-05T07:29:46.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.898+0000 7f3254ff6640 1 --2- 172.21.15.17:0/3906271333 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f323006be80 0x7f323006e340 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.898+0000 7f3254ff6640 1 --2- 172.21.15.17:0/3906271333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3250151720 0x7f3250152c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.898+0000 7f3254ff6640 1 --2- 172.21.15.17:0/3906271333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32500ca060 0x7f32501526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.898+0000 7f3254ff6640 1 --2- 172.21.15.17:0/3906271333 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f32500c8ae0 0x7f3250156dd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.898+0000 7f3254ff6640 1 -- 172.21.15.17:0/3906271333 >> 172.21.15.17:0/3906271333 conn(0x7f3250070250 msgr2=0x7f32500c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:46.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.898+0000 7f3254ff6640 1 -- 172.21.15.17:0/3906271333 shutdown_connections 2024-09-05T07:29:46.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.898+0000 7f3254ff6640 1 -- 172.21.15.17:0/3906271333 wait complete. 2024-09-05T07:29:46.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542155 for osd.4 2024-09-05T07:29:46.910 DEBUG:teuthology.parallel:result is None 2024-09-05T07:29:46.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.921+0000 7f9aeb9e4640 1 -- 172.21.15.17:0/3273453989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f9ae4067d30 con 0x7f9ae40afde0 2024-09-05T07:29:46.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.942+0000 7f43b1be8640 1 -- 172.21.15.17:0/259428282 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f43ac0c9c60 con 0x7f43ac073b00 2024-09-05T07:29:46.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.976+0000 7f9ad9ffb640 1 -- 172.21.15.17:0/3273453989 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9adc058c70 con 0x7f9ae40afde0 2024-09-05T07:29:46.977 INFO:teuthology.orchestra.run.smithi017.stdout:64424509451 2024-09-05T07:29:46.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.979+0000 7f9aeb9e4640 1 -- 172.21.15.17:0/3273453989 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f9ac806be30 msgr2=0x7f9ac806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:46.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.979+0000 7f9aeb9e4640 1 --2- 172.21.15.17:0/3273453989 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f9ac806be30 0x7f9ac806e2f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0000f60 tx=0x7f9ae0007a80 comp rx=0 tx=0).stop 2024-09-05T07:29:46.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.979+0000 7f9aeb9e4640 1 -- 172.21.15.17:0/3273453989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ae40afde0 msgr2=0x7f9ae4152c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:46.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.979+0000 7f9aeb9e4640 1 --2- 172.21.15.17:0/3273453989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ae40afde0 0x7f9ae4152c10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9adc00c7b0 tx=0x7f9adc00cc70 comp rx=0 tx=0).stop 2024-09-05T07:29:46.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.979+0000 7f9aeb9e4640 1 -- 172.21.15.17:0/3273453989 shutdown_connections 2024-09-05T07:29:46.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.979+0000 7f9aeb9e4640 1 --2- 172.21.15.17:0/3273453989 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f9ac806be30 0x7f9ac806e2f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.979+0000 7f9aeb9e4640 1 --2- 172.21.15.17:0/3273453989 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ae4072820 0x7f9ae40b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.979+0000 7f9aeb9e4640 1 --2- 172.21.15.17:0/3273453989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ae40afde0 0x7f9ae4152c10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.979+0000 7f9aeb9e4640 1 --2- 172.21.15.17:0/3273453989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ae4067950 0x7f9ae41f1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:46.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.979+0000 7f9aeb9e4640 1 -- 172.21.15.17:0/3273453989 >> 172.21.15.17:0/3273453989 conn(0x7f9ae40cd260 msgr2=0x7f9ae40cca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:46.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.979+0000 7f9aeb9e4640 1 -- 172.21.15.17:0/3273453989 shutdown_connections 2024-09-05T07:29:46.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:46.979+0000 7f9aeb9e4640 1 -- 172.21.15.17:0/3273453989 wait complete. 2024-09-05T07:29:46.990 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.3 2024-09-05T07:29:46.990 DEBUG:teuthology.parallel:result is None 2024-09-05T07:29:47.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.023+0000 7f4393fff640 1 -- 172.21.15.17:0/259428282 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f439c07a050 con 0x7f43ac073b00 2024-09-05T07:29:47.023 INFO:teuthology.orchestra.run.smithi017.stdout:64424509450 2024-09-05T07:29:47.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.025+0000 7f43b1be8640 1 -- 172.21.15.17:0/259428282 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f439806be30 msgr2=0x7f439806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:47.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.025+0000 7f43b1be8640 1 --2- 172.21.15.17:0/259428282 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f439806be30 0x7f439806e2f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f43ac1f2720 tx=0x7f43a0006ba0 comp rx=0 tx=0).stop 2024-09-05T07:29:47.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.025+0000 7f43b1be8640 1 -- 172.21.15.17:0/259428282 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43ac073b00 msgr2=0x7f43ac151b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:47.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.025+0000 7f43b1be8640 1 --2- 172.21.15.17:0/259428282 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43ac073b00 0x7f43ac151b40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f439c000c00 tx=0x7f439c0046c0 comp rx=0 tx=0).stop 2024-09-05T07:29:47.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.025+0000 7f43b1be8640 1 -- 172.21.15.17:0/259428282 shutdown_connections 2024-09-05T07:29:47.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.025+0000 7f43b1be8640 1 --2- 172.21.15.17:0/259428282 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f439806be30 0x7f439806e2f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:47.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.025+0000 7f43b1be8640 1 --2- 172.21.15.17:0/259428282 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43ac073ee0 0x7f43ac154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:47.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.025+0000 7f43b1be8640 1 --2- 172.21.15.17:0/259428282 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43ac0c8e40 0x7f43ac154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:47.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.025+0000 7f43b1be8640 1 --2- 172.21.15.17:0/259428282 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43ac073b00 0x7f43ac151b40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:47.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.025+0000 7f43b1be8640 1 -- 172.21.15.17:0/259428282 >> 172.21.15.17:0/259428282 conn(0x7f43ac0cd260 msgr2=0x7f43ac0cc990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:47.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.025+0000 7f43b1be8640 1 -- 172.21.15.17:0/259428282 shutdown_connections 2024-09-05T07:29:47.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.025+0000 7f43b1be8640 1 -- 172.21.15.17:0/259428282 wait complete. 2024-09-05T07:29:47.037 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.1 2024-09-05T07:29:47.037 DEBUG:teuthology.parallel:result is None 2024-09-05T07:29:47.037 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-05T07:29:47.038 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T07:29:47.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.177+0000 7f8d6f6ba640 1 Processor -- start 2024-09-05T07:29:47.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.177+0000 7f8d6f6ba640 1 -- start start 2024-09-05T07:29:47.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.178+0000 7f8d6f6ba640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8d68154770 0x7f8d6815b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:47.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.178+0000 7f8d6f6ba640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d680c5a80 0x7f8d680c5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:47.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.178+0000 7f8d6f6ba640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d6806c8c0 con 0x7f8d680cafa0 2024-09-05T07:29:47.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.178+0000 7f8d6f6ba640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f8d680c5310 con 0x7f8d68154770 2024-09-05T07:29:47.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.178+0000 7f8d6f6ba640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f8d680cb950 con 0x7f8d680c5a80 2024-09-05T07:29:47.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.179+0000 7f8d6d456640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8d68154770 0x7f8d6815b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:47.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.179+0000 7f8d6cc55640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f8d680cafa0 0x7f8d680d05c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42232/0 (socket says 172.21.15.17:42232) 2024-09-05T07:29:47.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.179+0000 7f8d6cc55640 1 -- 172.21.15.17:0/1445939036 learned_addr learned my addr 172.21.15.17:0/1445939036 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:29:47.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.179+0000 7f8d6dc57640 1 --2- 172.21.15.17:0/1445939036 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d680c5a80 0x7f8d680c5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:47.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.181+0000 7f8d5ffff640 1 -- 172.21.15.17:0/1445939036 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4136347290 0 0) 0x7f8d6806c8c0 con 0x7f8d680cafa0 2024-09-05T07:29:47.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.181+0000 7f8d5ffff640 1 -- 172.21.15.17:0/1445939036 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d54003520 con 0x7f8d680cafa0 2024-09-05T07:29:47.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.182+0000 7f8d6d456640 1 -- 172.21.15.17:0/1445939036 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d680c5a80 msgr2=0x7f8d680c5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:47.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.182+0000 7f8d6d456640 1 --2- 172.21.15.17:0/1445939036 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d680c5a80 0x7f8d680c5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:47.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.182+0000 7f8d6d456640 1 -- 172.21.15.17:0/1445939036 >> v1:172.21.15.17:6789/0 conn(0x7f8d680cafa0 legacy=0x7f8d680d05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:47.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.182+0000 7f8d6d456640 1 -- 172.21.15.17:0/1445939036 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6806cb60 con 0x7f8d68154770 2024-09-05T07:29:47.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.184+0000 7f8d6d456640 1 --2- 172.21.15.17:0/1445939036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d68154770 0x7f8d6815b240 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8d680c5490 tx=0x7f8d6002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=592f0c0ddac60820 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:47.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.189+0000 7f8d5ffff640 1 -- 172.21.15.17:0/1445939036 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d60037070 con 0x7f8d68154770 2024-09-05T07:29:47.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.189+0000 7f8d5ffff640 1 -- 172.21.15.17:0/1445939036 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d6002ae50 con 0x7f8d68154770 2024-09-05T07:29:47.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.189+0000 7f8d5ffff640 1 -- 172.21.15.17:0/1445939036 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d60032660 con 0x7f8d68154770 2024-09-05T07:29:47.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.190+0000 7f8d6f6ba640 1 -- 172.21.15.17:0/1445939036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d68154770 msgr2=0x7f8d6815b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:47.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.190+0000 7f8d6f6ba640 1 --2- 172.21.15.17:0/1445939036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d68154770 0x7f8d6815b240 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8d680c5490 tx=0x7f8d6002a100 comp rx=0 tx=0).stop 2024-09-05T07:29:47.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.190+0000 7f8d6f6ba640 1 -- 172.21.15.17:0/1445939036 shutdown_connections 2024-09-05T07:29:47.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.190+0000 7f8d6f6ba640 1 --2- 172.21.15.17:0/1445939036 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d680c5a80 0x7f8d680c5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:47.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.190+0000 7f8d6f6ba640 1 --2- 172.21.15.17:0/1445939036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d68154770 0x7f8d6815b240 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:47.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.190+0000 7f8d6f6ba640 1 -- 172.21.15.17:0/1445939036 >> 172.21.15.17:0/1445939036 conn(0x7f8d68073710 msgr2=0x7f8d68073b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:47.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.190+0000 7f8d6f6ba640 1 -- 172.21.15.17:0/1445939036 shutdown_connections 2024-09-05T07:29:47.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.190+0000 7f8d6f6ba640 1 -- 172.21.15.17:0/1445939036 wait complete. 2024-09-05T07:29:47.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.191+0000 7f8d6f6ba640 1 Processor -- start 2024-09-05T07:29:47.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.191+0000 7f8d6f6ba640 1 -- start start 2024-09-05T07:29:47.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.192+0000 7f8d6f6ba640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d680c5a80 0x7f8d681f0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:47.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.192+0000 7f8d6f6ba640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d680cafa0 0x7f8d681f3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:47.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.192+0000 7f8d6f6ba640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d68154770 0x7f8d6814f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:47.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.192+0000 7f8d6f6ba640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8d680c6430 con 0x7f8d680cafa0 2024-09-05T07:29:47.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.192+0000 7f8d6f6ba640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8d680cbc30 con 0x7f8d68154770 2024-09-05T07:29:47.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.192+0000 7f8d6f6ba640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f8d68154b50 con 0x7f8d680c5a80 2024-09-05T07:29:47.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.193+0000 7f8d6cc55640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d680cafa0 0x7f8d681f3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:47.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.193+0000 7f8d6dc57640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d68154770 0x7f8d6814f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:47.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.193+0000 7f8d6d456640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d680c5a80 0x7f8d681f0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:47.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.193+0000 7f8d6dc57640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d68154770 0x7f8d6814f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:36394/0 (socket says 172.21.15.17:36394) 2024-09-05T07:29:47.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.193+0000 7f8d6dc57640 1 -- 172.21.15.17:0/892387752 learned_addr learned my addr 172.21.15.17:0/892387752 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:47.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.197+0000 7f8d6d456640 1 -- 172.21.15.17:0/892387752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d68154770 msgr2=0x7f8d6814f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:47.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.197+0000 7f8d6d456640 1 --2- 172.21.15.17:0/892387752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d68154770 0x7f8d6814f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:47.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.197+0000 7f8d6d456640 1 -- 172.21.15.17:0/892387752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d680cafa0 msgr2=0x7f8d681f3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:47.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.197+0000 7f8d6d456640 1 --2- 172.21.15.17:0/892387752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d680cafa0 0x7f8d681f3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:47.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.197+0000 7f8d6d456640 1 -- 172.21.15.17:0/892387752 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d681551e0 con 0x7f8d680c5a80 2024-09-05T07:29:47.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.197+0000 7f8d6cc55640 1 --2- 172.21.15.17:0/892387752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d680cafa0 0x7f8d681f3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:29:47.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.199+0000 7f8d6d456640 1 --2- 172.21.15.17:0/892387752 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d680c5a80 0x7f8d681f0aa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8d6806ca90 tx=0x7f8d600046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:47.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.204+0000 7f8d5dffb640 1 -- 172.21.15.17:0/892387752 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d60041020 con 0x7f8d680c5a80 2024-09-05T07:29:47.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.204+0000 7f8d5dffb640 1 -- 172.21.15.17:0/892387752 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d6003d690 con 0x7f8d680c5a80 2024-09-05T07:29:47.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.204+0000 7f8d5dffb640 1 -- 172.21.15.17:0/892387752 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d60037040 con 0x7f8d680c5a80 2024-09-05T07:29:47.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.204+0000 7f8d6f6ba640 1 -- 172.21.15.17:0/892387752 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d681554c0 con 0x7f8d680c5a80 2024-09-05T07:29:47.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.205+0000 7f8d6f6ba640 1 -- 172.21.15.17:0/892387752 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d681f02a0 con 0x7f8d680c5a80 2024-09-05T07:29:47.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.205+0000 7f8d6f6ba640 1 -- 172.21.15.17:0/892387752 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d6806bca0 con 0x7f8d680c5a80 2024-09-05T07:29:47.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.224+0000 7f8d5dffb640 1 -- 172.21.15.17:0/892387752 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8d6002ad10 con 0x7f8d680c5a80 2024-09-05T07:29:47.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.225+0000 7f8d5dffb640 1 --2- 172.21.15.17:0/892387752 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f8d4c06be60 0x7f8d4c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:47.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.225+0000 7f8d6cc55640 1 --2- 172.21.15.17:0/892387752 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f8d4c06be60 0x7f8d4c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:47.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.225+0000 7f8d6cc55640 1 --2- 172.21.15.17:0/892387752 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f8d4c06be60 0x7f8d4c06e320 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8d681edb60 tx=0x7f8d58009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:47.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.228+0000 7f8d5dffb640 1 -- 172.21.15.17:0/892387752 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8d60077ea0 con 0x7f8d680c5a80 2024-09-05T07:29:47.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.497+0000 7f8d5dffb640 1 -- 172.21.15.17:0/892387752 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8d6004b030 con 0x7f8d680c5a80 2024-09-05T07:29:47.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.671+0000 7f8d6f6ba640 1 -- 172.21.15.17:0/892387752 --> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8d68152380 con 0x7f8d4c06be60 2024-09-05T07:29:47.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.677+0000 7f8d5dffb640 1 -- 172.21.15.17:0/892387752 <== mgr.4099 v2:172.21.15.26:6800/2736912541 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251936 (secure 0 0 0) 0x7f8d68152380 con 0x7f8d4c06be60 2024-09-05T07:29:47.680 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:29:47.682 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-05T07:29:47.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.680+0000 7f8d6f6ba640 1 -- 172.21.15.17:0/892387752 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f8d4c06be60 msgr2=0x7f8d4c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:47.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.680+0000 7f8d6f6ba640 1 --2- 172.21.15.17:0/892387752 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f8d4c06be60 0x7f8d4c06e320 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8d681edb60 tx=0x7f8d58009040 comp rx=0 tx=0).stop 2024-09-05T07:29:47.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.680+0000 7f8d6f6ba640 1 -- 172.21.15.17:0/892387752 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d680c5a80 msgr2=0x7f8d681f0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:47.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.680+0000 7f8d6f6ba640 1 --2- 172.21.15.17:0/892387752 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d680c5a80 0x7f8d681f0aa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8d6806ca90 tx=0x7f8d600046c0 comp rx=0 tx=0).stop 2024-09-05T07:29:47.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.680+0000 7f8d6f6ba640 1 -- 172.21.15.17:0/892387752 shutdown_connections 2024-09-05T07:29:47.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.680+0000 7f8d6f6ba640 1 --2- 172.21.15.17:0/892387752 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f8d4c06be60 0x7f8d4c06e320 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:47.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.680+0000 7f8d6f6ba640 1 --2- 172.21.15.17:0/892387752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d68154770 0x7f8d6814f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:47.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.680+0000 7f8d6f6ba640 1 --2- 172.21.15.17:0/892387752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d680cafa0 0x7f8d681f3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:47.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.680+0000 7f8d6f6ba640 1 --2- 172.21.15.17:0/892387752 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d680c5a80 0x7f8d681f0aa0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:47.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.680+0000 7f8d6f6ba640 1 -- 172.21.15.17:0/892387752 >> 172.21.15.17:0/892387752 conn(0x7f8d68073710 msgr2=0x7f8d680cd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:47.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.680+0000 7f8d6f6ba640 1 -- 172.21.15.17:0/892387752 shutdown_connections 2024-09-05T07:29:47.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.680+0000 7f8d6f6ba640 1 -- 172.21.15.17:0/892387752 wait complete. 2024-09-05T07:29:47.692 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-09-05T07:29:45.875612+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595002,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":282,"num_write_kb":2453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":269124,"kb_used_data":3012,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754705596,"statfs":{"total":773094113280,"available":772818530304,"internally_reserved":0,"allocated":3084288,"data_stored":1803078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":272354865},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4564,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002715"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.880921+0000","last_change":"2024-09-05T07:29:30.556803+0000","last_active":"2024-09-05T07:29:31.880921+0000","last_peered":"2024-09-05T07:29:31.880921+0000","last_clean":"2024-09-05T07:29:31.880921+0000","last_became_active":"2024-09-05T07:29:30.556513+0000","last_became_peered":"2024-09-05T07:29:30.556513+0000","last_unstale":"2024-09-05T07:29:31.880921+0000","last_undegraded":"2024-09-05T07:29:31.880921+0000","last_fullsized":"2024-09-05T07:29:31.880921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:38:11.961137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.631582+0000","last_change":"2024-09-05T07:29:30.658489+0000","last_active":"2024-09-05T07:29:31.631582+0000","last_peered":"2024-09-05T07:29:31.631582+0000","last_clean":"2024-09-05T07:29:31.631582+0000","last_became_active":"2024-09-05T07:29:30.658225+0000","last_became_peered":"2024-09-05T07:29:30.658225+0000","last_unstale":"2024-09-05T07:29:31.631582+0000","last_undegraded":"2024-09-05T07:29:31.631582+0000","last_fullsized":"2024-09-05T07:29:31.631582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:03:07.788844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.631512+0000","last_change":"2024-09-05T07:29:30.659535+0000","last_active":"2024-09-05T07:29:31.631512+0000","last_peered":"2024-09-05T07:29:31.631512+0000","last_clean":"2024-09-05T07:29:31.631512+0000","last_became_active":"2024-09-05T07:29:30.659042+0000","last_became_peered":"2024-09-05T07:29:30.659042+0000","last_unstale":"2024-09-05T07:29:31.631512+0000","last_undegraded":"2024-09-05T07:29:31.631512+0000","last_fullsized":"2024-09-05T07:29:31.631512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:08:39.718764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.882099+0000","last_change":"2024-09-05T07:29:30.640489+0000","last_active":"2024-09-05T07:29:31.882099+0000","last_peered":"2024-09-05T07:29:31.882099+0000","last_clean":"2024-09-05T07:29:31.882099+0000","last_became_active":"2024-09-05T07:29:30.640141+0000","last_became_peered":"2024-09-05T07:29:30.640141+0000","last_unstale":"2024-09-05T07:29:31.882099+0000","last_undegraded":"2024-09-05T07:29:31.882099+0000","last_fullsized":"2024-09-05T07:29:31.882099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:53:14.516901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881415+0000","last_change":"2024-09-05T07:29:30.659266+0000","last_active":"2024-09-05T07:29:31.881415+0000","last_peered":"2024-09-05T07:29:31.881415+0000","last_clean":"2024-09-05T07:29:31.881415+0000","last_became_active":"2024-09-05T07:29:30.658981+0000","last_became_peered":"2024-09-05T07:29:30.658981+0000","last_unstale":"2024-09-05T07:29:31.881415+0000","last_undegraded":"2024-09-05T07:29:31.881415+0000","last_fullsized":"2024-09-05T07:29:31.881415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:34:49.879681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881926+0000","last_change":"2024-09-05T07:29:30.641512+0000","last_active":"2024-09-05T07:29:31.881926+0000","last_peered":"2024-09-05T07:29:31.881926+0000","last_clean":"2024-09-05T07:29:31.881926+0000","last_became_active":"2024-09-05T07:29:30.641255+0000","last_became_peered":"2024-09-05T07:29:30.641255+0000","last_unstale":"2024-09-05T07:29:31.881926+0000","last_undegraded":"2024-09-05T07:29:31.881926+0000","last_fullsized":"2024-09-05T07:29:31.881926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:42.938157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881721+0000","last_change":"2024-09-05T07:29:30.556064+0000","last_active":"2024-09-05T07:29:31.881721+0000","last_peered":"2024-09-05T07:29:31.881721+0000","last_clean":"2024-09-05T07:29:31.881721+0000","last_became_active":"2024-09-05T07:29:30.555796+0000","last_became_peered":"2024-09-05T07:29:30.555796+0000","last_unstale":"2024-09-05T07:29:31.881721+0000","last_undegraded":"2024-09-05T07:29:31.881721+0000","last_fullsized":"2024-09-05T07:29:31.881721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:37:28.088603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.631334+0000","last_change":"2024-09-05T07:29:30.659561+0000","last_active":"2024-09-05T07:29:31.631334+0000","last_peered":"2024-09-05T07:29:31.631334+0000","last_clean":"2024-09-05T07:29:31.631334+0000","last_became_active":"2024-09-05T07:29:30.659070+0000","last_became_peered":"2024-09-05T07:29:30.659070+0000","last_unstale":"2024-09-05T07:29:31.631334+0000","last_undegraded":"2024-09-05T07:29:31.631334+0000","last_fullsized":"2024-09-05T07:29:31.631334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:13:33.902479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.907890+0000","last_change":"2024-09-05T07:29:30.565653+0000","last_active":"2024-09-05T07:29:31.907890+0000","last_peered":"2024-09-05T07:29:31.907890+0000","last_clean":"2024-09-05T07:29:31.907890+0000","last_became_active":"2024-09-05T07:29:30.565408+0000","last_became_peered":"2024-09-05T07:29:30.565408+0000","last_unstale":"2024-09-05T07:29:31.907890+0000","last_undegraded":"2024-09-05T07:29:31.907890+0000","last_fullsized":"2024-09-05T07:29:31.907890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:42.938157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881571+0000","last_change":"2024-09-05T07:29:30.643865+0000","last_active":"2024-09-05T07:29:31.881571+0000","last_peered":"2024-09-05T07:29:31.881571+0000","last_clean":"2024-09-05T07:29:31.881571+0000","last_became_active":"2024-09-05T07:29:30.643587+0000","last_became_peered":"2024-09-05T07:29:30.643587+0000","last_unstale":"2024-09-05T07:29:31.881571+0000","last_undegraded":"2024-09-05T07:29:31.881571+0000","last_fullsized":"2024-09-05T07:29:31.881571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:37:46.507371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.880939+0000","last_change":"2024-09-05T07:29:30.557314+0000","last_active":"2024-09-05T07:29:31.880939+0000","last_peered":"2024-09-05T07:29:31.880939+0000","last_clean":"2024-09-05T07:29:31.880939+0000","last_became_active":"2024-09-05T07:29:30.557039+0000","last_became_peered":"2024-09-05T07:29:30.557039+0000","last_unstale":"2024-09-05T07:29:31.880939+0000","last_undegraded":"2024-09-05T07:29:31.880939+0000","last_fullsized":"2024-09-05T07:29:31.880939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:08:39.718764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881426+0000","last_change":"2024-09-05T07:29:30.564518+0000","last_active":"2024-09-05T07:29:31.881426+0000","last_peered":"2024-09-05T07:29:31.881426+0000","last_clean":"2024-09-05T07:29:31.881426+0000","last_became_active":"2024-09-05T07:29:30.564271+0000","last_became_peered":"2024-09-05T07:29:30.564271+0000","last_unstale":"2024-09-05T07:29:31.881426+0000","last_undegraded":"2024-09-05T07:29:31.881426+0000","last_fullsized":"2024-09-05T07:29:31.881426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:09:22.026287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908103+0000","last_change":"2024-09-05T07:29:30.631857+0000","last_active":"2024-09-05T07:29:31.908103+0000","last_peered":"2024-09-05T07:29:31.908103+0000","last_clean":"2024-09-05T07:29:31.908103+0000","last_became_active":"2024-09-05T07:29:30.631588+0000","last_became_peered":"2024-09-05T07:29:30.631588+0000","last_unstale":"2024-09-05T07:29:31.908103+0000","last_undegraded":"2024-09-05T07:29:31.908103+0000","last_fullsized":"2024-09-05T07:29:31.908103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:41:25.696697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908490+0000","last_change":"2024-09-05T07:29:30.632829+0000","last_active":"2024-09-05T07:29:31.908490+0000","last_peered":"2024-09-05T07:29:31.908490+0000","last_clean":"2024-09-05T07:29:31.908490+0000","last_became_active":"2024-09-05T07:29:30.632528+0000","last_became_peered":"2024-09-05T07:29:30.632528+0000","last_unstale":"2024-09-05T07:29:31.908490+0000","last_undegraded":"2024-09-05T07:29:31.908490+0000","last_fullsized":"2024-09-05T07:29:31.908490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:22:35.613478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.631381+0000","last_change":"2024-09-05T07:29:30.657306+0000","last_active":"2024-09-05T07:29:31.631381+0000","last_peered":"2024-09-05T07:29:31.631381+0000","last_clean":"2024-09-05T07:29:31.631381+0000","last_became_active":"2024-09-05T07:29:30.656997+0000","last_became_peered":"2024-09-05T07:29:30.656997+0000","last_unstale":"2024-09-05T07:29:31.631381+0000","last_undegraded":"2024-09-05T07:29:31.631381+0000","last_fullsized":"2024-09-05T07:29:31.631381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:15:28.381136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.625605+0000","last_change":"2024-09-05T07:29:30.641543+0000","last_active":"2024-09-05T07:29:31.625605+0000","last_peered":"2024-09-05T07:29:31.625605+0000","last_clean":"2024-09-05T07:29:31.625605+0000","last_became_active":"2024-09-05T07:29:30.641283+0000","last_became_peered":"2024-09-05T07:29:30.641283+0000","last_unstale":"2024-09-05T07:29:31.625605+0000","last_undegraded":"2024-09-05T07:29:31.625605+0000","last_fullsized":"2024-09-05T07:29:31.625605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:36:59.967135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.626113+0000","last_change":"2024-09-05T07:29:30.558414+0000","last_active":"2024-09-05T07:29:31.626113+0000","last_peered":"2024-09-05T07:29:31.626113+0000","last_clean":"2024-09-05T07:29:31.626113+0000","last_became_active":"2024-09-05T07:29:30.558105+0000","last_became_peered":"2024-09-05T07:29:30.558105+0000","last_unstale":"2024-09-05T07:29:31.626113+0000","last_undegraded":"2024-09-05T07:29:31.626113+0000","last_fullsized":"2024-09-05T07:29:31.626113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:55:31.494616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908249+0000","last_change":"2024-09-05T07:29:30.643169+0000","last_active":"2024-09-05T07:29:31.908249+0000","last_peered":"2024-09-05T07:29:31.908249+0000","last_clean":"2024-09-05T07:29:31.908249+0000","last_became_active":"2024-09-05T07:29:30.642876+0000","last_became_peered":"2024-09-05T07:29:30.642876+0000","last_unstale":"2024-09-05T07:29:31.908249+0000","last_undegraded":"2024-09-05T07:29:31.908249+0000","last_fullsized":"2024-09-05T07:29:31.908249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:40.101513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.626245+0000","last_change":"2024-09-05T07:29:30.557239+0000","last_active":"2024-09-05T07:29:31.626245+0000","last_peered":"2024-09-05T07:29:31.626245+0000","last_clean":"2024-09-05T07:29:31.626245+0000","last_became_active":"2024-09-05T07:29:30.556969+0000","last_became_peered":"2024-09-05T07:29:30.556969+0000","last_unstale":"2024-09-05T07:29:31.626245+0000","last_undegraded":"2024-09-05T07:29:31.626245+0000","last_fullsized":"2024-09-05T07:29:31.626245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:47:29.801348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881573+0000","last_change":"2024-09-05T07:29:30.564077+0000","last_active":"2024-09-05T07:29:31.881573+0000","last_peered":"2024-09-05T07:29:31.881573+0000","last_clean":"2024-09-05T07:29:31.881573+0000","last_became_active":"2024-09-05T07:29:30.563808+0000","last_became_peered":"2024-09-05T07:29:30.563808+0000","last_unstale":"2024-09-05T07:29:31.881573+0000","last_undegraded":"2024-09-05T07:29:31.881573+0000","last_fullsized":"2024-09-05T07:29:31.881573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:00:35.625571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.668993+0000","last_change":"2024-09-05T07:29:30.643879+0000","last_active":"2024-09-05T07:29:31.668993+0000","last_peered":"2024-09-05T07:29:31.668993+0000","last_clean":"2024-09-05T07:29:31.668993+0000","last_became_active":"2024-09-05T07:29:30.643559+0000","last_became_peered":"2024-09-05T07:29:30.643559+0000","last_unstale":"2024-09-05T07:29:31.668993+0000","last_undegraded":"2024-09-05T07:29:31.668993+0000","last_fullsized":"2024-09-05T07:29:31.668993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:52:56.756904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.907631+0000","last_change":"2024-09-05T07:29:30.564954+0000","last_active":"2024-09-05T07:29:31.907631+0000","last_peered":"2024-09-05T07:29:31.907631+0000","last_clean":"2024-09-05T07:29:31.907631+0000","last_became_active":"2024-09-05T07:29:30.564669+0000","last_became_peered":"2024-09-05T07:29:30.564669+0000","last_unstale":"2024-09-05T07:29:31.907631+0000","last_undegraded":"2024-09-05T07:29:31.907631+0000","last_fullsized":"2024-09-05T07:29:31.907631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:53:40.150507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.631446+0000","last_change":"2024-09-05T07:29:30.656718+0000","last_active":"2024-09-05T07:29:31.631446+0000","last_peered":"2024-09-05T07:29:31.631446+0000","last_clean":"2024-09-05T07:29:31.631446+0000","last_became_active":"2024-09-05T07:29:30.656451+0000","last_became_peered":"2024-09-05T07:29:30.656451+0000","last_unstale":"2024-09-05T07:29:31.631446+0000","last_undegraded":"2024-09-05T07:29:31.631446+0000","last_fullsized":"2024-09-05T07:29:31.631446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:38:11.961137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.625602+0000","last_change":"2024-09-05T07:29:30.658481+0000","last_active":"2024-09-05T07:29:31.625602+0000","last_peered":"2024-09-05T07:29:31.625602+0000","last_clean":"2024-09-05T07:29:31.625602+0000","last_became_active":"2024-09-05T07:29:30.658207+0000","last_became_peered":"2024-09-05T07:29:30.658207+0000","last_unstale":"2024-09-05T07:29:31.625602+0000","last_undegraded":"2024-09-05T07:29:31.625602+0000","last_fullsized":"2024-09-05T07:29:31.625602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:23:04.483495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.631597+0000","last_change":"2024-09-05T07:29:30.657936+0000","last_active":"2024-09-05T07:29:31.631597+0000","last_peered":"2024-09-05T07:29:31.631597+0000","last_clean":"2024-09-05T07:29:31.631597+0000","last_became_active":"2024-09-05T07:29:30.657177+0000","last_became_peered":"2024-09-05T07:29:30.657177+0000","last_unstale":"2024-09-05T07:29:31.631597+0000","last_undegraded":"2024-09-05T07:29:31.631597+0000","last_fullsized":"2024-09-05T07:29:31.631597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:01:34.217228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.882231+0000","last_change":"2024-09-05T07:29:30.642790+0000","last_active":"2024-09-05T07:29:31.882231+0000","last_peered":"2024-09-05T07:29:31.882231+0000","last_clean":"2024-09-05T07:29:31.882231+0000","last_became_active":"2024-09-05T07:29:30.641834+0000","last_became_peered":"2024-09-05T07:29:30.641834+0000","last_unstale":"2024-09-05T07:29:31.882231+0000","last_undegraded":"2024-09-05T07:29:31.882231+0000","last_fullsized":"2024-09-05T07:29:31.882231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:34:17.448981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908717+0000","last_change":"2024-09-05T07:29:30.633776+0000","last_active":"2024-09-05T07:29:31.908717+0000","last_peered":"2024-09-05T07:29:31.908717+0000","last_clean":"2024-09-05T07:29:31.908717+0000","last_became_active":"2024-09-05T07:29:30.633507+0000","last_became_peered":"2024-09-05T07:29:30.633507+0000","last_unstale":"2024-09-05T07:29:31.908717+0000","last_undegraded":"2024-09-05T07:29:31.908717+0000","last_fullsized":"2024-09-05T07:29:31.908717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:34:54.335152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908515+0000","last_change":"2024-09-05T07:29:30.632558+0000","last_active":"2024-09-05T07:29:31.908515+0000","last_peered":"2024-09-05T07:29:31.908515+0000","last_clean":"2024-09-05T07:29:31.908515+0000","last_became_active":"2024-09-05T07:29:30.632269+0000","last_became_peered":"2024-09-05T07:29:30.632269+0000","last_unstale":"2024-09-05T07:29:31.908515+0000","last_undegraded":"2024-09-05T07:29:31.908515+0000","last_fullsized":"2024-09-05T07:29:31.908515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:35:18.927192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.631730+0000","last_change":"2024-09-05T07:29:30.656638+0000","last_active":"2024-09-05T07:29:31.631730+0000","last_peered":"2024-09-05T07:29:31.631730+0000","last_clean":"2024-09-05T07:29:31.631730+0000","last_became_active":"2024-09-05T07:29:30.656382+0000","last_became_peered":"2024-09-05T07:29:30.656382+0000","last_unstale":"2024-09-05T07:29:31.631730+0000","last_undegraded":"2024-09-05T07:29:31.631730+0000","last_fullsized":"2024-09-05T07:29:31.631730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:34:49.879681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.625711+0000","last_change":"2024-09-05T07:29:30.657421+0000","last_active":"2024-09-05T07:29:31.625711+0000","last_peered":"2024-09-05T07:29:31.625711+0000","last_clean":"2024-09-05T07:29:31.625711+0000","last_became_active":"2024-09-05T07:29:30.657159+0000","last_became_peered":"2024-09-05T07:29:30.657159+0000","last_unstale":"2024-09-05T07:29:31.625711+0000","last_undegraded":"2024-09-05T07:29:31.625711+0000","last_fullsized":"2024-09-05T07:29:31.625711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:13:05.334750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908422+0000","last_change":"2024-09-05T07:29:30.624866+0000","last_active":"2024-09-05T07:29:31.908422+0000","last_peered":"2024-09-05T07:29:31.908422+0000","last_clean":"2024-09-05T07:29:31.908422+0000","last_became_active":"2024-09-05T07:29:30.624605+0000","last_became_peered":"2024-09-05T07:29:30.624605+0000","last_unstale":"2024-09-05T07:29:31.908422+0000","last_undegraded":"2024-09-05T07:29:31.908422+0000","last_fullsized":"2024-09-05T07:29:31.908422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:42.938157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881624+0000","last_change":"2024-09-05T07:29:30.642514+0000","last_active":"2024-09-05T07:29:31.881624+0000","last_peered":"2024-09-05T07:29:31.881624+0000","last_clean":"2024-09-05T07:29:31.881624+0000","last_became_active":"2024-09-05T07:29:30.642084+0000","last_became_peered":"2024-09-05T07:29:30.642084+0000","last_unstale":"2024-09-05T07:29:31.881624+0000","last_undegraded":"2024-09-05T07:29:31.881624+0000","last_fullsized":"2024-09-05T07:29:31.881624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:40.101513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.907656+0000","last_change":"2024-09-05T07:29:30.657456+0000","last_active":"2024-09-05T07:29:31.907656+0000","last_peered":"2024-09-05T07:29:31.907656+0000","last_clean":"2024-09-05T07:29:31.907656+0000","last_became_active":"2024-09-05T07:29:30.657117+0000","last_became_peered":"2024-09-05T07:29:30.657117+0000","last_unstale":"2024-09-05T07:29:31.907656+0000","last_undegraded":"2024-09-05T07:29:31.907656+0000","last_fullsized":"2024-09-05T07:29:31.907656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:40.101513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'5","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.497941+0000","last_change":"2024-09-05T07:29:29.568126+0000","last_active":"2024-09-05T07:29:36.497941+0000","last_peered":"2024-09-05T07:29:36.497941+0000","last_clean":"2024-09-05T07:29:36.497941+0000","last_became_active":"2024-09-05T07:29:29.567846+0000","last_became_peered":"2024-09-05T07:29:29.567846+0000","last_unstale":"2024-09-05T07:29:36.497941+0000","last_undegraded":"2024-09-05T07:29:36.497941+0000","last_fullsized":"2024-09-05T07:29:36.497941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:48:25.900221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.669165+0000","last_change":"2024-09-05T07:29:30.557504+0000","last_active":"2024-09-05T07:29:31.669165+0000","last_peered":"2024-09-05T07:29:31.669165+0000","last_clean":"2024-09-05T07:29:31.669165+0000","last_became_active":"2024-09-05T07:29:30.557203+0000","last_became_peered":"2024-09-05T07:29:30.557203+0000","last_unstale":"2024-09-05T07:29:31.669165+0000","last_undegraded":"2024-09-05T07:29:31.669165+0000","last_fullsized":"2024-09-05T07:29:31.669165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:55:13.742728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:43.516742+0000","last_change":"2024-09-05T07:29:29.524587+0000","last_active":"2024-09-05T07:29:43.516742+0000","last_peered":"2024-09-05T07:29:43.516742+0000","last_clean":"2024-09-05T07:29:43.516742+0000","last_became_active":"2024-09-05T07:29:29.524321+0000","last_became_peered":"2024-09-05T07:29:29.524321+0000","last_unstale":"2024-09-05T07:29:43.516742+0000","last_undegraded":"2024-09-05T07:29:43.516742+0000","last_fullsized":"2024-09-05T07:29:43.516742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:53:13.376716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:43.514742+0000","last_change":"2024-09-05T07:29:29.570879+0000","last_active":"2024-09-05T07:29:43.514742+0000","last_peered":"2024-09-05T07:29:43.514742+0000","last_clean":"2024-09-05T07:29:43.514742+0000","last_became_active":"2024-09-05T07:29:29.570456+0000","last_became_peered":"2024-09-05T07:29:29.570456+0000","last_unstale":"2024-09-05T07:29:43.514742+0000","last_undegraded":"2024-09-05T07:29:43.514742+0000","last_fullsized":"2024-09-05T07:29:43.514742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:52:54.638586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.632417+0000","last_change":"2024-09-05T07:29:30.657364+0000","last_active":"2024-09-05T07:29:31.632417+0000","last_peered":"2024-09-05T07:29:31.632417+0000","last_clean":"2024-09-05T07:29:31.632417+0000","last_became_active":"2024-09-05T07:29:30.657008+0000","last_became_peered":"2024-09-05T07:29:30.657008+0000","last_unstale":"2024-09-05T07:29:31.632417+0000","last_undegraded":"2024-09-05T07:29:31.632417+0000","last_fullsized":"2024-09-05T07:29:31.632417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:36:59.967135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.626059+0000","last_change":"2024-09-05T07:29:29.562802+0000","last_active":"2024-09-05T07:29:31.626059+0000","last_peered":"2024-09-05T07:29:31.626059+0000","last_clean":"2024-09-05T07:29:31.626059+0000","last_became_active":"2024-09-05T07:29:29.562520+0000","last_became_peered":"2024-09-05T07:29:29.562520+0000","last_unstale":"2024-09-05T07:29:31.626059+0000","last_undegraded":"2024-09-05T07:29:31.626059+0000","last_fullsized":"2024-09-05T07:29:31.626059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:34:16.308797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.669116+0000","last_change":"2024-09-05T07:29:30.563197+0000","last_active":"2024-09-05T07:29:31.669116+0000","last_peered":"2024-09-05T07:29:31.669116+0000","last_clean":"2024-09-05T07:29:31.669116+0000","last_became_active":"2024-09-05T07:29:30.562945+0000","last_became_peered":"2024-09-05T07:29:30.562945+0000","last_unstale":"2024-09-05T07:29:31.669116+0000","last_undegraded":"2024-09-05T07:29:31.669116+0000","last_fullsized":"2024-09-05T07:29:31.669116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:31:37.754325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.489982+0000","last_change":"2024-09-05T07:29:29.559012+0000","last_active":"2024-09-05T07:29:36.489982+0000","last_peered":"2024-09-05T07:29:36.489982+0000","last_clean":"2024-09-05T07:29:36.489982+0000","last_became_active":"2024-09-05T07:29:29.558744+0000","last_became_peered":"2024-09-05T07:29:29.558744+0000","last_unstale":"2024-09-05T07:29:36.489982+0000","last_undegraded":"2024-09-05T07:29:36.489982+0000","last_fullsized":"2024-09-05T07:29:36.489982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:28:41.630593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.882278+0000","last_change":"2024-09-05T07:29:30.641594+0000","last_active":"2024-09-05T07:29:31.882278+0000","last_peered":"2024-09-05T07:29:31.882278+0000","last_clean":"2024-09-05T07:29:31.882278+0000","last_became_active":"2024-09-05T07:29:30.641360+0000","last_became_peered":"2024-09-05T07:29:30.641360+0000","last_unstale":"2024-09-05T07:29:31.882278+0000","last_undegraded":"2024-09-05T07:29:31.882278+0000","last_fullsized":"2024-09-05T07:29:31.882278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:49:40.327718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.506359+0000","last_change":"2024-09-05T07:29:29.559998+0000","last_active":"2024-09-05T07:29:36.506359+0000","last_peered":"2024-09-05T07:29:36.506359+0000","last_clean":"2024-09-05T07:29:36.506359+0000","last_became_active":"2024-09-05T07:29:29.559717+0000","last_became_peered":"2024-09-05T07:29:29.559717+0000","last_unstale":"2024-09-05T07:29:36.506359+0000","last_undegraded":"2024-09-05T07:29:36.506359+0000","last_fullsized":"2024-09-05T07:29:36.506359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:58.513308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.632185+0000","last_change":"2024-09-05T07:29:30.657727+0000","last_active":"2024-09-05T07:29:31.632185+0000","last_peered":"2024-09-05T07:29:31.632185+0000","last_clean":"2024-09-05T07:29:31.632185+0000","last_became_active":"2024-09-05T07:29:30.657038+0000","last_became_peered":"2024-09-05T07:29:30.657038+0000","last_unstale":"2024-09-05T07:29:31.632185+0000","last_undegraded":"2024-09-05T07:29:31.632185+0000","last_fullsized":"2024-09-05T07:29:31.632185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:00:35.625571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.962311+0000","last_change":"2024-09-05T07:29:29.566840+0000","last_active":"2024-09-05T07:29:31.962311+0000","last_peered":"2024-09-05T07:29:31.962311+0000","last_clean":"2024-09-05T07:29:31.962311+0000","last_became_active":"2024-09-05T07:29:29.566501+0000","last_became_peered":"2024-09-05T07:29:29.566501+0000","last_unstale":"2024-09-05T07:29:31.962311+0000","last_undegraded":"2024-09-05T07:29:31.962311+0000","last_fullsized":"2024-09-05T07:29:31.962311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:47:57.187710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.625755+0000","last_change":"2024-09-05T07:29:30.642252+0000","last_active":"2024-09-05T07:29:31.625755+0000","last_peered":"2024-09-05T07:29:31.625755+0000","last_clean":"2024-09-05T07:29:31.625755+0000","last_became_active":"2024-09-05T07:29:30.641991+0000","last_became_peered":"2024-09-05T07:29:30.641991+0000","last_unstale":"2024-09-05T07:29:31.625755+0000","last_undegraded":"2024-09-05T07:29:31.625755+0000","last_fullsized":"2024-09-05T07:29:31.625755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:42:04.216273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.495388+0000","last_change":"2024-09-05T07:29:29.562441+0000","last_active":"2024-09-05T07:29:36.495388+0000","last_peered":"2024-09-05T07:29:36.495388+0000","last_clean":"2024-09-05T07:29:36.495388+0000","last_became_active":"2024-09-05T07:29:29.562136+0000","last_became_peered":"2024-09-05T07:29:29.562136+0000","last_unstale":"2024-09-05T07:29:36.495388+0000","last_undegraded":"2024-09-05T07:29:36.495388+0000","last_fullsized":"2024-09-05T07:29:36.495388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:06:20.633881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881213+0000","last_change":"2024-09-05T07:29:30.633033+0000","last_active":"2024-09-05T07:29:31.881213+0000","last_peered":"2024-09-05T07:29:31.881213+0000","last_clean":"2024-09-05T07:29:31.881213+0000","last_became_active":"2024-09-05T07:29:30.632784+0000","last_became_peered":"2024-09-05T07:29:30.632784+0000","last_unstale":"2024-09-05T07:29:31.881213+0000","last_undegraded":"2024-09-05T07:29:31.881213+0000","last_fullsized":"2024-09-05T07:29:31.881213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:03:07.788844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:43.510115+0000","last_change":"2024-09-05T07:29:29.567195+0000","last_active":"2024-09-05T07:29:43.510115+0000","last_peered":"2024-09-05T07:29:43.510115+0000","last_clean":"2024-09-05T07:29:43.510115+0000","last_became_active":"2024-09-05T07:29:29.566934+0000","last_became_peered":"2024-09-05T07:29:29.566934+0000","last_unstale":"2024-09-05T07:29:43.510115+0000","last_undegraded":"2024-09-05T07:29:43.510115+0000","last_fullsized":"2024-09-05T07:29:43.510115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:10:28.438071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908548+0000","last_change":"2024-09-05T07:29:30.632260+0000","last_active":"2024-09-05T07:29:31.908548+0000","last_peered":"2024-09-05T07:29:31.908548+0000","last_clean":"2024-09-05T07:29:31.908548+0000","last_became_active":"2024-09-05T07:29:30.631974+0000","last_became_peered":"2024-09-05T07:29:30.631974+0000","last_unstale":"2024-09-05T07:29:31.908548+0000","last_undegraded":"2024-09-05T07:29:31.908548+0000","last_fullsized":"2024-09-05T07:29:31.908548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:45:00.967978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.418310+0000","last_change":"2024-09-05T07:29:29.567028+0000","last_active":"2024-09-05T07:29:36.418310+0000","last_peered":"2024-09-05T07:29:36.418310+0000","last_clean":"2024-09-05T07:29:36.418310+0000","last_became_active":"2024-09-05T07:29:29.566754+0000","last_became_peered":"2024-09-05T07:29:29.566754+0000","last_unstale":"2024-09-05T07:29:36.418310+0000","last_undegraded":"2024-09-05T07:29:36.418310+0000","last_fullsized":"2024-09-05T07:29:36.418310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:49:13.565181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.626093+0000","last_change":"2024-09-05T07:29:30.558658+0000","last_active":"2024-09-05T07:29:31.626093+0000","last_peered":"2024-09-05T07:29:31.626093+0000","last_clean":"2024-09-05T07:29:31.626093+0000","last_became_active":"2024-09-05T07:29:30.558179+0000","last_became_peered":"2024-09-05T07:29:30.558179+0000","last_unstale":"2024-09-05T07:29:31.626093+0000","last_undegraded":"2024-09-05T07:29:31.626093+0000","last_fullsized":"2024-09-05T07:29:31.626093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:44:13.003367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:43.607061+0000","last_change":"2024-09-05T07:29:29.525420+0000","last_active":"2024-09-05T07:29:43.607061+0000","last_peered":"2024-09-05T07:29:43.607061+0000","last_clean":"2024-09-05T07:29:43.607061+0000","last_became_active":"2024-09-05T07:29:29.525139+0000","last_became_peered":"2024-09-05T07:29:29.525139+0000","last_unstale":"2024-09-05T07:29:43.607061+0000","last_undegraded":"2024-09-05T07:29:43.607061+0000","last_fullsized":"2024-09-05T07:29:43.607061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:54:00.339029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.907555+0000","last_change":"2024-09-05T07:29:30.659606+0000","last_active":"2024-09-05T07:29:31.907555+0000","last_peered":"2024-09-05T07:29:31.907555+0000","last_clean":"2024-09-05T07:29:31.907555+0000","last_became_active":"2024-09-05T07:29:30.659311+0000","last_became_peered":"2024-09-05T07:29:30.659311+0000","last_unstale":"2024-09-05T07:29:31.907555+0000","last_undegraded":"2024-09-05T07:29:31.907555+0000","last_fullsized":"2024-09-05T07:29:31.907555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:54:01.479214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'15","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:43.594660+0000","last_change":"2024-09-05T07:29:29.566784+0000","last_active":"2024-09-05T07:29:43.594660+0000","last_peered":"2024-09-05T07:29:43.594660+0000","last_clean":"2024-09-05T07:29:43.594660+0000","last_became_active":"2024-09-05T07:29:29.566503+0000","last_became_peered":"2024-09-05T07:29:29.566503+0000","last_unstale":"2024-09-05T07:29:43.594660+0000","last_undegraded":"2024-09-05T07:29:43.594660+0000","last_fullsized":"2024-09-05T07:29:43.594660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:35:54.465221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.625644+0000","last_change":"2024-09-05T07:29:30.641565+0000","last_active":"2024-09-05T07:29:31.625644+0000","last_peered":"2024-09-05T07:29:31.625644+0000","last_clean":"2024-09-05T07:29:31.625644+0000","last_became_active":"2024-09-05T07:29:30.641309+0000","last_became_peered":"2024-09-05T07:29:30.641309+0000","last_unstale":"2024-09-05T07:29:31.625644+0000","last_undegraded":"2024-09-05T07:29:31.625644+0000","last_fullsized":"2024-09-05T07:29:31.625644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:37:28.088603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881203+0000","last_change":"2024-09-05T07:29:29.524793+0000","last_active":"2024-09-05T07:29:31.881203+0000","last_peered":"2024-09-05T07:29:31.881203+0000","last_clean":"2024-09-05T07:29:31.881203+0000","last_became_active":"2024-09-05T07:29:29.524522+0000","last_became_peered":"2024-09-05T07:29:29.524522+0000","last_unstale":"2024-09-05T07:29:31.881203+0000","last_undegraded":"2024-09-05T07:29:31.881203+0000","last_fullsized":"2024-09-05T07:29:31.881203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:41.797972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.882353+0000","last_change":"2024-09-05T07:29:30.642565+0000","last_active":"2024-09-05T07:29:31.882353+0000","last_peered":"2024-09-05T07:29:31.882353+0000","last_clean":"2024-09-05T07:29:31.882353+0000","last_became_active":"2024-09-05T07:29:30.641774+0000","last_became_peered":"2024-09-05T07:29:30.641774+0000","last_unstale":"2024-09-05T07:29:31.882353+0000","last_undegraded":"2024-09-05T07:29:31.882353+0000","last_fullsized":"2024-09-05T07:29:31.882353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:09:36.911425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:32.036409+0000","last_change":"2024-09-05T07:29:29.525374+0000","last_active":"2024-09-05T07:29:32.036409+0000","last_peered":"2024-09-05T07:29:32.036409+0000","last_clean":"2024-09-05T07:29:32.036409+0000","last_became_active":"2024-09-05T07:29:29.525044+0000","last_became_peered":"2024-09-05T07:29:29.525044+0000","last_unstale":"2024-09-05T07:29:32.036409+0000","last_undegraded":"2024-09-05T07:29:32.036409+0000","last_fullsized":"2024-09-05T07:29:32.036409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:25:35.862773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881625+0000","last_change":"2024-09-05T07:29:30.563669+0000","last_active":"2024-09-05T07:29:31.881625+0000","last_peered":"2024-09-05T07:29:31.881625+0000","last_clean":"2024-09-05T07:29:31.881625+0000","last_became_active":"2024-09-05T07:29:30.563408+0000","last_became_peered":"2024-09-05T07:29:30.563408+0000","last_unstale":"2024-09-05T07:29:31.881625+0000","last_undegraded":"2024-09-05T07:29:31.881625+0000","last_fullsized":"2024-09-05T07:29:31.881625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:42:04.216273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:32.041498+0000","last_change":"2024-09-05T07:29:29.559111+0000","last_active":"2024-09-05T07:29:32.041498+0000","last_peered":"2024-09-05T07:29:32.041498+0000","last_clean":"2024-09-05T07:29:32.041498+0000","last_became_active":"2024-09-05T07:29:29.558856+0000","last_became_peered":"2024-09-05T07:29:29.558856+0000","last_unstale":"2024-09-05T07:29:32.041498+0000","last_undegraded":"2024-09-05T07:29:32.041498+0000","last_fullsized":"2024-09-05T07:29:32.041498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:47:57.187710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881728+0000","last_change":"2024-09-05T07:29:30.624401+0000","last_active":"2024-09-05T07:29:31.881728+0000","last_peered":"2024-09-05T07:29:31.881728+0000","last_clean":"2024-09-05T07:29:31.881728+0000","last_became_active":"2024-09-05T07:29:30.624057+0000","last_became_peered":"2024-09-05T07:29:30.624057+0000","last_unstale":"2024-09-05T07:29:31.881728+0000","last_undegraded":"2024-09-05T07:29:31.881728+0000","last_fullsized":"2024-09-05T07:29:31.881728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:36:59.967135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:43.514854+0000","last_change":"2024-09-05T07:29:29.570940+0000","last_active":"2024-09-05T07:29:43.514854+0000","last_peered":"2024-09-05T07:29:43.514854+0000","last_clean":"2024-09-05T07:29:43.514854+0000","last_became_active":"2024-09-05T07:29:29.570478+0000","last_became_peered":"2024-09-05T07:29:29.570478+0000","last_unstale":"2024-09-05T07:29:43.514854+0000","last_undegraded":"2024-09-05T07:29:43.514854+0000","last_fullsized":"2024-09-05T07:29:43.514854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:35:54.465221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.625978+0000","last_change":"2024-09-05T07:29:30.563109+0000","last_active":"2024-09-05T07:29:31.625978+0000","last_peered":"2024-09-05T07:29:31.625978+0000","last_clean":"2024-09-05T07:29:31.625978+0000","last_became_active":"2024-09-05T07:29:30.562824+0000","last_became_peered":"2024-09-05T07:29:30.562824+0000","last_unstale":"2024-09-05T07:29:31.625978+0000","last_undegraded":"2024-09-05T07:29:31.625978+0000","last_fullsized":"2024-09-05T07:29:31.625978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:42:02.212868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":171,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.907582+0000","last_change":"2024-09-05T07:29:13.366600+0000","last_active":"2024-09-05T07:29:31.907582+0000","last_peered":"2024-09-05T07:29:31.907582+0000","last_clean":"2024-09-05T07:29:31.907582+0000","last_became_active":"2024-09-05T07:29:13.365841+0000","last_became_peered":"2024-09-05T07:29:13.365841+0000","last_unstale":"2024-09-05T07:29:31.907582+0000","last_undegraded":"2024-09-05T07:29:31.907582+0000","last_fullsized":"2024-09-05T07:29:31.907582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:10.874807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:10.874807+0000","last_clean_scrub_stamp":"2024-09-05T07:29:10.874807+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:21:17.673107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.418729+0000","last_change":"2024-09-05T07:29:29.563604+0000","last_active":"2024-09-05T07:29:36.418729+0000","last_peered":"2024-09-05T07:29:36.418729+0000","last_clean":"2024-09-05T07:29:36.418729+0000","last_became_active":"2024-09-05T07:29:29.562956+0000","last_became_peered":"2024-09-05T07:29:29.562956+0000","last_unstale":"2024-09-05T07:29:36.418729+0000","last_undegraded":"2024-09-05T07:29:36.418729+0000","last_fullsized":"2024-09-05T07:29:36.418729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:41.797972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.669026+0000","last_change":"2024-09-05T07:29:30.641543+0000","last_active":"2024-09-05T07:29:31.669026+0000","last_peered":"2024-09-05T07:29:31.669026+0000","last_clean":"2024-09-05T07:29:31.669026+0000","last_became_active":"2024-09-05T07:29:30.641243+0000","last_became_peered":"2024-09-05T07:29:30.641243+0000","last_unstale":"2024-09-05T07:29:31.669026+0000","last_undegraded":"2024-09-05T07:29:31.669026+0000","last_fullsized":"2024-09-05T07:29:31.669026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:34:54.335152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:43.515757+0000","last_change":"2024-09-05T07:29:29.479329+0000","last_active":"2024-09-05T07:29:43.515757+0000","last_peered":"2024-09-05T07:29:43.515757+0000","last_clean":"2024-09-05T07:29:43.515757+0000","last_became_active":"2024-09-05T07:29:29.479005+0000","last_became_peered":"2024-09-05T07:29:29.479005+0000","last_unstale":"2024-09-05T07:29:43.515757+0000","last_undegraded":"2024-09-05T07:29:43.515757+0000","last_fullsized":"2024-09-05T07:29:43.515757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:49:39.187534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908022+0000","last_change":"2024-09-05T07:29:30.641557+0000","last_active":"2024-09-05T07:29:31.908022+0000","last_peered":"2024-09-05T07:29:31.908022+0000","last_clean":"2024-09-05T07:29:31.908022+0000","last_became_active":"2024-09-05T07:29:30.641269+0000","last_became_peered":"2024-09-05T07:29:30.641269+0000","last_unstale":"2024-09-05T07:29:31.908022+0000","last_undegraded":"2024-09-05T07:29:31.908022+0000","last_fullsized":"2024-09-05T07:29:31.908022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:32:30.263430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:43.511356+0000","last_change":"2024-09-05T07:29:29.568835+0000","last_active":"2024-09-05T07:29:43.511356+0000","last_peered":"2024-09-05T07:29:43.511356+0000","last_clean":"2024-09-05T07:29:43.511356+0000","last_became_active":"2024-09-05T07:29:29.568576+0000","last_became_peered":"2024-09-05T07:29:29.568576+0000","last_unstale":"2024-09-05T07:29:43.511356+0000","last_undegraded":"2024-09-05T07:29:43.511356+0000","last_fullsized":"2024-09-05T07:29:43.511356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:05:05.417016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.632195+0000","last_change":"2024-09-05T07:29:30.660008+0000","last_active":"2024-09-05T07:29:31.632195+0000","last_peered":"2024-09-05T07:29:31.632195+0000","last_clean":"2024-09-05T07:29:31.632195+0000","last_became_active":"2024-09-05T07:29:30.659720+0000","last_became_peered":"2024-09-05T07:29:30.659720+0000","last_unstale":"2024-09-05T07:29:31.632195+0000","last_undegraded":"2024-09-05T07:29:31.632195+0000","last_fullsized":"2024-09-05T07:29:31.632195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:42:04.216273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.626354+0000","last_change":"2024-09-05T07:29:29.568569+0000","last_active":"2024-09-05T07:29:31.626354+0000","last_peered":"2024-09-05T07:29:31.626354+0000","last_clean":"2024-09-05T07:29:31.626354+0000","last_became_active":"2024-09-05T07:29:29.568307+0000","last_became_peered":"2024-09-05T07:29:29.568307+0000","last_unstale":"2024-09-05T07:29:31.626354+0000","last_undegraded":"2024-09-05T07:29:31.626354+0000","last_fullsized":"2024-09-05T07:29:31.626354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:12:38.814463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881267+0000","last_change":"2024-09-05T07:29:30.642687+0000","last_active":"2024-09-05T07:29:31.881267+0000","last_peered":"2024-09-05T07:29:31.881267+0000","last_clean":"2024-09-05T07:29:31.881267+0000","last_became_active":"2024-09-05T07:29:30.642414+0000","last_became_peered":"2024-09-05T07:29:30.642414+0000","last_unstale":"2024-09-05T07:29:31.881267+0000","last_undegraded":"2024-09-05T07:29:31.881267+0000","last_fullsized":"2024-09-05T07:29:31.881267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:01:34.217228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.631634+0000","last_change":"2024-09-05T07:29:29.568739+0000","last_active":"2024-09-05T07:29:31.631634+0000","last_peered":"2024-09-05T07:29:31.631634+0000","last_clean":"2024-09-05T07:29:31.631634+0000","last_became_active":"2024-09-05T07:29:29.568499+0000","last_became_peered":"2024-09-05T07:29:29.568499+0000","last_unstale":"2024-09-05T07:29:31.631634+0000","last_undegraded":"2024-09-05T07:29:31.631634+0000","last_fullsized":"2024-09-05T07:29:31.631634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:05:05.417016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881813+0000","last_change":"2024-09-05T07:29:30.641340+0000","last_active":"2024-09-05T07:29:31.881813+0000","last_peered":"2024-09-05T07:29:31.881813+0000","last_clean":"2024-09-05T07:29:31.881813+0000","last_became_active":"2024-09-05T07:29:30.640805+0000","last_became_peered":"2024-09-05T07:29:30.640805+0000","last_unstale":"2024-09-05T07:29:31.881813+0000","last_undegraded":"2024-09-05T07:29:31.881813+0000","last_fullsized":"2024-09-05T07:29:31.881813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:59.653492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.626381+0000","last_change":"2024-09-05T07:29:29.525212+0000","last_active":"2024-09-05T07:29:31.626381+0000","last_peered":"2024-09-05T07:29:31.626381+0000","last_clean":"2024-09-05T07:29:31.626381+0000","last_became_active":"2024-09-05T07:29:29.524918+0000","last_became_peered":"2024-09-05T07:29:29.524918+0000","last_unstale":"2024-09-05T07:29:31.626381+0000","last_undegraded":"2024-09-05T07:29:31.626381+0000","last_fullsized":"2024-09-05T07:29:31.626381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:09:35.771241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908661+0000","last_change":"2024-09-05T07:29:30.658407+0000","last_active":"2024-09-05T07:29:31.908661+0000","last_peered":"2024-09-05T07:29:31.908661+0000","last_clean":"2024-09-05T07:29:31.908661+0000","last_became_active":"2024-09-05T07:29:30.658155+0000","last_became_peered":"2024-09-05T07:29:30.658155+0000","last_unstale":"2024-09-05T07:29:31.908661+0000","last_undegraded":"2024-09-05T07:29:31.908661+0000","last_fullsized":"2024-09-05T07:29:31.908661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:52:56.756904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:43.512345+0000","last_change":"2024-09-05T07:29:29.526674+0000","last_active":"2024-09-05T07:29:43.512345+0000","last_peered":"2024-09-05T07:29:43.512345+0000","last_clean":"2024-09-05T07:29:43.512345+0000","last_became_active":"2024-09-05T07:29:29.526421+0000","last_became_peered":"2024-09-05T07:29:29.526421+0000","last_unstale":"2024-09-05T07:29:43.512345+0000","last_undegraded":"2024-09-05T07:29:43.512345+0000","last_fullsized":"2024-09-05T07:29:43.512345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:52:13.496606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.669439+0000","last_change":"2024-09-05T07:29:30.633806+0000","last_active":"2024-09-05T07:29:31.669439+0000","last_peered":"2024-09-05T07:29:31.669439+0000","last_clean":"2024-09-05T07:29:31.669439+0000","last_became_active":"2024-09-05T07:29:30.633535+0000","last_became_peered":"2024-09-05T07:29:30.633535+0000","last_unstale":"2024-09-05T07:29:31.669439+0000","last_undegraded":"2024-09-05T07:29:31.669439+0000","last_fullsized":"2024-09-05T07:29:31.669439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:40:35.334862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.417663+0000","last_change":"2024-09-05T07:29:29.524532+0000","last_active":"2024-09-05T07:29:36.417663+0000","last_peered":"2024-09-05T07:29:36.417663+0000","last_clean":"2024-09-05T07:29:36.417663+0000","last_became_active":"2024-09-05T07:29:29.524268+0000","last_became_peered":"2024-09-05T07:29:29.524268+0000","last_unstale":"2024-09-05T07:29:36.417663+0000","last_undegraded":"2024-09-05T07:29:36.417663+0000","last_fullsized":"2024-09-05T07:29:36.417663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:58.513308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.669296+0000","last_change":"2024-09-05T07:29:30.624431+0000","last_active":"2024-09-05T07:29:31.669296+0000","last_peered":"2024-09-05T07:29:31.669296+0000","last_clean":"2024-09-05T07:29:31.669296+0000","last_became_active":"2024-09-05T07:29:30.624117+0000","last_became_peered":"2024-09-05T07:29:30.624117+0000","last_unstale":"2024-09-05T07:29:31.669296+0000","last_undegraded":"2024-09-05T07:29:31.669296+0000","last_fullsized":"2024-09-05T07:29:31.669296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:10:00.845713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.506474+0000","last_change":"2024-09-05T07:29:29.561285+0000","last_active":"2024-09-05T07:29:36.506474+0000","last_peered":"2024-09-05T07:29:36.506474+0000","last_clean":"2024-09-05T07:29:36.506474+0000","last_became_active":"2024-09-05T07:29:29.561026+0000","last_became_peered":"2024-09-05T07:29:29.561026+0000","last_unstale":"2024-09-05T07:29:36.506474+0000","last_undegraded":"2024-09-05T07:29:36.506474+0000","last_fullsized":"2024-09-05T07:29:36.506474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:48:25.900221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.626031+0000","last_change":"2024-09-05T07:29:30.556889+0000","last_active":"2024-09-05T07:29:31.626031+0000","last_peered":"2024-09-05T07:29:31.626031+0000","last_clean":"2024-09-05T07:29:31.626031+0000","last_became_active":"2024-09-05T07:29:30.556627+0000","last_became_peered":"2024-09-05T07:29:30.556627+0000","last_unstale":"2024-09-05T07:29:31.626031+0000","last_undegraded":"2024-09-05T07:29:31.626031+0000","last_fullsized":"2024-09-05T07:29:31.626031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:20:01.152157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.415122+0000","last_change":"2024-09-05T07:29:29.526873+0000","last_active":"2024-09-05T07:29:36.415122+0000","last_peered":"2024-09-05T07:29:36.415122+0000","last_clean":"2024-09-05T07:29:36.415122+0000","last_became_active":"2024-09-05T07:29:29.526572+0000","last_became_peered":"2024-09-05T07:29:29.526572+0000","last_unstale":"2024-09-05T07:29:36.415122+0000","last_undegraded":"2024-09-05T07:29:36.415122+0000","last_fullsized":"2024-09-05T07:29:36.415122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:33:14.122911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.668972+0000","last_change":"2024-09-05T07:29:30.624592+0000","last_active":"2024-09-05T07:29:31.668972+0000","last_peered":"2024-09-05T07:29:31.668972+0000","last_clean":"2024-09-05T07:29:31.668972+0000","last_became_active":"2024-09-05T07:29:30.624109+0000","last_became_peered":"2024-09-05T07:29:30.624109+0000","last_unstale":"2024-09-05T07:29:31.668972+0000","last_undegraded":"2024-09-05T07:29:31.668972+0000","last_fullsized":"2024-09-05T07:29:31.668972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:22:35.613478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908729+0000","last_change":"2024-09-05T07:29:29.569816+0000","last_active":"2024-09-05T07:29:31.908729+0000","last_peered":"2024-09-05T07:29:31.908729+0000","last_clean":"2024-09-05T07:29:31.908729+0000","last_became_active":"2024-09-05T07:29:29.569536+0000","last_became_peered":"2024-09-05T07:29:29.569536+0000","last_unstale":"2024-09-05T07:29:31.908729+0000","last_undegraded":"2024-09-05T07:29:31.908729+0000","last_fullsized":"2024-09-05T07:29:31.908729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:59:18.418220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908389+0000","last_change":"2024-09-05T07:29:30.632805+0000","last_active":"2024-09-05T07:29:31.908389+0000","last_peered":"2024-09-05T07:29:31.908389+0000","last_clean":"2024-09-05T07:29:31.908389+0000","last_became_active":"2024-09-05T07:29:30.632502+0000","last_became_peered":"2024-09-05T07:29:30.632502+0000","last_unstale":"2024-09-05T07:29:31.908389+0000","last_undegraded":"2024-09-05T07:29:31.908389+0000","last_fullsized":"2024-09-05T07:29:31.908389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:59.653492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.417932+0000","last_change":"2024-09-05T07:29:29.563821+0000","last_active":"2024-09-05T07:29:36.417932+0000","last_peered":"2024-09-05T07:29:36.417932+0000","last_clean":"2024-09-05T07:29:36.417932+0000","last_became_active":"2024-09-05T07:29:29.563316+0000","last_became_peered":"2024-09-05T07:29:29.563316+0000","last_unstale":"2024-09-05T07:29:36.417932+0000","last_undegraded":"2024-09-05T07:29:36.417932+0000","last_fullsized":"2024-09-05T07:29:36.417932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:38.961328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.626045+0000","last_change":"2024-09-05T07:29:30.563106+0000","last_active":"2024-09-05T07:29:31.626045+0000","last_peered":"2024-09-05T07:29:31.626045+0000","last_clean":"2024-09-05T07:29:31.626045+0000","last_became_active":"2024-09-05T07:29:30.562776+0000","last_became_peered":"2024-09-05T07:29:30.562776+0000","last_unstale":"2024-09-05T07:29:31.626045+0000","last_undegraded":"2024-09-05T07:29:31.626045+0000","last_fullsized":"2024-09-05T07:29:31.626045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:37:16.174244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.625848+0000","last_change":"2024-09-05T07:29:30.558029+0000","last_active":"2024-09-05T07:29:31.625848+0000","last_peered":"2024-09-05T07:29:31.625848+0000","last_clean":"2024-09-05T07:29:31.625848+0000","last_became_active":"2024-09-05T07:29:30.557747+0000","last_became_peered":"2024-09-05T07:29:30.557747+0000","last_unstale":"2024-09-05T07:29:31.625848+0000","last_undegraded":"2024-09-05T07:29:31.625848+0000","last_fullsized":"2024-09-05T07:29:31.625848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:55:28.983976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.975672+0000","last_change":"2024-09-05T07:29:29.561333+0000","last_active":"2024-09-05T07:29:31.975672+0000","last_peered":"2024-09-05T07:29:31.975672+0000","last_clean":"2024-09-05T07:29:31.975672+0000","last_became_active":"2024-09-05T07:29:29.561065+0000","last_became_peered":"2024-09-05T07:29:29.561065+0000","last_unstale":"2024-09-05T07:29:31.975672+0000","last_undegraded":"2024-09-05T07:29:31.975672+0000","last_fullsized":"2024-09-05T07:29:31.975672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:38.961328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.907784+0000","last_change":"2024-09-05T07:29:30.566028+0000","last_active":"2024-09-05T07:29:31.907784+0000","last_peered":"2024-09-05T07:29:31.907784+0000","last_clean":"2024-09-05T07:29:31.907784+0000","last_became_active":"2024-09-05T07:29:30.565787+0000","last_became_peered":"2024-09-05T07:29:30.565787+0000","last_unstale":"2024-09-05T07:29:31.907784+0000","last_undegraded":"2024-09-05T07:29:31.907784+0000","last_fullsized":"2024-09-05T07:29:31.907784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:59.653492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:43.607129+0000","last_change":"2024-09-05T07:29:29.559969+0000","last_active":"2024-09-05T07:29:43.607129+0000","last_peered":"2024-09-05T07:29:43.607129+0000","last_clean":"2024-09-05T07:29:43.607129+0000","last_became_active":"2024-09-05T07:29:29.559675+0000","last_became_peered":"2024-09-05T07:29:29.559675+0000","last_unstale":"2024-09-05T07:29:43.607129+0000","last_undegraded":"2024-09-05T07:29:43.607129+0000","last_fullsized":"2024-09-05T07:29:43.607129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:53:39.010323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.631741+0000","last_change":"2024-09-05T07:29:30.657369+0000","last_active":"2024-09-05T07:29:31.631741+0000","last_peered":"2024-09-05T07:29:31.631741+0000","last_clean":"2024-09-05T07:29:31.631741+0000","last_became_active":"2024-09-05T07:29:30.656876+0000","last_became_peered":"2024-09-05T07:29:30.656876+0000","last_unstale":"2024-09-05T07:29:31.631741+0000","last_undegraded":"2024-09-05T07:29:31.631741+0000","last_fullsized":"2024-09-05T07:29:31.631741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:09:22.026287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:32.565312+0000","last_change":"2024-09-05T07:29:29.567440+0000","last_active":"2024-09-05T07:29:32.565312+0000","last_peered":"2024-09-05T07:29:32.565312+0000","last_clean":"2024-09-05T07:29:32.565312+0000","last_became_active":"2024-09-05T07:29:29.567129+0000","last_became_peered":"2024-09-05T07:29:29.567129+0000","last_unstale":"2024-09-05T07:29:32.565312+0000","last_undegraded":"2024-09-05T07:29:32.565312+0000","last_fullsized":"2024-09-05T07:29:32.565312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:54:00.339029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.632072+0000","last_change":"2024-09-05T07:29:30.657929+0000","last_active":"2024-09-05T07:29:31.632072+0000","last_peered":"2024-09-05T07:29:31.632072+0000","last_clean":"2024-09-05T07:29:31.632072+0000","last_became_active":"2024-09-05T07:29:30.657625+0000","last_became_peered":"2024-09-05T07:29:30.657625+0000","last_unstale":"2024-09-05T07:29:31.632072+0000","last_undegraded":"2024-09-05T07:29:31.632072+0000","last_fullsized":"2024-09-05T07:29:31.632072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:37:46.507371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'9","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:43.575475+0000","last_change":"2024-09-05T07:29:29.526099+0000","last_active":"2024-09-05T07:29:43.575475+0000","last_peered":"2024-09-05T07:29:43.575475+0000","last_clean":"2024-09-05T07:29:43.575475+0000","last_became_active":"2024-09-05T07:29:29.525832+0000","last_became_peered":"2024-09-05T07:29:29.525832+0000","last_unstale":"2024-09-05T07:29:43.575475+0000","last_undegraded":"2024-09-05T07:29:43.575475+0000","last_fullsized":"2024-09-05T07:29:43.575475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:44:32.741898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4634,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":9268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476748,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36156,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335684,"statfs":{"total":96636764160,"available":96599740416,"internally_reserved":0,"allocated":831488,"data_stored":667834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35572,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336268,"statfs":{"total":96636764160,"available":96600338432,"internally_reserved":0,"allocated":233472,"data_stored":77458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":229376,"data_stored":77356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":233472,"data_stored":78364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":823296,"data_stored":667280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":233472,"data_stored":76898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542156,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35572,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336268,"statfs":{"total":96636764160,"available":96600338432,"internally_reserved":0,"allocated":233472,"data_stored":77956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35604,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336236,"statfs":{"total":96636764160,"available":96600305664,"internally_reserved":0,"allocated":266240,"data_stored":79932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T07:29:47.697 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T07:29:47.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.832+0000 7fc6f7fff640 1 Processor -- start 2024-09-05T07:29:47.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.832+0000 7fc6f7fff640 1 -- start start 2024-09-05T07:29:47.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.833+0000 7fc6f7fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc6f8154980 0x7fc6f80cac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:47.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.833+0000 7fc6f7fff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc6f80cbb60 0x7fc6f80cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:47.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.833+0000 7fc6f7fff640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6f80cc530 con 0x7fc6f80d0b90 2024-09-05T07:29:47.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.833+0000 7fc6f7fff640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fc6f815a740 con 0x7fc6f8154980 2024-09-05T07:29:47.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.833+0000 7fc6f7fff640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fc6f815aa00 con 0x7fc6f80cbb60 2024-09-05T07:29:47.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.833+0000 7fc6f6ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc6f8154980 0x7fc6f80cac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:47.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.833+0000 7fc6f77fe640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc6f80cbb60 0x7fc6f80cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:47.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.833+0000 7fc6f67fc640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc6f80d0b90 0x7fc6f8072230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.17:44760/0 (socket says 172.21.15.17:44760) 2024-09-05T07:29:47.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.833+0000 7fc6f67fc640 1 -- 172.21.15.17:0/424672222 learned_addr learned my addr 172.21.15.17:0/424672222 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:29:47.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.836+0000 7fc6f77fe640 1 -- 172.21.15.17:0/424672222 >> v2:172.21.15.17:3300/0 conn(0x7fc6f8154980 msgr2=0x7fc6f80cac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:47.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.836+0000 7fc6f77fe640 1 --2- 172.21.15.17:0/424672222 >> v2:172.21.15.17:3300/0 conn(0x7fc6f8154980 0x7fc6f80cac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:47.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.836+0000 7fc6f77fe640 1 -- 172.21.15.17:0/424672222 >> v1:172.21.15.26:6789/0 conn(0x7fc6f80d0b90 legacy=0x7fc6f8072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:47.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.836+0000 7fc6f77fe640 1 -- 172.21.15.17:0/424672222 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f815ace0 con 0x7fc6f80cbb60 2024-09-05T07:29:47.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.841+0000 7fc6f77fe640 1 --2- 172.21.15.17:0/424672222 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc6f80cbb60 0x7fc6f80cbff0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0009dc0 tx=0x7fc6f002a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=783c607026cf3599 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:47.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.845+0000 7fc6f5ffb640 1 -- 172.21.15.17:0/424672222 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f002ae60 con 0x7fc6f80cbb60 2024-09-05T07:29:47.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.845+0000 7fc6f5ffb640 1 -- 172.21.15.17:0/424672222 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6f0007740 con 0x7fc6f80cbb60 2024-09-05T07:29:47.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.845+0000 7fc6f5ffb640 1 -- 172.21.15.17:0/424672222 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f0007b10 con 0x7fc6f80cbb60 2024-09-05T07:29:47.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.845+0000 7fc6f7fff640 1 -- 172.21.15.17:0/424672222 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc6f80cbb60 msgr2=0x7fc6f80cbff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:47.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.845+0000 7fc6f7fff640 1 --2- 172.21.15.17:0/424672222 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc6f80cbb60 0x7fc6f80cbff0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0009dc0 tx=0x7fc6f002a680 comp rx=0 tx=0).stop 2024-09-05T07:29:47.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.845+0000 7fc6f7fff640 1 -- 172.21.15.17:0/424672222 shutdown_connections 2024-09-05T07:29:47.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.845+0000 7fc6f7fff640 1 --2- 172.21.15.17:0/424672222 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc6f80cbb60 0x7fc6f80cbff0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:47.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.845+0000 7fc6f7fff640 1 --2- 172.21.15.17:0/424672222 >> v2:172.21.15.17:3300/0 conn(0x7fc6f8154980 0x7fc6f80cac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:47.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.845+0000 7fc6f7fff640 1 -- 172.21.15.17:0/424672222 >> 172.21.15.17:0/424672222 conn(0x7fc6f8073470 msgr2=0x7fc6f8073880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:47.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.846+0000 7fc6f7fff640 1 -- 172.21.15.17:0/424672222 shutdown_connections 2024-09-05T07:29:47.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.846+0000 7fc6f7fff640 1 -- 172.21.15.17:0/424672222 wait complete. 2024-09-05T07:29:47.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.847+0000 7fc6f7fff640 1 Processor -- start 2024-09-05T07:29:47.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.847+0000 7fc6f7fff640 1 -- start start 2024-09-05T07:29:47.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.847+0000 7fc6f7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6f80cbb60 0x7fc6f80b4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:47.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.848+0000 7fc6f7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6f80d0b90 0x7fc6f8157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:47.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.848+0000 7fc6f7fff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc6f8154980 0x7fc6f81eff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:47.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.848+0000 7fc6f7fff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f80d0fe0 con 0x7fc6f80d0b90 2024-09-05T07:29:47.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.848+0000 7fc6f7fff640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f815b2a0 con 0x7fc6f80cbb60 2024-09-05T07:29:47.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.848+0000 7fc6f7fff640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fc6f80cd940 con 0x7fc6f8154980 2024-09-05T07:29:47.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.848+0000 7fc6f77fe640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc6f8154980 0x7fc6f81eff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:47.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.848+0000 7fc6f67fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6f80d0b90 0x7fc6f8157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:47.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.848+0000 7fc6f6ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6f80cbb60 0x7fc6f80b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:47.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.848+0000 7fc6f77fe640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc6f8154980 0x7fc6f81eff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:60186/0 (socket says 172.21.15.17:60186) 2024-09-05T07:29:47.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.848+0000 7fc6f77fe640 1 -- 172.21.15.17:0/1808940214 learned_addr learned my addr 172.21.15.17:0/1808940214 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:47.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.852+0000 7fc6f77fe640 1 -- 172.21.15.17:0/1808940214 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6f80cbb60 msgr2=0x7fc6f80b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:47.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.852+0000 7fc6f77fe640 1 --2- 172.21.15.17:0/1808940214 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6f80cbb60 0x7fc6f80b4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:47.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.852+0000 7fc6f77fe640 1 -- 172.21.15.17:0/1808940214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6f80d0b90 msgr2=0x7fc6f8157860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:47.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.852+0000 7fc6f77fe640 1 --2- 172.21.15.17:0/1808940214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6f80d0b90 0x7fc6f8157860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:47.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.852+0000 7fc6f77fe640 1 -- 172.21.15.17:0/1808940214 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f81f34a0 con 0x7fc6f8154980 2024-09-05T07:29:47.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.854+0000 7fc6f77fe640 1 --2- 172.21.15.17:0/1808940214 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc6f8154980 0x7fc6f81eff90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0009ee0 tx=0x7fc6f0004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:47.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.858+0000 7fc6df7fe640 1 -- 172.21.15.17:0/1808940214 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f0040070 con 0x7fc6f8154980 2024-09-05T07:29:47.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.858+0000 7fc6df7fe640 1 -- 172.21.15.17:0/1808940214 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6f00319c0 con 0x7fc6f8154980 2024-09-05T07:29:47.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.859+0000 7fc6df7fe640 1 -- 172.21.15.17:0/1808940214 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f0031b90 con 0x7fc6f8154980 2024-09-05T07:29:47.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.859+0000 7fc6f7fff640 1 -- 172.21.15.17:0/1808940214 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6f81f3780 con 0x7fc6f8154980 2024-09-05T07:29:47.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.859+0000 7fc6f7fff640 1 -- 172.21.15.17:0/1808940214 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6f81f3d40 con 0x7fc6f8154980 2024-09-05T07:29:47.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.860+0000 7fc6f7fff640 1 -- 172.21.15.17:0/1808940214 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6f8154d60 con 0x7fc6f8154980 2024-09-05T07:29:47.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.895+0000 7fc6df7fe640 1 -- 172.21.15.17:0/1808940214 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc6f0039040 con 0x7fc6f8154980 2024-09-05T07:29:47.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.896+0000 7fc6df7fe640 1 --2- 172.21.15.17:0/1808940214 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc6e406be80 0x7fc6e406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:47.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.896+0000 7fc6f6ffd640 1 --2- 172.21.15.17:0/1808940214 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc6e406be80 0x7fc6e406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:47.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:47.896+0000 7fc6f6ffd640 1 --2- 172.21.15.17:0/1808940214 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc6e406be80 0x7fc6e406e340 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8009aa0 tx=0x7fc6e8009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:48.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.162+0000 7fc6df7fe640 1 -- 172.21.15.17:0/1808940214 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc6f0078ba0 con 0x7fc6f8154980 2024-09-05T07:29:48.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.175+0000 7fc6df7fe640 1 -- 172.21.15.17:0/1808940214 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc6f007ab00 con 0x7fc6f8154980 2024-09-05T07:29:48.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.385+0000 7fc6f7fff640 1 -- 172.21.15.17:0/1808940214 --> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc6f80ca360 con 0x7fc6e406be80 2024-09-05T07:29:48.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.392+0000 7fc6df7fe640 1 -- 172.21.15.17:0/1808940214 <== mgr.4099 v2:172.21.15.26:6800/2736912541 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251963 (secure 0 0 0) 0x7fc6f80ca360 con 0x7fc6e406be80 2024-09-05T07:29:48.395 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:29:48.396 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-05T07:29:48.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.395+0000 7fc6f7fff640 1 -- 172.21.15.17:0/1808940214 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc6e406be80 msgr2=0x7fc6e406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:48.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.395+0000 7fc6f7fff640 1 --2- 172.21.15.17:0/1808940214 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc6e406be80 0x7fc6e406e340 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8009aa0 tx=0x7fc6e8009190 comp rx=0 tx=0).stop 2024-09-05T07:29:48.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.395+0000 7fc6f7fff640 1 -- 172.21.15.17:0/1808940214 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc6f8154980 msgr2=0x7fc6f81eff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:48.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.395+0000 7fc6f7fff640 1 --2- 172.21.15.17:0/1808940214 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc6f8154980 0x7fc6f81eff90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0009ee0 tx=0x7fc6f0004a40 comp rx=0 tx=0).stop 2024-09-05T07:29:48.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.395+0000 7fc6f7fff640 1 -- 172.21.15.17:0/1808940214 shutdown_connections 2024-09-05T07:29:48.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.395+0000 7fc6f7fff640 1 --2- 172.21.15.17:0/1808940214 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc6e406be80 0x7fc6e406e340 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:48.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.395+0000 7fc6f7fff640 1 --2- 172.21.15.17:0/1808940214 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc6f8154980 0x7fc6f81eff90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:48.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.395+0000 7fc6f7fff640 1 --2- 172.21.15.17:0/1808940214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6f80d0b90 0x7fc6f8157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:48.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.395+0000 7fc6f7fff640 1 --2- 172.21.15.17:0/1808940214 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6f80cbb60 0x7fc6f80b4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:48.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.395+0000 7fc6f7fff640 1 -- 172.21.15.17:0/1808940214 >> 172.21.15.17:0/1808940214 conn(0x7fc6f8073470 msgr2=0x7fc6f8152790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:48.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.395+0000 7fc6f7fff640 1 -- 172.21.15.17:0/1808940214 shutdown_connections 2024-09-05T07:29:48.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.395+0000 7fc6f7fff640 1 -- 172.21.15.17:0/1808940214 wait complete. 2024-09-05T07:29:48.406 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-09-05T07:29:47.876048+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596408,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":310,"num_write_kb":2465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":247,"ondisk_log_size":247,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":269180,"kb_used_data":3068,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754705540,"statfs":{"total":773094113280,"available":772818472960,"internally_reserved":0,"allocated":3141632,"data_stored":1806014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":272354865},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5388,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002683"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.880921+0000","last_change":"2024-09-05T07:29:30.556803+0000","last_active":"2024-09-05T07:29:31.880921+0000","last_peered":"2024-09-05T07:29:31.880921+0000","last_clean":"2024-09-05T07:29:31.880921+0000","last_became_active":"2024-09-05T07:29:30.556513+0000","last_became_peered":"2024-09-05T07:29:30.556513+0000","last_unstale":"2024-09-05T07:29:31.880921+0000","last_undegraded":"2024-09-05T07:29:31.880921+0000","last_fullsized":"2024-09-05T07:29:31.880921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:38:11.961137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.631582+0000","last_change":"2024-09-05T07:29:30.658489+0000","last_active":"2024-09-05T07:29:31.631582+0000","last_peered":"2024-09-05T07:29:31.631582+0000","last_clean":"2024-09-05T07:29:31.631582+0000","last_became_active":"2024-09-05T07:29:30.658225+0000","last_became_peered":"2024-09-05T07:29:30.658225+0000","last_unstale":"2024-09-05T07:29:31.631582+0000","last_undegraded":"2024-09-05T07:29:31.631582+0000","last_fullsized":"2024-09-05T07:29:31.631582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:03:07.788844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.631512+0000","last_change":"2024-09-05T07:29:30.659535+0000","last_active":"2024-09-05T07:29:31.631512+0000","last_peered":"2024-09-05T07:29:31.631512+0000","last_clean":"2024-09-05T07:29:31.631512+0000","last_became_active":"2024-09-05T07:29:30.659042+0000","last_became_peered":"2024-09-05T07:29:30.659042+0000","last_unstale":"2024-09-05T07:29:31.631512+0000","last_undegraded":"2024-09-05T07:29:31.631512+0000","last_fullsized":"2024-09-05T07:29:31.631512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:08:39.718764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.882099+0000","last_change":"2024-09-05T07:29:30.640489+0000","last_active":"2024-09-05T07:29:31.882099+0000","last_peered":"2024-09-05T07:29:31.882099+0000","last_clean":"2024-09-05T07:29:31.882099+0000","last_became_active":"2024-09-05T07:29:30.640141+0000","last_became_peered":"2024-09-05T07:29:30.640141+0000","last_unstale":"2024-09-05T07:29:31.882099+0000","last_undegraded":"2024-09-05T07:29:31.882099+0000","last_fullsized":"2024-09-05T07:29:31.882099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:53:14.516901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881415+0000","last_change":"2024-09-05T07:29:30.659266+0000","last_active":"2024-09-05T07:29:31.881415+0000","last_peered":"2024-09-05T07:29:31.881415+0000","last_clean":"2024-09-05T07:29:31.881415+0000","last_became_active":"2024-09-05T07:29:30.658981+0000","last_became_peered":"2024-09-05T07:29:30.658981+0000","last_unstale":"2024-09-05T07:29:31.881415+0000","last_undegraded":"2024-09-05T07:29:31.881415+0000","last_fullsized":"2024-09-05T07:29:31.881415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:34:49.879681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881926+0000","last_change":"2024-09-05T07:29:30.641512+0000","last_active":"2024-09-05T07:29:31.881926+0000","last_peered":"2024-09-05T07:29:31.881926+0000","last_clean":"2024-09-05T07:29:31.881926+0000","last_became_active":"2024-09-05T07:29:30.641255+0000","last_became_peered":"2024-09-05T07:29:30.641255+0000","last_unstale":"2024-09-05T07:29:31.881926+0000","last_undegraded":"2024-09-05T07:29:31.881926+0000","last_fullsized":"2024-09-05T07:29:31.881926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:42.938157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881721+0000","last_change":"2024-09-05T07:29:30.556064+0000","last_active":"2024-09-05T07:29:31.881721+0000","last_peered":"2024-09-05T07:29:31.881721+0000","last_clean":"2024-09-05T07:29:31.881721+0000","last_became_active":"2024-09-05T07:29:30.555796+0000","last_became_peered":"2024-09-05T07:29:30.555796+0000","last_unstale":"2024-09-05T07:29:31.881721+0000","last_undegraded":"2024-09-05T07:29:31.881721+0000","last_fullsized":"2024-09-05T07:29:31.881721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:37:28.088603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.631334+0000","last_change":"2024-09-05T07:29:30.659561+0000","last_active":"2024-09-05T07:29:31.631334+0000","last_peered":"2024-09-05T07:29:31.631334+0000","last_clean":"2024-09-05T07:29:31.631334+0000","last_became_active":"2024-09-05T07:29:30.659070+0000","last_became_peered":"2024-09-05T07:29:30.659070+0000","last_unstale":"2024-09-05T07:29:31.631334+0000","last_undegraded":"2024-09-05T07:29:31.631334+0000","last_fullsized":"2024-09-05T07:29:31.631334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:13:33.902479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.907890+0000","last_change":"2024-09-05T07:29:30.565653+0000","last_active":"2024-09-05T07:29:31.907890+0000","last_peered":"2024-09-05T07:29:31.907890+0000","last_clean":"2024-09-05T07:29:31.907890+0000","last_became_active":"2024-09-05T07:29:30.565408+0000","last_became_peered":"2024-09-05T07:29:30.565408+0000","last_unstale":"2024-09-05T07:29:31.907890+0000","last_undegraded":"2024-09-05T07:29:31.907890+0000","last_fullsized":"2024-09-05T07:29:31.907890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:42.938157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881571+0000","last_change":"2024-09-05T07:29:30.643865+0000","last_active":"2024-09-05T07:29:31.881571+0000","last_peered":"2024-09-05T07:29:31.881571+0000","last_clean":"2024-09-05T07:29:31.881571+0000","last_became_active":"2024-09-05T07:29:30.643587+0000","last_became_peered":"2024-09-05T07:29:30.643587+0000","last_unstale":"2024-09-05T07:29:31.881571+0000","last_undegraded":"2024-09-05T07:29:31.881571+0000","last_fullsized":"2024-09-05T07:29:31.881571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:37:46.507371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.880939+0000","last_change":"2024-09-05T07:29:30.557314+0000","last_active":"2024-09-05T07:29:31.880939+0000","last_peered":"2024-09-05T07:29:31.880939+0000","last_clean":"2024-09-05T07:29:31.880939+0000","last_became_active":"2024-09-05T07:29:30.557039+0000","last_became_peered":"2024-09-05T07:29:30.557039+0000","last_unstale":"2024-09-05T07:29:31.880939+0000","last_undegraded":"2024-09-05T07:29:31.880939+0000","last_fullsized":"2024-09-05T07:29:31.880939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:08:39.718764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881426+0000","last_change":"2024-09-05T07:29:30.564518+0000","last_active":"2024-09-05T07:29:31.881426+0000","last_peered":"2024-09-05T07:29:31.881426+0000","last_clean":"2024-09-05T07:29:31.881426+0000","last_became_active":"2024-09-05T07:29:30.564271+0000","last_became_peered":"2024-09-05T07:29:30.564271+0000","last_unstale":"2024-09-05T07:29:31.881426+0000","last_undegraded":"2024-09-05T07:29:31.881426+0000","last_fullsized":"2024-09-05T07:29:31.881426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:09:22.026287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908103+0000","last_change":"2024-09-05T07:29:30.631857+0000","last_active":"2024-09-05T07:29:31.908103+0000","last_peered":"2024-09-05T07:29:31.908103+0000","last_clean":"2024-09-05T07:29:31.908103+0000","last_became_active":"2024-09-05T07:29:30.631588+0000","last_became_peered":"2024-09-05T07:29:30.631588+0000","last_unstale":"2024-09-05T07:29:31.908103+0000","last_undegraded":"2024-09-05T07:29:31.908103+0000","last_fullsized":"2024-09-05T07:29:31.908103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:41:25.696697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908490+0000","last_change":"2024-09-05T07:29:30.632829+0000","last_active":"2024-09-05T07:29:31.908490+0000","last_peered":"2024-09-05T07:29:31.908490+0000","last_clean":"2024-09-05T07:29:31.908490+0000","last_became_active":"2024-09-05T07:29:30.632528+0000","last_became_peered":"2024-09-05T07:29:30.632528+0000","last_unstale":"2024-09-05T07:29:31.908490+0000","last_undegraded":"2024-09-05T07:29:31.908490+0000","last_fullsized":"2024-09-05T07:29:31.908490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:22:35.613478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.631381+0000","last_change":"2024-09-05T07:29:30.657306+0000","last_active":"2024-09-05T07:29:31.631381+0000","last_peered":"2024-09-05T07:29:31.631381+0000","last_clean":"2024-09-05T07:29:31.631381+0000","last_became_active":"2024-09-05T07:29:30.656997+0000","last_became_peered":"2024-09-05T07:29:30.656997+0000","last_unstale":"2024-09-05T07:29:31.631381+0000","last_undegraded":"2024-09-05T07:29:31.631381+0000","last_fullsized":"2024-09-05T07:29:31.631381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:15:28.381136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.625605+0000","last_change":"2024-09-05T07:29:30.641543+0000","last_active":"2024-09-05T07:29:31.625605+0000","last_peered":"2024-09-05T07:29:31.625605+0000","last_clean":"2024-09-05T07:29:31.625605+0000","last_became_active":"2024-09-05T07:29:30.641283+0000","last_became_peered":"2024-09-05T07:29:30.641283+0000","last_unstale":"2024-09-05T07:29:31.625605+0000","last_undegraded":"2024-09-05T07:29:31.625605+0000","last_fullsized":"2024-09-05T07:29:31.625605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:36:59.967135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.626113+0000","last_change":"2024-09-05T07:29:30.558414+0000","last_active":"2024-09-05T07:29:31.626113+0000","last_peered":"2024-09-05T07:29:31.626113+0000","last_clean":"2024-09-05T07:29:31.626113+0000","last_became_active":"2024-09-05T07:29:30.558105+0000","last_became_peered":"2024-09-05T07:29:30.558105+0000","last_unstale":"2024-09-05T07:29:31.626113+0000","last_undegraded":"2024-09-05T07:29:31.626113+0000","last_fullsized":"2024-09-05T07:29:31.626113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:55:31.494616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908249+0000","last_change":"2024-09-05T07:29:30.643169+0000","last_active":"2024-09-05T07:29:31.908249+0000","last_peered":"2024-09-05T07:29:31.908249+0000","last_clean":"2024-09-05T07:29:31.908249+0000","last_became_active":"2024-09-05T07:29:30.642876+0000","last_became_peered":"2024-09-05T07:29:30.642876+0000","last_unstale":"2024-09-05T07:29:31.908249+0000","last_undegraded":"2024-09-05T07:29:31.908249+0000","last_fullsized":"2024-09-05T07:29:31.908249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:40.101513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.626245+0000","last_change":"2024-09-05T07:29:30.557239+0000","last_active":"2024-09-05T07:29:31.626245+0000","last_peered":"2024-09-05T07:29:31.626245+0000","last_clean":"2024-09-05T07:29:31.626245+0000","last_became_active":"2024-09-05T07:29:30.556969+0000","last_became_peered":"2024-09-05T07:29:30.556969+0000","last_unstale":"2024-09-05T07:29:31.626245+0000","last_undegraded":"2024-09-05T07:29:31.626245+0000","last_fullsized":"2024-09-05T07:29:31.626245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:47:29.801348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881573+0000","last_change":"2024-09-05T07:29:30.564077+0000","last_active":"2024-09-05T07:29:31.881573+0000","last_peered":"2024-09-05T07:29:31.881573+0000","last_clean":"2024-09-05T07:29:31.881573+0000","last_became_active":"2024-09-05T07:29:30.563808+0000","last_became_peered":"2024-09-05T07:29:30.563808+0000","last_unstale":"2024-09-05T07:29:31.881573+0000","last_undegraded":"2024-09-05T07:29:31.881573+0000","last_fullsized":"2024-09-05T07:29:31.881573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:00:35.625571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.668993+0000","last_change":"2024-09-05T07:29:30.643879+0000","last_active":"2024-09-05T07:29:31.668993+0000","last_peered":"2024-09-05T07:29:31.668993+0000","last_clean":"2024-09-05T07:29:31.668993+0000","last_became_active":"2024-09-05T07:29:30.643559+0000","last_became_peered":"2024-09-05T07:29:30.643559+0000","last_unstale":"2024-09-05T07:29:31.668993+0000","last_undegraded":"2024-09-05T07:29:31.668993+0000","last_fullsized":"2024-09-05T07:29:31.668993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:52:56.756904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.907631+0000","last_change":"2024-09-05T07:29:30.564954+0000","last_active":"2024-09-05T07:29:31.907631+0000","last_peered":"2024-09-05T07:29:31.907631+0000","last_clean":"2024-09-05T07:29:31.907631+0000","last_became_active":"2024-09-05T07:29:30.564669+0000","last_became_peered":"2024-09-05T07:29:30.564669+0000","last_unstale":"2024-09-05T07:29:31.907631+0000","last_undegraded":"2024-09-05T07:29:31.907631+0000","last_fullsized":"2024-09-05T07:29:31.907631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:53:40.150507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.631446+0000","last_change":"2024-09-05T07:29:30.656718+0000","last_active":"2024-09-05T07:29:31.631446+0000","last_peered":"2024-09-05T07:29:31.631446+0000","last_clean":"2024-09-05T07:29:31.631446+0000","last_became_active":"2024-09-05T07:29:30.656451+0000","last_became_peered":"2024-09-05T07:29:30.656451+0000","last_unstale":"2024-09-05T07:29:31.631446+0000","last_undegraded":"2024-09-05T07:29:31.631446+0000","last_fullsized":"2024-09-05T07:29:31.631446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:38:11.961137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.625602+0000","last_change":"2024-09-05T07:29:30.658481+0000","last_active":"2024-09-05T07:29:31.625602+0000","last_peered":"2024-09-05T07:29:31.625602+0000","last_clean":"2024-09-05T07:29:31.625602+0000","last_became_active":"2024-09-05T07:29:30.658207+0000","last_became_peered":"2024-09-05T07:29:30.658207+0000","last_unstale":"2024-09-05T07:29:31.625602+0000","last_undegraded":"2024-09-05T07:29:31.625602+0000","last_fullsized":"2024-09-05T07:29:31.625602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:23:04.483495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.631597+0000","last_change":"2024-09-05T07:29:30.657936+0000","last_active":"2024-09-05T07:29:31.631597+0000","last_peered":"2024-09-05T07:29:31.631597+0000","last_clean":"2024-09-05T07:29:31.631597+0000","last_became_active":"2024-09-05T07:29:30.657177+0000","last_became_peered":"2024-09-05T07:29:30.657177+0000","last_unstale":"2024-09-05T07:29:31.631597+0000","last_undegraded":"2024-09-05T07:29:31.631597+0000","last_fullsized":"2024-09-05T07:29:31.631597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:01:34.217228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.882231+0000","last_change":"2024-09-05T07:29:30.642790+0000","last_active":"2024-09-05T07:29:31.882231+0000","last_peered":"2024-09-05T07:29:31.882231+0000","last_clean":"2024-09-05T07:29:31.882231+0000","last_became_active":"2024-09-05T07:29:30.641834+0000","last_became_peered":"2024-09-05T07:29:30.641834+0000","last_unstale":"2024-09-05T07:29:31.882231+0000","last_undegraded":"2024-09-05T07:29:31.882231+0000","last_fullsized":"2024-09-05T07:29:31.882231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:34:17.448981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908717+0000","last_change":"2024-09-05T07:29:30.633776+0000","last_active":"2024-09-05T07:29:31.908717+0000","last_peered":"2024-09-05T07:29:31.908717+0000","last_clean":"2024-09-05T07:29:31.908717+0000","last_became_active":"2024-09-05T07:29:30.633507+0000","last_became_peered":"2024-09-05T07:29:30.633507+0000","last_unstale":"2024-09-05T07:29:31.908717+0000","last_undegraded":"2024-09-05T07:29:31.908717+0000","last_fullsized":"2024-09-05T07:29:31.908717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:34:54.335152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908515+0000","last_change":"2024-09-05T07:29:30.632558+0000","last_active":"2024-09-05T07:29:31.908515+0000","last_peered":"2024-09-05T07:29:31.908515+0000","last_clean":"2024-09-05T07:29:31.908515+0000","last_became_active":"2024-09-05T07:29:30.632269+0000","last_became_peered":"2024-09-05T07:29:30.632269+0000","last_unstale":"2024-09-05T07:29:31.908515+0000","last_undegraded":"2024-09-05T07:29:31.908515+0000","last_fullsized":"2024-09-05T07:29:31.908515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:35:18.927192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.631730+0000","last_change":"2024-09-05T07:29:30.656638+0000","last_active":"2024-09-05T07:29:31.631730+0000","last_peered":"2024-09-05T07:29:31.631730+0000","last_clean":"2024-09-05T07:29:31.631730+0000","last_became_active":"2024-09-05T07:29:30.656382+0000","last_became_peered":"2024-09-05T07:29:30.656382+0000","last_unstale":"2024-09-05T07:29:31.631730+0000","last_undegraded":"2024-09-05T07:29:31.631730+0000","last_fullsized":"2024-09-05T07:29:31.631730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:34:49.879681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.625711+0000","last_change":"2024-09-05T07:29:30.657421+0000","last_active":"2024-09-05T07:29:31.625711+0000","last_peered":"2024-09-05T07:29:31.625711+0000","last_clean":"2024-09-05T07:29:31.625711+0000","last_became_active":"2024-09-05T07:29:30.657159+0000","last_became_peered":"2024-09-05T07:29:30.657159+0000","last_unstale":"2024-09-05T07:29:31.625711+0000","last_undegraded":"2024-09-05T07:29:31.625711+0000","last_fullsized":"2024-09-05T07:29:31.625711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:13:05.334750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908422+0000","last_change":"2024-09-05T07:29:30.624866+0000","last_active":"2024-09-05T07:29:31.908422+0000","last_peered":"2024-09-05T07:29:31.908422+0000","last_clean":"2024-09-05T07:29:31.908422+0000","last_became_active":"2024-09-05T07:29:30.624605+0000","last_became_peered":"2024-09-05T07:29:30.624605+0000","last_unstale":"2024-09-05T07:29:31.908422+0000","last_undegraded":"2024-09-05T07:29:31.908422+0000","last_fullsized":"2024-09-05T07:29:31.908422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:42.938157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881624+0000","last_change":"2024-09-05T07:29:30.642514+0000","last_active":"2024-09-05T07:29:31.881624+0000","last_peered":"2024-09-05T07:29:31.881624+0000","last_clean":"2024-09-05T07:29:31.881624+0000","last_became_active":"2024-09-05T07:29:30.642084+0000","last_became_peered":"2024-09-05T07:29:30.642084+0000","last_unstale":"2024-09-05T07:29:31.881624+0000","last_undegraded":"2024-09-05T07:29:31.881624+0000","last_fullsized":"2024-09-05T07:29:31.881624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:40.101513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.907656+0000","last_change":"2024-09-05T07:29:30.657456+0000","last_active":"2024-09-05T07:29:31.907656+0000","last_peered":"2024-09-05T07:29:31.907656+0000","last_clean":"2024-09-05T07:29:31.907656+0000","last_became_active":"2024-09-05T07:29:30.657117+0000","last_became_peered":"2024-09-05T07:29:30.657117+0000","last_unstale":"2024-09-05T07:29:31.907656+0000","last_undegraded":"2024-09-05T07:29:31.907656+0000","last_fullsized":"2024-09-05T07:29:31.907656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:40.101513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'5","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.497941+0000","last_change":"2024-09-05T07:29:29.568126+0000","last_active":"2024-09-05T07:29:36.497941+0000","last_peered":"2024-09-05T07:29:36.497941+0000","last_clean":"2024-09-05T07:29:36.497941+0000","last_became_active":"2024-09-05T07:29:29.567846+0000","last_became_peered":"2024-09-05T07:29:29.567846+0000","last_unstale":"2024-09-05T07:29:36.497941+0000","last_undegraded":"2024-09-05T07:29:36.497941+0000","last_fullsized":"2024-09-05T07:29:36.497941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:48:25.900221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.669165+0000","last_change":"2024-09-05T07:29:30.557504+0000","last_active":"2024-09-05T07:29:31.669165+0000","last_peered":"2024-09-05T07:29:31.669165+0000","last_clean":"2024-09-05T07:29:31.669165+0000","last_became_active":"2024-09-05T07:29:30.557203+0000","last_became_peered":"2024-09-05T07:29:30.557203+0000","last_unstale":"2024-09-05T07:29:31.669165+0000","last_undegraded":"2024-09-05T07:29:31.669165+0000","last_fullsized":"2024-09-05T07:29:31.669165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:55:13.742728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'7","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:46.191539+0000","last_change":"2024-09-05T07:29:29.524587+0000","last_active":"2024-09-05T07:29:46.191539+0000","last_peered":"2024-09-05T07:29:46.191539+0000","last_clean":"2024-09-05T07:29:46.191539+0000","last_became_active":"2024-09-05T07:29:29.524321+0000","last_became_peered":"2024-09-05T07:29:29.524321+0000","last_unstale":"2024-09-05T07:29:46.191539+0000","last_undegraded":"2024-09-05T07:29:46.191539+0000","last_fullsized":"2024-09-05T07:29:46.191539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:53:13.376716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:43.514742+0000","last_change":"2024-09-05T07:29:29.570879+0000","last_active":"2024-09-05T07:29:43.514742+0000","last_peered":"2024-09-05T07:29:43.514742+0000","last_clean":"2024-09-05T07:29:43.514742+0000","last_became_active":"2024-09-05T07:29:29.570456+0000","last_became_peered":"2024-09-05T07:29:29.570456+0000","last_unstale":"2024-09-05T07:29:43.514742+0000","last_undegraded":"2024-09-05T07:29:43.514742+0000","last_fullsized":"2024-09-05T07:29:43.514742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:52:54.638586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.632417+0000","last_change":"2024-09-05T07:29:30.657364+0000","last_active":"2024-09-05T07:29:31.632417+0000","last_peered":"2024-09-05T07:29:31.632417+0000","last_clean":"2024-09-05T07:29:31.632417+0000","last_became_active":"2024-09-05T07:29:30.657008+0000","last_became_peered":"2024-09-05T07:29:30.657008+0000","last_unstale":"2024-09-05T07:29:31.632417+0000","last_undegraded":"2024-09-05T07:29:31.632417+0000","last_fullsized":"2024-09-05T07:29:31.632417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:36:59.967135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.418084+0000","last_change":"2024-09-05T07:29:29.562802+0000","last_active":"2024-09-05T07:29:36.418084+0000","last_peered":"2024-09-05T07:29:36.418084+0000","last_clean":"2024-09-05T07:29:36.418084+0000","last_became_active":"2024-09-05T07:29:29.562520+0000","last_became_peered":"2024-09-05T07:29:29.562520+0000","last_unstale":"2024-09-05T07:29:36.418084+0000","last_undegraded":"2024-09-05T07:29:36.418084+0000","last_fullsized":"2024-09-05T07:29:36.418084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:34:16.308797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.669116+0000","last_change":"2024-09-05T07:29:30.563197+0000","last_active":"2024-09-05T07:29:31.669116+0000","last_peered":"2024-09-05T07:29:31.669116+0000","last_clean":"2024-09-05T07:29:31.669116+0000","last_became_active":"2024-09-05T07:29:30.562945+0000","last_became_peered":"2024-09-05T07:29:30.562945+0000","last_unstale":"2024-09-05T07:29:31.669116+0000","last_undegraded":"2024-09-05T07:29:31.669116+0000","last_fullsized":"2024-09-05T07:29:31.669116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:31:37.754325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.490215+0000","last_change":"2024-09-05T07:29:29.559012+0000","last_active":"2024-09-05T07:29:36.490215+0000","last_peered":"2024-09-05T07:29:36.490215+0000","last_clean":"2024-09-05T07:29:36.490215+0000","last_became_active":"2024-09-05T07:29:29.558744+0000","last_became_peered":"2024-09-05T07:29:29.558744+0000","last_unstale":"2024-09-05T07:29:36.490215+0000","last_undegraded":"2024-09-05T07:29:36.490215+0000","last_fullsized":"2024-09-05T07:29:36.490215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:28:41.630593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.882278+0000","last_change":"2024-09-05T07:29:30.641594+0000","last_active":"2024-09-05T07:29:31.882278+0000","last_peered":"2024-09-05T07:29:31.882278+0000","last_clean":"2024-09-05T07:29:31.882278+0000","last_became_active":"2024-09-05T07:29:30.641360+0000","last_became_peered":"2024-09-05T07:29:30.641360+0000","last_unstale":"2024-09-05T07:29:31.882278+0000","last_undegraded":"2024-09-05T07:29:31.882278+0000","last_fullsized":"2024-09-05T07:29:31.882278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:49:40.327718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.506359+0000","last_change":"2024-09-05T07:29:29.559998+0000","last_active":"2024-09-05T07:29:36.506359+0000","last_peered":"2024-09-05T07:29:36.506359+0000","last_clean":"2024-09-05T07:29:36.506359+0000","last_became_active":"2024-09-05T07:29:29.559717+0000","last_became_peered":"2024-09-05T07:29:29.559717+0000","last_unstale":"2024-09-05T07:29:36.506359+0000","last_undegraded":"2024-09-05T07:29:36.506359+0000","last_fullsized":"2024-09-05T07:29:36.506359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:58.513308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.632185+0000","last_change":"2024-09-05T07:29:30.657727+0000","last_active":"2024-09-05T07:29:31.632185+0000","last_peered":"2024-09-05T07:29:31.632185+0000","last_clean":"2024-09-05T07:29:31.632185+0000","last_became_active":"2024-09-05T07:29:30.657038+0000","last_became_peered":"2024-09-05T07:29:30.657038+0000","last_unstale":"2024-09-05T07:29:31.632185+0000","last_undegraded":"2024-09-05T07:29:31.632185+0000","last_fullsized":"2024-09-05T07:29:31.632185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:00:35.625571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'5","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.412609+0000","last_change":"2024-09-05T07:29:29.566840+0000","last_active":"2024-09-05T07:29:36.412609+0000","last_peered":"2024-09-05T07:29:36.412609+0000","last_clean":"2024-09-05T07:29:36.412609+0000","last_became_active":"2024-09-05T07:29:29.566501+0000","last_became_peered":"2024-09-05T07:29:29.566501+0000","last_unstale":"2024-09-05T07:29:36.412609+0000","last_undegraded":"2024-09-05T07:29:36.412609+0000","last_fullsized":"2024-09-05T07:29:36.412609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:47:57.187710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.625755+0000","last_change":"2024-09-05T07:29:30.642252+0000","last_active":"2024-09-05T07:29:31.625755+0000","last_peered":"2024-09-05T07:29:31.625755+0000","last_clean":"2024-09-05T07:29:31.625755+0000","last_became_active":"2024-09-05T07:29:30.641991+0000","last_became_peered":"2024-09-05T07:29:30.641991+0000","last_unstale":"2024-09-05T07:29:31.625755+0000","last_undegraded":"2024-09-05T07:29:31.625755+0000","last_fullsized":"2024-09-05T07:29:31.625755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:42:04.216273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.495388+0000","last_change":"2024-09-05T07:29:29.562441+0000","last_active":"2024-09-05T07:29:36.495388+0000","last_peered":"2024-09-05T07:29:36.495388+0000","last_clean":"2024-09-05T07:29:36.495388+0000","last_became_active":"2024-09-05T07:29:29.562136+0000","last_became_peered":"2024-09-05T07:29:29.562136+0000","last_unstale":"2024-09-05T07:29:36.495388+0000","last_undegraded":"2024-09-05T07:29:36.495388+0000","last_fullsized":"2024-09-05T07:29:36.495388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:06:20.633881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881213+0000","last_change":"2024-09-05T07:29:30.633033+0000","last_active":"2024-09-05T07:29:31.881213+0000","last_peered":"2024-09-05T07:29:31.881213+0000","last_clean":"2024-09-05T07:29:31.881213+0000","last_became_active":"2024-09-05T07:29:30.632784+0000","last_became_peered":"2024-09-05T07:29:30.632784+0000","last_unstale":"2024-09-05T07:29:31.881213+0000","last_undegraded":"2024-09-05T07:29:31.881213+0000","last_fullsized":"2024-09-05T07:29:31.881213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:03:07.788844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'7","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:43.511371+0000","last_change":"2024-09-05T07:29:29.567195+0000","last_active":"2024-09-05T07:29:43.511371+0000","last_peered":"2024-09-05T07:29:43.511371+0000","last_clean":"2024-09-05T07:29:43.511371+0000","last_became_active":"2024-09-05T07:29:29.566934+0000","last_became_peered":"2024-09-05T07:29:29.566934+0000","last_unstale":"2024-09-05T07:29:43.511371+0000","last_undegraded":"2024-09-05T07:29:43.511371+0000","last_fullsized":"2024-09-05T07:29:43.511371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:10:28.438071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908548+0000","last_change":"2024-09-05T07:29:30.632260+0000","last_active":"2024-09-05T07:29:31.908548+0000","last_peered":"2024-09-05T07:29:31.908548+0000","last_clean":"2024-09-05T07:29:31.908548+0000","last_became_active":"2024-09-05T07:29:30.631974+0000","last_became_peered":"2024-09-05T07:29:30.631974+0000","last_unstale":"2024-09-05T07:29:31.908548+0000","last_undegraded":"2024-09-05T07:29:31.908548+0000","last_fullsized":"2024-09-05T07:29:31.908548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:45:00.967978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.418387+0000","last_change":"2024-09-05T07:29:29.567028+0000","last_active":"2024-09-05T07:29:36.418387+0000","last_peered":"2024-09-05T07:29:36.418387+0000","last_clean":"2024-09-05T07:29:36.418387+0000","last_became_active":"2024-09-05T07:29:29.566754+0000","last_became_peered":"2024-09-05T07:29:29.566754+0000","last_unstale":"2024-09-05T07:29:36.418387+0000","last_undegraded":"2024-09-05T07:29:36.418387+0000","last_fullsized":"2024-09-05T07:29:36.418387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:49:13.565181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.626093+0000","last_change":"2024-09-05T07:29:30.558658+0000","last_active":"2024-09-05T07:29:31.626093+0000","last_peered":"2024-09-05T07:29:31.626093+0000","last_clean":"2024-09-05T07:29:31.626093+0000","last_became_active":"2024-09-05T07:29:30.558179+0000","last_became_peered":"2024-09-05T07:29:30.558179+0000","last_unstale":"2024-09-05T07:29:31.626093+0000","last_undegraded":"2024-09-05T07:29:31.626093+0000","last_fullsized":"2024-09-05T07:29:31.626093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:44:13.003367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"22'5","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:46.300635+0000","last_change":"2024-09-05T07:29:29.525420+0000","last_active":"2024-09-05T07:29:46.300635+0000","last_peered":"2024-09-05T07:29:46.300635+0000","last_clean":"2024-09-05T07:29:46.300635+0000","last_became_active":"2024-09-05T07:29:29.525139+0000","last_became_peered":"2024-09-05T07:29:29.525139+0000","last_unstale":"2024-09-05T07:29:46.300635+0000","last_undegraded":"2024-09-05T07:29:46.300635+0000","last_fullsized":"2024-09-05T07:29:46.300635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:54:00.339029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.907555+0000","last_change":"2024-09-05T07:29:30.659606+0000","last_active":"2024-09-05T07:29:31.907555+0000","last_peered":"2024-09-05T07:29:31.907555+0000","last_clean":"2024-09-05T07:29:31.907555+0000","last_became_active":"2024-09-05T07:29:30.659311+0000","last_became_peered":"2024-09-05T07:29:30.659311+0000","last_unstale":"2024-09-05T07:29:31.907555+0000","last_undegraded":"2024-09-05T07:29:31.907555+0000","last_fullsized":"2024-09-05T07:29:31.907555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:54:01.479214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'15","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:43.594660+0000","last_change":"2024-09-05T07:29:29.566784+0000","last_active":"2024-09-05T07:29:43.594660+0000","last_peered":"2024-09-05T07:29:43.594660+0000","last_clean":"2024-09-05T07:29:43.594660+0000","last_became_active":"2024-09-05T07:29:29.566503+0000","last_became_peered":"2024-09-05T07:29:29.566503+0000","last_unstale":"2024-09-05T07:29:43.594660+0000","last_undegraded":"2024-09-05T07:29:43.594660+0000","last_fullsized":"2024-09-05T07:29:43.594660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:35:54.465221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.625644+0000","last_change":"2024-09-05T07:29:30.641565+0000","last_active":"2024-09-05T07:29:31.625644+0000","last_peered":"2024-09-05T07:29:31.625644+0000","last_clean":"2024-09-05T07:29:31.625644+0000","last_became_active":"2024-09-05T07:29:30.641309+0000","last_became_peered":"2024-09-05T07:29:30.641309+0000","last_unstale":"2024-09-05T07:29:31.625644+0000","last_undegraded":"2024-09-05T07:29:31.625644+0000","last_fullsized":"2024-09-05T07:29:31.625644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:37:28.088603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:32.026265+0000","last_change":"2024-09-05T07:29:29.524793+0000","last_active":"2024-09-05T07:29:32.026265+0000","last_peered":"2024-09-05T07:29:32.026265+0000","last_clean":"2024-09-05T07:29:32.026265+0000","last_became_active":"2024-09-05T07:29:29.524522+0000","last_became_peered":"2024-09-05T07:29:29.524522+0000","last_unstale":"2024-09-05T07:29:32.026265+0000","last_undegraded":"2024-09-05T07:29:32.026265+0000","last_fullsized":"2024-09-05T07:29:32.026265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:41.797972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.882353+0000","last_change":"2024-09-05T07:29:30.642565+0000","last_active":"2024-09-05T07:29:31.882353+0000","last_peered":"2024-09-05T07:29:31.882353+0000","last_clean":"2024-09-05T07:29:31.882353+0000","last_became_active":"2024-09-05T07:29:30.641774+0000","last_became_peered":"2024-09-05T07:29:30.641774+0000","last_unstale":"2024-09-05T07:29:31.882353+0000","last_undegraded":"2024-09-05T07:29:31.882353+0000","last_fullsized":"2024-09-05T07:29:31.882353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:09:36.911425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:32.036409+0000","last_change":"2024-09-05T07:29:29.525374+0000","last_active":"2024-09-05T07:29:32.036409+0000","last_peered":"2024-09-05T07:29:32.036409+0000","last_clean":"2024-09-05T07:29:32.036409+0000","last_became_active":"2024-09-05T07:29:29.525044+0000","last_became_peered":"2024-09-05T07:29:29.525044+0000","last_unstale":"2024-09-05T07:29:32.036409+0000","last_undegraded":"2024-09-05T07:29:32.036409+0000","last_fullsized":"2024-09-05T07:29:32.036409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:25:35.862773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881625+0000","last_change":"2024-09-05T07:29:30.563669+0000","last_active":"2024-09-05T07:29:31.881625+0000","last_peered":"2024-09-05T07:29:31.881625+0000","last_clean":"2024-09-05T07:29:31.881625+0000","last_became_active":"2024-09-05T07:29:30.563408+0000","last_became_peered":"2024-09-05T07:29:30.563408+0000","last_unstale":"2024-09-05T07:29:31.881625+0000","last_undegraded":"2024-09-05T07:29:31.881625+0000","last_fullsized":"2024-09-05T07:29:31.881625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:42:04.216273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:32.565260+0000","last_change":"2024-09-05T07:29:29.559111+0000","last_active":"2024-09-05T07:29:32.565260+0000","last_peered":"2024-09-05T07:29:32.565260+0000","last_clean":"2024-09-05T07:29:32.565260+0000","last_became_active":"2024-09-05T07:29:29.558856+0000","last_became_peered":"2024-09-05T07:29:29.558856+0000","last_unstale":"2024-09-05T07:29:32.565260+0000","last_undegraded":"2024-09-05T07:29:32.565260+0000","last_fullsized":"2024-09-05T07:29:32.565260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:47:57.187710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881728+0000","last_change":"2024-09-05T07:29:30.624401+0000","last_active":"2024-09-05T07:29:31.881728+0000","last_peered":"2024-09-05T07:29:31.881728+0000","last_clean":"2024-09-05T07:29:31.881728+0000","last_became_active":"2024-09-05T07:29:30.624057+0000","last_became_peered":"2024-09-05T07:29:30.624057+0000","last_unstale":"2024-09-05T07:29:31.881728+0000","last_undegraded":"2024-09-05T07:29:31.881728+0000","last_fullsized":"2024-09-05T07:29:31.881728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:36:59.967135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:43.514854+0000","last_change":"2024-09-05T07:29:29.570940+0000","last_active":"2024-09-05T07:29:43.514854+0000","last_peered":"2024-09-05T07:29:43.514854+0000","last_clean":"2024-09-05T07:29:43.514854+0000","last_became_active":"2024-09-05T07:29:29.570478+0000","last_became_peered":"2024-09-05T07:29:29.570478+0000","last_unstale":"2024-09-05T07:29:43.514854+0000","last_undegraded":"2024-09-05T07:29:43.514854+0000","last_fullsized":"2024-09-05T07:29:43.514854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:35:54.465221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.625978+0000","last_change":"2024-09-05T07:29:30.563109+0000","last_active":"2024-09-05T07:29:31.625978+0000","last_peered":"2024-09-05T07:29:31.625978+0000","last_clean":"2024-09-05T07:29:31.625978+0000","last_became_active":"2024-09-05T07:29:30.562824+0000","last_became_peered":"2024-09-05T07:29:30.562824+0000","last_unstale":"2024-09-05T07:29:31.625978+0000","last_undegraded":"2024-09-05T07:29:31.625978+0000","last_fullsized":"2024-09-05T07:29:31.625978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:42:02.212868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":171,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.907582+0000","last_change":"2024-09-05T07:29:13.366600+0000","last_active":"2024-09-05T07:29:31.907582+0000","last_peered":"2024-09-05T07:29:31.907582+0000","last_clean":"2024-09-05T07:29:31.907582+0000","last_became_active":"2024-09-05T07:29:13.365841+0000","last_became_peered":"2024-09-05T07:29:13.365841+0000","last_unstale":"2024-09-05T07:29:31.907582+0000","last_undegraded":"2024-09-05T07:29:31.907582+0000","last_fullsized":"2024-09-05T07:29:31.907582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:10.874807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:10.874807+0000","last_clean_scrub_stamp":"2024-09-05T07:29:10.874807+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:21:17.673107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"22'5","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:46.190412+0000","last_change":"2024-09-05T07:29:29.563604+0000","last_active":"2024-09-05T07:29:46.190412+0000","last_peered":"2024-09-05T07:29:46.190412+0000","last_clean":"2024-09-05T07:29:46.190412+0000","last_became_active":"2024-09-05T07:29:29.562956+0000","last_became_peered":"2024-09-05T07:29:29.562956+0000","last_unstale":"2024-09-05T07:29:46.190412+0000","last_undegraded":"2024-09-05T07:29:46.190412+0000","last_fullsized":"2024-09-05T07:29:46.190412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:41.797972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.669026+0000","last_change":"2024-09-05T07:29:30.641543+0000","last_active":"2024-09-05T07:29:31.669026+0000","last_peered":"2024-09-05T07:29:31.669026+0000","last_clean":"2024-09-05T07:29:31.669026+0000","last_became_active":"2024-09-05T07:29:30.641243+0000","last_became_peered":"2024-09-05T07:29:30.641243+0000","last_unstale":"2024-09-05T07:29:31.669026+0000","last_undegraded":"2024-09-05T07:29:31.669026+0000","last_fullsized":"2024-09-05T07:29:31.669026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:34:54.335152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:43.515757+0000","last_change":"2024-09-05T07:29:29.479329+0000","last_active":"2024-09-05T07:29:43.515757+0000","last_peered":"2024-09-05T07:29:43.515757+0000","last_clean":"2024-09-05T07:29:43.515757+0000","last_became_active":"2024-09-05T07:29:29.479005+0000","last_became_peered":"2024-09-05T07:29:29.479005+0000","last_unstale":"2024-09-05T07:29:43.515757+0000","last_undegraded":"2024-09-05T07:29:43.515757+0000","last_fullsized":"2024-09-05T07:29:43.515757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:49:39.187534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908022+0000","last_change":"2024-09-05T07:29:30.641557+0000","last_active":"2024-09-05T07:29:31.908022+0000","last_peered":"2024-09-05T07:29:31.908022+0000","last_clean":"2024-09-05T07:29:31.908022+0000","last_became_active":"2024-09-05T07:29:30.641269+0000","last_became_peered":"2024-09-05T07:29:30.641269+0000","last_unstale":"2024-09-05T07:29:31.908022+0000","last_undegraded":"2024-09-05T07:29:31.908022+0000","last_fullsized":"2024-09-05T07:29:31.908022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:32:30.263430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:43.511356+0000","last_change":"2024-09-05T07:29:29.568835+0000","last_active":"2024-09-05T07:29:43.511356+0000","last_peered":"2024-09-05T07:29:43.511356+0000","last_clean":"2024-09-05T07:29:43.511356+0000","last_became_active":"2024-09-05T07:29:29.568576+0000","last_became_peered":"2024-09-05T07:29:29.568576+0000","last_unstale":"2024-09-05T07:29:43.511356+0000","last_undegraded":"2024-09-05T07:29:43.511356+0000","last_fullsized":"2024-09-05T07:29:43.511356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:05:05.417016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.632195+0000","last_change":"2024-09-05T07:29:30.660008+0000","last_active":"2024-09-05T07:29:31.632195+0000","last_peered":"2024-09-05T07:29:31.632195+0000","last_clean":"2024-09-05T07:29:31.632195+0000","last_became_active":"2024-09-05T07:29:30.659720+0000","last_became_peered":"2024-09-05T07:29:30.659720+0000","last_unstale":"2024-09-05T07:29:31.632195+0000","last_undegraded":"2024-09-05T07:29:31.632195+0000","last_fullsized":"2024-09-05T07:29:31.632195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:42:04.216273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.626354+0000","last_change":"2024-09-05T07:29:29.568569+0000","last_active":"2024-09-05T07:29:31.626354+0000","last_peered":"2024-09-05T07:29:31.626354+0000","last_clean":"2024-09-05T07:29:31.626354+0000","last_became_active":"2024-09-05T07:29:29.568307+0000","last_became_peered":"2024-09-05T07:29:29.568307+0000","last_unstale":"2024-09-05T07:29:31.626354+0000","last_undegraded":"2024-09-05T07:29:31.626354+0000","last_fullsized":"2024-09-05T07:29:31.626354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:12:38.814463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881267+0000","last_change":"2024-09-05T07:29:30.642687+0000","last_active":"2024-09-05T07:29:31.881267+0000","last_peered":"2024-09-05T07:29:31.881267+0000","last_clean":"2024-09-05T07:29:31.881267+0000","last_became_active":"2024-09-05T07:29:30.642414+0000","last_became_peered":"2024-09-05T07:29:30.642414+0000","last_unstale":"2024-09-05T07:29:31.881267+0000","last_undegraded":"2024-09-05T07:29:31.881267+0000","last_fullsized":"2024-09-05T07:29:31.881267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:01:34.217228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:32.565227+0000","last_change":"2024-09-05T07:29:29.568739+0000","last_active":"2024-09-05T07:29:32.565227+0000","last_peered":"2024-09-05T07:29:32.565227+0000","last_clean":"2024-09-05T07:29:32.565227+0000","last_became_active":"2024-09-05T07:29:29.568499+0000","last_became_peered":"2024-09-05T07:29:29.568499+0000","last_unstale":"2024-09-05T07:29:32.565227+0000","last_undegraded":"2024-09-05T07:29:32.565227+0000","last_fullsized":"2024-09-05T07:29:32.565227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:05:05.417016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.881813+0000","last_change":"2024-09-05T07:29:30.641340+0000","last_active":"2024-09-05T07:29:31.881813+0000","last_peered":"2024-09-05T07:29:31.881813+0000","last_clean":"2024-09-05T07:29:31.881813+0000","last_became_active":"2024-09-05T07:29:30.640805+0000","last_became_peered":"2024-09-05T07:29:30.640805+0000","last_unstale":"2024-09-05T07:29:31.881813+0000","last_undegraded":"2024-09-05T07:29:31.881813+0000","last_fullsized":"2024-09-05T07:29:31.881813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:59.653492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:46.191234+0000","last_change":"2024-09-05T07:29:29.525212+0000","last_active":"2024-09-05T07:29:46.191234+0000","last_peered":"2024-09-05T07:29:46.191234+0000","last_clean":"2024-09-05T07:29:46.191234+0000","last_became_active":"2024-09-05T07:29:29.524918+0000","last_became_peered":"2024-09-05T07:29:29.524918+0000","last_unstale":"2024-09-05T07:29:46.191234+0000","last_undegraded":"2024-09-05T07:29:46.191234+0000","last_fullsized":"2024-09-05T07:29:46.191234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:09:35.771241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908661+0000","last_change":"2024-09-05T07:29:30.658407+0000","last_active":"2024-09-05T07:29:31.908661+0000","last_peered":"2024-09-05T07:29:31.908661+0000","last_clean":"2024-09-05T07:29:31.908661+0000","last_became_active":"2024-09-05T07:29:30.658155+0000","last_became_peered":"2024-09-05T07:29:30.658155+0000","last_unstale":"2024-09-05T07:29:31.908661+0000","last_undegraded":"2024-09-05T07:29:31.908661+0000","last_fullsized":"2024-09-05T07:29:31.908661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:52:56.756904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:43.512345+0000","last_change":"2024-09-05T07:29:29.526674+0000","last_active":"2024-09-05T07:29:43.512345+0000","last_peered":"2024-09-05T07:29:43.512345+0000","last_clean":"2024-09-05T07:29:43.512345+0000","last_became_active":"2024-09-05T07:29:29.526421+0000","last_became_peered":"2024-09-05T07:29:29.526421+0000","last_unstale":"2024-09-05T07:29:43.512345+0000","last_undegraded":"2024-09-05T07:29:43.512345+0000","last_fullsized":"2024-09-05T07:29:43.512345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:52:13.496606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.669439+0000","last_change":"2024-09-05T07:29:30.633806+0000","last_active":"2024-09-05T07:29:31.669439+0000","last_peered":"2024-09-05T07:29:31.669439+0000","last_clean":"2024-09-05T07:29:31.669439+0000","last_became_active":"2024-09-05T07:29:30.633535+0000","last_became_peered":"2024-09-05T07:29:30.633535+0000","last_unstale":"2024-09-05T07:29:31.669439+0000","last_undegraded":"2024-09-05T07:29:31.669439+0000","last_fullsized":"2024-09-05T07:29:31.669439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:40:35.334862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'5","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.418438+0000","last_change":"2024-09-05T07:29:29.524532+0000","last_active":"2024-09-05T07:29:36.418438+0000","last_peered":"2024-09-05T07:29:36.418438+0000","last_clean":"2024-09-05T07:29:36.418438+0000","last_became_active":"2024-09-05T07:29:29.524268+0000","last_became_peered":"2024-09-05T07:29:29.524268+0000","last_unstale":"2024-09-05T07:29:36.418438+0000","last_undegraded":"2024-09-05T07:29:36.418438+0000","last_fullsized":"2024-09-05T07:29:36.418438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:58.513308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.669296+0000","last_change":"2024-09-05T07:29:30.624431+0000","last_active":"2024-09-05T07:29:31.669296+0000","last_peered":"2024-09-05T07:29:31.669296+0000","last_clean":"2024-09-05T07:29:31.669296+0000","last_became_active":"2024-09-05T07:29:30.624117+0000","last_became_peered":"2024-09-05T07:29:30.624117+0000","last_unstale":"2024-09-05T07:29:31.669296+0000","last_undegraded":"2024-09-05T07:29:31.669296+0000","last_fullsized":"2024-09-05T07:29:31.669296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:10:00.845713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.506474+0000","last_change":"2024-09-05T07:29:29.561285+0000","last_active":"2024-09-05T07:29:36.506474+0000","last_peered":"2024-09-05T07:29:36.506474+0000","last_clean":"2024-09-05T07:29:36.506474+0000","last_became_active":"2024-09-05T07:29:29.561026+0000","last_became_peered":"2024-09-05T07:29:29.561026+0000","last_unstale":"2024-09-05T07:29:36.506474+0000","last_undegraded":"2024-09-05T07:29:36.506474+0000","last_fullsized":"2024-09-05T07:29:36.506474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:48:25.900221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.626031+0000","last_change":"2024-09-05T07:29:30.556889+0000","last_active":"2024-09-05T07:29:31.626031+0000","last_peered":"2024-09-05T07:29:31.626031+0000","last_clean":"2024-09-05T07:29:31.626031+0000","last_became_active":"2024-09-05T07:29:30.556627+0000","last_became_peered":"2024-09-05T07:29:30.556627+0000","last_unstale":"2024-09-05T07:29:31.626031+0000","last_undegraded":"2024-09-05T07:29:31.626031+0000","last_fullsized":"2024-09-05T07:29:31.626031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:20:01.152157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.415122+0000","last_change":"2024-09-05T07:29:29.526873+0000","last_active":"2024-09-05T07:29:36.415122+0000","last_peered":"2024-09-05T07:29:36.415122+0000","last_clean":"2024-09-05T07:29:36.415122+0000","last_became_active":"2024-09-05T07:29:29.526572+0000","last_became_peered":"2024-09-05T07:29:29.526572+0000","last_unstale":"2024-09-05T07:29:36.415122+0000","last_undegraded":"2024-09-05T07:29:36.415122+0000","last_fullsized":"2024-09-05T07:29:36.415122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:33:14.122911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.668972+0000","last_change":"2024-09-05T07:29:30.624592+0000","last_active":"2024-09-05T07:29:31.668972+0000","last_peered":"2024-09-05T07:29:31.668972+0000","last_clean":"2024-09-05T07:29:31.668972+0000","last_became_active":"2024-09-05T07:29:30.624109+0000","last_became_peered":"2024-09-05T07:29:30.624109+0000","last_unstale":"2024-09-05T07:29:31.668972+0000","last_undegraded":"2024-09-05T07:29:31.668972+0000","last_fullsized":"2024-09-05T07:29:31.668972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:22:35.613478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908729+0000","last_change":"2024-09-05T07:29:29.569816+0000","last_active":"2024-09-05T07:29:31.908729+0000","last_peered":"2024-09-05T07:29:31.908729+0000","last_clean":"2024-09-05T07:29:31.908729+0000","last_became_active":"2024-09-05T07:29:29.569536+0000","last_became_peered":"2024-09-05T07:29:29.569536+0000","last_unstale":"2024-09-05T07:29:31.908729+0000","last_undegraded":"2024-09-05T07:29:31.908729+0000","last_fullsized":"2024-09-05T07:29:31.908729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:59:18.418220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.908389+0000","last_change":"2024-09-05T07:29:30.632805+0000","last_active":"2024-09-05T07:29:31.908389+0000","last_peered":"2024-09-05T07:29:31.908389+0000","last_clean":"2024-09-05T07:29:31.908389+0000","last_became_active":"2024-09-05T07:29:30.632502+0000","last_became_peered":"2024-09-05T07:29:30.632502+0000","last_unstale":"2024-09-05T07:29:31.908389+0000","last_undegraded":"2024-09-05T07:29:31.908389+0000","last_fullsized":"2024-09-05T07:29:31.908389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:59.653492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:36.417932+0000","last_change":"2024-09-05T07:29:29.563821+0000","last_active":"2024-09-05T07:29:36.417932+0000","last_peered":"2024-09-05T07:29:36.417932+0000","last_clean":"2024-09-05T07:29:36.417932+0000","last_became_active":"2024-09-05T07:29:29.563316+0000","last_became_peered":"2024-09-05T07:29:29.563316+0000","last_unstale":"2024-09-05T07:29:36.417932+0000","last_undegraded":"2024-09-05T07:29:36.417932+0000","last_fullsized":"2024-09-05T07:29:36.417932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:38.961328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.626045+0000","last_change":"2024-09-05T07:29:30.563106+0000","last_active":"2024-09-05T07:29:31.626045+0000","last_peered":"2024-09-05T07:29:31.626045+0000","last_clean":"2024-09-05T07:29:31.626045+0000","last_became_active":"2024-09-05T07:29:30.562776+0000","last_became_peered":"2024-09-05T07:29:30.562776+0000","last_unstale":"2024-09-05T07:29:31.626045+0000","last_undegraded":"2024-09-05T07:29:31.626045+0000","last_fullsized":"2024-09-05T07:29:31.626045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:37:16.174244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.625848+0000","last_change":"2024-09-05T07:29:30.558029+0000","last_active":"2024-09-05T07:29:31.625848+0000","last_peered":"2024-09-05T07:29:31.625848+0000","last_clean":"2024-09-05T07:29:31.625848+0000","last_became_active":"2024-09-05T07:29:30.557747+0000","last_became_peered":"2024-09-05T07:29:30.557747+0000","last_unstale":"2024-09-05T07:29:31.625848+0000","last_undegraded":"2024-09-05T07:29:31.625848+0000","last_fullsized":"2024-09-05T07:29:31.625848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:55:28.983976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.975672+0000","last_change":"2024-09-05T07:29:29.561333+0000","last_active":"2024-09-05T07:29:31.975672+0000","last_peered":"2024-09-05T07:29:31.975672+0000","last_clean":"2024-09-05T07:29:31.975672+0000","last_became_active":"2024-09-05T07:29:29.561065+0000","last_became_peered":"2024-09-05T07:29:29.561065+0000","last_unstale":"2024-09-05T07:29:31.975672+0000","last_undegraded":"2024-09-05T07:29:31.975672+0000","last_fullsized":"2024-09-05T07:29:31.975672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:38.961328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.907784+0000","last_change":"2024-09-05T07:29:30.566028+0000","last_active":"2024-09-05T07:29:31.907784+0000","last_peered":"2024-09-05T07:29:31.907784+0000","last_clean":"2024-09-05T07:29:31.907784+0000","last_became_active":"2024-09-05T07:29:30.565787+0000","last_became_peered":"2024-09-05T07:29:30.565787+0000","last_unstale":"2024-09-05T07:29:31.907784+0000","last_undegraded":"2024-09-05T07:29:31.907784+0000","last_fullsized":"2024-09-05T07:29:31.907784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:59.653492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'7","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:46.300464+0000","last_change":"2024-09-05T07:29:29.559969+0000","last_active":"2024-09-05T07:29:46.300464+0000","last_peered":"2024-09-05T07:29:46.300464+0000","last_clean":"2024-09-05T07:29:46.300464+0000","last_became_active":"2024-09-05T07:29:29.559675+0000","last_became_peered":"2024-09-05T07:29:29.559675+0000","last_unstale":"2024-09-05T07:29:46.300464+0000","last_undegraded":"2024-09-05T07:29:46.300464+0000","last_fullsized":"2024-09-05T07:29:46.300464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:53:39.010323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.631741+0000","last_change":"2024-09-05T07:29:30.657369+0000","last_active":"2024-09-05T07:29:31.631741+0000","last_peered":"2024-09-05T07:29:31.631741+0000","last_clean":"2024-09-05T07:29:31.631741+0000","last_became_active":"2024-09-05T07:29:30.656876+0000","last_became_peered":"2024-09-05T07:29:30.656876+0000","last_unstale":"2024-09-05T07:29:31.631741+0000","last_undegraded":"2024-09-05T07:29:31.631741+0000","last_fullsized":"2024-09-05T07:29:31.631741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:09:22.026287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:32.565312+0000","last_change":"2024-09-05T07:29:29.567440+0000","last_active":"2024-09-05T07:29:32.565312+0000","last_peered":"2024-09-05T07:29:32.565312+0000","last_clean":"2024-09-05T07:29:32.565312+0000","last_became_active":"2024-09-05T07:29:29.567129+0000","last_became_peered":"2024-09-05T07:29:29.567129+0000","last_unstale":"2024-09-05T07:29:32.565312+0000","last_undegraded":"2024-09-05T07:29:32.565312+0000","last_fullsized":"2024-09-05T07:29:32.565312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:54:00.339029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:31.632072+0000","last_change":"2024-09-05T07:29:30.657929+0000","last_active":"2024-09-05T07:29:31.632072+0000","last_peered":"2024-09-05T07:29:31.632072+0000","last_clean":"2024-09-05T07:29:31.632072+0000","last_became_active":"2024-09-05T07:29:30.657625+0000","last_became_peered":"2024-09-05T07:29:30.657625+0000","last_unstale":"2024-09-05T07:29:31.632072+0000","last_undegraded":"2024-09-05T07:29:31.632072+0000","last_fullsized":"2024-09-05T07:29:31.632072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:37:46.507371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'9","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T07:29:43.575475+0000","last_change":"2024-09-05T07:29:29.526099+0000","last_active":"2024-09-05T07:29:43.575475+0000","last_peered":"2024-09-05T07:29:43.575475+0000","last_clean":"2024-09-05T07:29:43.575475+0000","last_became_active":"2024-09-05T07:29:29.525832+0000","last_became_peered":"2024-09-05T07:29:29.525832+0000","last_unstale":"2024-09-05T07:29:43.575475+0000","last_undegraded":"2024-09-05T07:29:43.575475+0000","last_fullsized":"2024-09-05T07:29:43.575475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:44:32.741898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6040,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":204800,"data_stored":12578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719476749,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36160,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335680,"statfs":{"total":96636764160,"available":96599736320,"internally_reserved":0,"allocated":835584,"data_stored":667924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509452,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35592,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336248,"statfs":{"total":96636764160,"available":96600317952,"internally_reserved":0,"allocated":253952,"data_stored":77784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509452,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":249856,"data_stored":78672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509452,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":237568,"data_stored":78398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509451,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":823296,"data_stored":667280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":241664,"data_stored":78068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542156,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35572,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336268,"statfs":{"total":96636764160,"available":96600338432,"internally_reserved":0,"allocated":233472,"data_stored":77956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35604,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336236,"statfs":{"total":96636764160,"available":96600305664,"internally_reserved":0,"allocated":266240,"data_stored":79932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T07:29:48.411 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-05T07:29:48.411 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-05T07:29:48.411 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-05T07:29:48.411 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-05T07:29:48.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.545+0000 7fb4432d0640 1 Processor -- start 2024-09-05T07:29:48.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.545+0000 7fb4432d0640 1 -- start start 2024-09-05T07:29:48.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.546+0000 7fb4432d0640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb43c15a790 0x7fb43c0cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:48.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.546+0000 7fb4432d0640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb43c0c8020 con 0x7fb43c0c4060 2024-09-05T07:29:48.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.546+0000 7fb4432d0640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb43c15e7a0 con 0x7fb43c0cabe0 2024-09-05T07:29:48.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.546+0000 7fb4432d0640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fb43c0c3bd0 con 0x7fb43c15a790 2024-09-05T07:29:48.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.547+0000 7fb44186d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fb43c0c4060 0x7fb43c0c4470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:42238/0 (socket says 172.21.15.17:42238) 2024-09-05T07:29:48.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.547+0000 7fb44186d640 1 -- 172.21.15.17:0/3557897854 learned_addr learned my addr 172.21.15.17:0/3557897854 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:29:48.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.550+0000 7fb44086b640 1 --2- 172.21.15.17:0/3557897854 >> v2:172.21.15.26:3300/0 conn(0x7fb43c15a790 0x7fb43c0cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:48.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.551+0000 7fb43bfff640 1 -- 172.21.15.17:0/3557897854 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2253544706 0 0) 0x7fb43c0c8020 con 0x7fb43c0c4060 2024-09-05T07:29:48.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.551+0000 7fb43bfff640 1 -- 172.21.15.17:0/3557897854 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb424003520 con 0x7fb43c0c4060 2024-09-05T07:29:48.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.553+0000 7fb44086b640 1 -- 172.21.15.17:0/3557897854 >> v1:172.21.15.26:6789/0 conn(0x7fb43c0cabe0 legacy=0x7fb43c15dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:48.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.553+0000 7fb44086b640 1 -- 172.21.15.17:0/3557897854 >> v1:172.21.15.17:6789/0 conn(0x7fb43c0c4060 legacy=0x7fb43c0c4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:48.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.553+0000 7fb44086b640 1 -- 172.21.15.17:0/3557897854 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb43c15ea60 con 0x7fb43c15a790 2024-09-05T07:29:48.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.556+0000 7fb44086b640 1 --2- 172.21.15.17:0/3557897854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb43c15a790 0x7fb43c0cafc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb4300097a0 tx=0x7fb43002a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ab962887703a834 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:48.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.559+0000 7fb43bfff640 1 -- 172.21.15.17:0/3557897854 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb430037070 con 0x7fb43c15a790 2024-09-05T07:29:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.561+0000 7fb43bfff640 1 -- 172.21.15.17:0/3557897854 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb430032640 con 0x7fb43c15a790 2024-09-05T07:29:48.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.561+0000 7fb43bfff640 1 -- 172.21.15.17:0/3557897854 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4300329f0 con 0x7fb43c15a790 2024-09-05T07:29:48.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.562+0000 7fb4432d0640 1 -- 172.21.15.17:0/3557897854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb43c15a790 msgr2=0x7fb43c0cafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:48.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.562+0000 7fb4432d0640 1 --2- 172.21.15.17:0/3557897854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb43c15a790 0x7fb43c0cafc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb4300097a0 tx=0x7fb43002a2c0 comp rx=0 tx=0).stop 2024-09-05T07:29:48.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.562+0000 7fb4432d0640 1 -- 172.21.15.17:0/3557897854 shutdown_connections 2024-09-05T07:29:48.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.562+0000 7fb4432d0640 1 --2- 172.21.15.17:0/3557897854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb43c15a790 0x7fb43c0cafc0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:48.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.562+0000 7fb4432d0640 1 -- 172.21.15.17:0/3557897854 >> 172.21.15.17:0/3557897854 conn(0x7fb43c0715f0 msgr2=0x7fb43c0719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:48.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.562+0000 7fb4432d0640 1 -- 172.21.15.17:0/3557897854 shutdown_connections 2024-09-05T07:29:48.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.562+0000 7fb4432d0640 1 -- 172.21.15.17:0/3557897854 wait complete. 2024-09-05T07:29:48.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.563+0000 7fb4432d0640 1 Processor -- start 2024-09-05T07:29:48.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.563+0000 7fb4432d0640 1 -- start start 2024-09-05T07:29:48.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.564+0000 7fb4432d0640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb43c0c4060 0x7fb43c1519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:48.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.564+0000 7fb4432d0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb43c0cabe0 0x7fb43c15cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:48.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.564+0000 7fb4432d0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb43c15a790 0x7fb43c1e6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:48.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.564+0000 7fb4432d0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb43c15e490 con 0x7fb43c15a790 2024-09-05T07:29:48.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.564+0000 7fb4432d0640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb43c0c3860 con 0x7fb43c0cabe0 2024-09-05T07:29:48.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.564+0000 7fb4432d0640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fb43c154aa0 con 0x7fb43c0c4060 2024-09-05T07:29:48.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.564+0000 7fb44186d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb43c15a790 0x7fb43c1e6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:48.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.565+0000 7fb44086b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb43c0cabe0 0x7fb43c15cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:48.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.565+0000 7fb44106c640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb43c0c4060 0x7fb43c1519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:48.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.565+0000 7fb44186d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb43c15a790 0x7fb43c1e6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60884/0 (socket says 172.21.15.17:60884) 2024-09-05T07:29:48.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.565+0000 7fb44186d640 1 -- 172.21.15.17:0/2141102930 learned_addr learned my addr 172.21.15.17:0/2141102930 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:48.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.569+0000 7fb44186d640 1 -- 172.21.15.17:0/2141102930 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb43c0c4060 msgr2=0x7fb43c1519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:48.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.569+0000 7fb44186d640 1 --2- 172.21.15.17:0/2141102930 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb43c0c4060 0x7fb43c1519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:48.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.569+0000 7fb44186d640 1 -- 172.21.15.17:0/2141102930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb43c0cabe0 msgr2=0x7fb43c15cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:48.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.569+0000 7fb44186d640 1 --2- 172.21.15.17:0/2141102930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb43c0cabe0 0x7fb43c15cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:48.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.569+0000 7fb44186d640 1 -- 172.21.15.17:0/2141102930 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb43c15d870 con 0x7fb43c15a790 2024-09-05T07:29:48.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.571+0000 7fb44186d640 1 --2- 172.21.15.17:0/2141102930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb43c15a790 0x7fb43c1e6f80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb43400c460 tx=0x7fb43400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:48.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.575+0000 7fb439ffb640 1 -- 172.21.15.17:0/2141102930 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb434017070 con 0x7fb43c15a790 2024-09-05T07:29:48.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.575+0000 7fb439ffb640 1 -- 172.21.15.17:0/2141102930 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb434005ce0 con 0x7fb43c15a790 2024-09-05T07:29:48.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.575+0000 7fb4432d0640 1 -- 172.21.15.17:0/2141102930 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb43c151ef0 con 0x7fb43c15a790 2024-09-05T07:29:48.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.575+0000 7fb439ffb640 1 -- 172.21.15.17:0/2141102930 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4340072b0 con 0x7fb43c15a790 2024-09-05T07:29:48.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.575+0000 7fb4432d0640 1 -- 172.21.15.17:0/2141102930 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb43c152ba0 con 0x7fb43c15a790 2024-09-05T07:29:48.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.576+0000 7fb4432d0640 1 -- 172.21.15.17:0/2141102930 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb43c0cafc0 con 0x7fb43c15a790 2024-09-05T07:29:48.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.847+0000 7fb439ffb640 1 -- 172.21.15.17:0/2141102930 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb43401a070 con 0x7fb43c15a790 2024-09-05T07:29:48.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.848+0000 7fb439ffb640 1 --2- 172.21.15.17:0/2141102930 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fb42806be80 0x7fb42806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:48.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.848+0000 7fb44106c640 1 --2- 172.21.15.17:0/2141102930 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fb42806be80 0x7fb42806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:48.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.848+0000 7fb44106c640 1 --2- 172.21.15.17:0/2141102930 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fb42806be80 0x7fb42806e340 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb42c0012e0 tx=0x7fb42c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:48.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.862+0000 7fb439ffb640 1 -- 172.21.15.17:0/2141102930 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb4340569b0 con 0x7fb43c15a790 2024-09-05T07:29:48.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:48.863+0000 7fb439ffb640 1 -- 172.21.15.17:0/2141102930 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb434021020 con 0x7fb43c15a790 2024-09-05T07:29:49.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.075+0000 7fb4432d0640 1 -- 172.21.15.17:0/2141102930 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb43c06ef00 con 0x7fb43c15a790 2024-09-05T07:29:49.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.081+0000 7fb439ffb640 1 -- 172.21.15.17:0/2141102930 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fb43c15d870 con 0x7fb43c15a790 2024-09-05T07:29:49.082 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:29:49.082 INFO:teuthology.orchestra.run.smithi017.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-05T07:29:49.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.084+0000 7fb4432d0640 1 -- 172.21.15.17:0/2141102930 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fb42806be80 msgr2=0x7fb42806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:49.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.084+0000 7fb4432d0640 1 --2- 172.21.15.17:0/2141102930 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fb42806be80 0x7fb42806e340 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb42c0012e0 tx=0x7fb42c009040 comp rx=0 tx=0).stop 2024-09-05T07:29:49.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.084+0000 7fb4432d0640 1 -- 172.21.15.17:0/2141102930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb43c15a790 msgr2=0x7fb43c1e6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:49.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.084+0000 7fb4432d0640 1 --2- 172.21.15.17:0/2141102930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb43c15a790 0x7fb43c1e6f80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb43400c460 tx=0x7fb43400c920 comp rx=0 tx=0).stop 2024-09-05T07:29:49.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.084+0000 7fb4432d0640 1 -- 172.21.15.17:0/2141102930 shutdown_connections 2024-09-05T07:29:49.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.084+0000 7fb4432d0640 1 --2- 172.21.15.17:0/2141102930 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fb42806be80 0x7fb42806e340 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:49.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.084+0000 7fb4432d0640 1 --2- 172.21.15.17:0/2141102930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb43c15a790 0x7fb43c1e6f80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:49.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.084+0000 7fb4432d0640 1 --2- 172.21.15.17:0/2141102930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb43c0cabe0 0x7fb43c15cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:49.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.084+0000 7fb4432d0640 1 --2- 172.21.15.17:0/2141102930 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb43c0c4060 0x7fb43c1519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:49.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.084+0000 7fb4432d0640 1 -- 172.21.15.17:0/2141102930 >> 172.21.15.17:0/2141102930 conn(0x7fb43c0715f0 msgr2=0x7fb43c0719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:49.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.084+0000 7fb4432d0640 1 -- 172.21.15.17:0/2141102930 shutdown_connections 2024-09-05T07:29:49.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.084+0000 7fb4432d0640 1 -- 172.21.15.17:0/2141102930 wait complete. 2024-09-05T07:29:49.095 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-05T07:29:49.096 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-05T07:29:49.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.196+0000 7f1a13fc4640 1 Processor -- start 2024-09-05T07:29:49.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.197+0000 7f1a13fc4640 1 -- start start 2024-09-05T07:29:49.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.197+0000 7f1a13fc4640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1a0c1529a0 0x7f1a0c15bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:49.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.197+0000 7f1a13fc4640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1a0c0c4fd0 0x7f1a0c0c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:49.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.197+0000 7f1a13fc4640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a0c15cb90 con 0x7f1a0c1590e0 2024-09-05T07:29:49.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.197+0000 7f1a13fc4640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f1a0c158c50 con 0x7f1a0c0c4fd0 2024-09-05T07:29:49.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.197+0000 7f1a13fc4640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f1a0c15c2f0 con 0x7f1a0c1529a0 2024-09-05T07:29:49.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.198+0000 7f1a1155f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1a0c0c4fd0 0x7f1a0c0c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:49.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.198+0000 7f1a1155f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1a0c0c4fd0 0x7f1a0c0c8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56336/0 (socket says 172.21.15.17:56336) 2024-09-05T07:29:49.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.198+0000 7f1a1155f640 1 -- 172.21.15.17:0/4124221622 learned_addr learned my addr 172.21.15.17:0/4124221622 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:49.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.199+0000 7f1a11d60640 1 --2- 172.21.15.17:0/4124221622 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1a0c1529a0 0x7f1a0c15bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:49.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.201+0000 7f1a1155f640 1 -- 172.21.15.17:0/4124221622 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1a0c1529a0 msgr2=0x7f1a0c15bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:49.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.201+0000 7f1a1155f640 1 --2- 172.21.15.17:0/4124221622 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1a0c1529a0 0x7f1a0c15bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:49.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.201+0000 7f1a1155f640 1 -- 172.21.15.17:0/4124221622 >> v1:172.21.15.26:6789/0 conn(0x7f1a0c1590e0 legacy=0x7f1a0c0ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:49.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.201+0000 7f1a1155f640 1 -- 172.21.15.17:0/4124221622 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a0c15c5d0 con 0x7f1a0c0c4fd0 2024-09-05T07:29:49.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.203+0000 7f1a1155f640 1 --2- 172.21.15.17:0/4124221622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a0c0c4fd0 0x7f1a0c0c8ad0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f19fc009870 tx=0x7f19fc02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ffd5c4a65772f80 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:49.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.272+0000 7f1a10d5e640 1 -- 172.21.15.17:0/4124221622 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19fc037070 con 0x7f1a0c0c4fd0 2024-09-05T07:29:49.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.272+0000 7f1a10d5e640 1 -- 172.21.15.17:0/4124221622 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19fc02ae50 con 0x7f1a0c0c4fd0 2024-09-05T07:29:49.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.272+0000 7f1a10d5e640 1 -- 172.21.15.17:0/4124221622 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19fc032860 con 0x7f1a0c0c4fd0 2024-09-05T07:29:49.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.273+0000 7f1a13fc4640 1 -- 172.21.15.17:0/4124221622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a0c0c4fd0 msgr2=0x7f1a0c0c8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:49.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.273+0000 7f1a13fc4640 1 --2- 172.21.15.17:0/4124221622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a0c0c4fd0 0x7f1a0c0c8ad0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f19fc009870 tx=0x7f19fc02a300 comp rx=0 tx=0).stop 2024-09-05T07:29:49.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.273+0000 7f1a13fc4640 1 -- 172.21.15.17:0/4124221622 shutdown_connections 2024-09-05T07:29:49.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.273+0000 7f1a13fc4640 1 --2- 172.21.15.17:0/4124221622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a0c0c4fd0 0x7f1a0c0c8ad0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:49.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.273+0000 7f1a13fc4640 1 --2- 172.21.15.17:0/4124221622 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1a0c1529a0 0x7f1a0c15bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:49.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.273+0000 7f1a13fc4640 1 -- 172.21.15.17:0/4124221622 >> 172.21.15.17:0/4124221622 conn(0x7f1a0c067950 msgr2=0x7f1a0c067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:49.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.273+0000 7f1a13fc4640 1 -- 172.21.15.17:0/4124221622 shutdown_connections 2024-09-05T07:29:49.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.273+0000 7f1a13fc4640 1 -- 172.21.15.17:0/4124221622 wait complete. 2024-09-05T07:29:49.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.274+0000 7f1a13fc4640 1 Processor -- start 2024-09-05T07:29:49.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.274+0000 7f1a13fc4640 1 -- start start 2024-09-05T07:29:49.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.275+0000 7f1a13fc4640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1a0c0c4fd0 0x7f1a0c153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:49.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.275+0000 7f1a13fc4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a0c1529a0 0x7f1a0c0cbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:49.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.275+0000 7f1a13fc4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a0c1590e0 0x7f1a0c14b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:49.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.275+0000 7f1a13fc4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0c159590 con 0x7f1a0c1529a0 2024-09-05T07:29:49.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.275+0000 7f1a13fc4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0c1588e0 con 0x7f1a0c1590e0 2024-09-05T07:29:49.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.275+0000 7f1a13fc4640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f1a0c1eeea0 con 0x7f1a0c0c4fd0 2024-09-05T07:29:49.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.276+0000 7f1a12561640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a0c1590e0 0x7f1a0c14b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:49.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.276+0000 7f1a11d60640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1a0c0c4fd0 0x7f1a0c153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:49.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.276+0000 7f1a12561640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a0c1590e0 0x7f1a0c14b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:58408/0 (socket says 172.21.15.17:58408) 2024-09-05T07:29:49.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.276+0000 7f1a12561640 1 -- 172.21.15.17:0/490091354 learned_addr learned my addr 172.21.15.17:0/490091354 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:49.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.279+0000 7f1a1155f640 1 --2- 172.21.15.17:0/490091354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a0c1529a0 0x7f1a0c0cbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:49.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.279+0000 7f1a12561640 1 -- 172.21.15.17:0/490091354 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1a0c0c4fd0 msgr2=0x7f1a0c153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:49.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.279+0000 7f1a12561640 1 --2- 172.21.15.17:0/490091354 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1a0c0c4fd0 0x7f1a0c153320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:49.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.279+0000 7f1a12561640 1 -- 172.21.15.17:0/490091354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a0c1529a0 msgr2=0x7f1a0c0cbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:49.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.279+0000 7f1a12561640 1 --2- 172.21.15.17:0/490091354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a0c1529a0 0x7f1a0c0cbed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:49.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.279+0000 7f1a12561640 1 -- 172.21.15.17:0/490091354 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a0c0cd380 con 0x7f1a0c1590e0 2024-09-05T07:29:49.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.282+0000 7f1a12561640 1 --2- 172.21.15.17:0/490091354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a0c1590e0 0x7f1a0c14b750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1a0400c6b0 tx=0x7f1a0400cb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:49.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.286+0000 7f1a027fc640 1 -- 172.21.15.17:0/490091354 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a04003b70 con 0x7f1a0c1590e0 2024-09-05T07:29:49.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.286+0000 7f1a027fc640 1 -- 172.21.15.17:0/490091354 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a04003d30 con 0x7f1a0c1590e0 2024-09-05T07:29:49.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.286+0000 7f1a13fc4640 1 -- 172.21.15.17:0/490091354 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a0c1ee0e0 con 0x7f1a0c1590e0 2024-09-05T07:29:49.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.286+0000 7f1a027fc640 1 -- 172.21.15.17:0/490091354 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a04005310 con 0x7f1a0c1590e0 2024-09-05T07:29:49.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.286+0000 7f1a13fc4640 1 -- 172.21.15.17:0/490091354 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a0c1ee6a0 con 0x7f1a0c1590e0 2024-09-05T07:29:49.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.287+0000 7f1a13fc4640 1 -- 172.21.15.17:0/490091354 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a0c152d80 con 0x7f1a0c1590e0 2024-09-05T07:29:49.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.308+0000 7f1a027fc640 1 -- 172.21.15.17:0/490091354 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1a040054b0 con 0x7f1a0c1590e0 2024-09-05T07:29:49.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.309+0000 7f1a027fc640 1 --2- 172.21.15.17:0/490091354 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f19f006be80 0x7f19f006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:49.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.309+0000 7f1a11d60640 1 --2- 172.21.15.17:0/490091354 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f19f006be80 0x7f19f006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:49.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.310+0000 7f1a11d60640 1 --2- 172.21.15.17:0/490091354 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f19f006be80 0x7f19f006e340 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1a08009b40 tx=0x7f1a08009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:49.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.313+0000 7f1a027fc640 1 -- 172.21.15.17:0/490091354 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1a040057a0 con 0x7f1a0c1590e0 2024-09-05T07:29:49.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.636+0000 7f1a027fc640 1 -- 172.21.15.17:0/490091354 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1a0405a090 con 0x7f1a0c1590e0 2024-09-05T07:29:49.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.849+0000 7f1a13fc4640 1 -- 172.21.15.17:0/490091354 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1a0c0c5f80 con 0x7f1a0c1590e0 2024-09-05T07:29:49.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.872+0000 7f1a027fc640 1 -- 172.21.15.17:0/490091354 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6938 (secure 0 0 0) 0x7f1a04059990 con 0x7f1a0c1590e0 2024-09-05T07:29:49.872 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:29:49.873 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":18,"btime":"2024-09-05T07:29:49:192665+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4221,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/1677649004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1677649004},{"type":"v1","addr":"172.21.15.17:6833","nonce":1677649004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-05T07:29:30.282161+0000","modified":"2024-09-05T07:29:49.192601+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4261,"mds_1":4258,"mds_2":4241,"mds_3":4233,"mds_4":4230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4230":{"gid":4230,"name":"d","rank":4,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.26:6837/840343339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":840343339},{"type":"v1","addr":"172.21.15.26:6837","nonce":840343339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4233":{"gid":4233,"name":"b","rank":3,"incarnation":15,"state":"up:active","state_seq":7,"addr":"172.21.15.26:6839/914231229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":914231229},{"type":"v1","addr":"172.21.15.26:6839","nonce":914231229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4241":{"gid":4241,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":6,"addr":"172.21.15.17:6837/4100397916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":4100397916},{"type":"v1","addr":"172.21.15.17:6837","nonce":4100397916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4258":{"gid":4258,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.17:6835/2818017162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2818017162},{"type":"v1","addr":"172.21.15.17:6835","nonce":2818017162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4261":{"gid":4261,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/656329439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":656329439},{"type":"v1","addr":"172.21.15.26:6835","nonce":656329439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4261,"qdb_cluster":[4230,4233,4241,4258,4261]},"id":1}]} 2024-09-05T07:29:49.873 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 18 2024-09-05T07:29:49.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.874+0000 7f1a13fc4640 1 -- 172.21.15.17:0/490091354 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f19f006be80 msgr2=0x7f19f006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:49.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.874+0000 7f1a13fc4640 1 --2- 172.21.15.17:0/490091354 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f19f006be80 0x7f19f006e340 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1a08009b40 tx=0x7f1a08009190 comp rx=0 tx=0).stop 2024-09-05T07:29:49.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.874+0000 7f1a13fc4640 1 -- 172.21.15.17:0/490091354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a0c1590e0 msgr2=0x7f1a0c14b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:49.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.874+0000 7f1a13fc4640 1 --2- 172.21.15.17:0/490091354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a0c1590e0 0x7f1a0c14b750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1a0400c6b0 tx=0x7f1a0400cb70 comp rx=0 tx=0).stop 2024-09-05T07:29:49.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.874+0000 7f1a13fc4640 1 -- 172.21.15.17:0/490091354 shutdown_connections 2024-09-05T07:29:49.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.874+0000 7f1a13fc4640 1 --2- 172.21.15.17:0/490091354 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f19f006be80 0x7f19f006e340 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:49.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.874+0000 7f1a13fc4640 1 --2- 172.21.15.17:0/490091354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a0c1590e0 0x7f1a0c14b750 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:49.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.874+0000 7f1a13fc4640 1 --2- 172.21.15.17:0/490091354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a0c1529a0 0x7f1a0c0cbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:49.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.874+0000 7f1a13fc4640 1 --2- 172.21.15.17:0/490091354 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1a0c0c4fd0 0x7f1a0c153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:49.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.874+0000 7f1a13fc4640 1 -- 172.21.15.17:0/490091354 >> 172.21.15.17:0/490091354 conn(0x7f1a0c067950 msgr2=0x7f1a0c06e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:49.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.874+0000 7f1a13fc4640 1 -- 172.21.15.17:0/490091354 shutdown_connections 2024-09-05T07:29:49.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.874+0000 7f1a13fc4640 1 -- 172.21.15.17:0/490091354 wait complete. 2024-09-05T07:29:49.885 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-05T07:29:49.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.985+0000 7f15db4af640 1 Processor -- start 2024-09-05T07:29:49.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.985+0000 7f15db4af640 1 -- start start 2024-09-05T07:29:49.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.986+0000 7f15db4af640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f15d40cae80 0x7f15d415b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:49.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.986+0000 7f15db4af640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f15d40cb260 0x7f15d40c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:49.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.986+0000 7f15db4af640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15d40c4100 con 0x7f15d40c9620 2024-09-05T07:29:49.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.986+0000 7f15db4af640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f15d415b950 con 0x7f15d40cb260 2024-09-05T07:29:49.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.986+0000 7f15db4af640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f15d40c4370 con 0x7f15d40cae80 2024-09-05T07:29:49.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.986+0000 7f15d8a4a640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f15d40cb260 0x7f15d40c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:49.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.986+0000 7f15d924b640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f15d40cae80 0x7f15d415b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:49.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.987+0000 7f15d924b640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f15d40cae80 0x7f15d415b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:49340/0 (socket says 172.21.15.17:49340) 2024-09-05T07:29:49.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.987+0000 7f15d924b640 1 -- 172.21.15.17:0/315313065 learned_addr learned my addr 172.21.15.17:0/315313065 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:49.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.989+0000 7f15d924b640 1 -- 172.21.15.17:0/315313065 >> v2:172.21.15.17:3300/0 conn(0x7f15d40cb260 msgr2=0x7f15d40c3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:49.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.989+0000 7f15d924b640 1 --2- 172.21.15.17:0/315313065 >> v2:172.21.15.17:3300/0 conn(0x7f15d40cb260 0x7f15d40c3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:49.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.989+0000 7f15d924b640 1 -- 172.21.15.17:0/315313065 >> v1:172.21.15.17:6789/0 conn(0x7f15d40c9620 legacy=0x7f15d40c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:49.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.989+0000 7f15d924b640 1 -- 172.21.15.17:0/315313065 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d40c4610 con 0x7f15d40cae80 2024-09-05T07:29:49.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.991+0000 7f15d924b640 1 --2- 172.21.15.17:0/315313065 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f15d40cae80 0x7f15d415b410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f15d0009870 tx=0x7f15d002a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d437bade5cbf49fd server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:49.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.994+0000 7f15cbfff640 1 -- 172.21.15.17:0/315313065 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d0037070 con 0x7f15d40cae80 2024-09-05T07:29:49.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.994+0000 7f15cbfff640 1 -- 172.21.15.17:0/315313065 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15d002ae50 con 0x7f15d40cae80 2024-09-05T07:29:49.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.994+0000 7f15cbfff640 1 -- 172.21.15.17:0/315313065 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d0032860 con 0x7f15d40cae80 2024-09-05T07:29:49.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.995+0000 7f15db4af640 1 -- 172.21.15.17:0/315313065 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f15d40cae80 msgr2=0x7f15d415b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:49.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.995+0000 7f15db4af640 1 --2- 172.21.15.17:0/315313065 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f15d40cae80 0x7f15d415b410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f15d0009870 tx=0x7f15d002a300 comp rx=0 tx=0).stop 2024-09-05T07:29:49.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.995+0000 7f15db4af640 1 -- 172.21.15.17:0/315313065 shutdown_connections 2024-09-05T07:29:49.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.995+0000 7f15db4af640 1 --2- 172.21.15.17:0/315313065 >> v2:172.21.15.17:3300/0 conn(0x7f15d40cb260 0x7f15d40c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:49.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.995+0000 7f15db4af640 1 --2- 172.21.15.17:0/315313065 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f15d40cae80 0x7f15d415b410 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:49.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.995+0000 7f15db4af640 1 -- 172.21.15.17:0/315313065 >> 172.21.15.17:0/315313065 conn(0x7f15d40715f0 msgr2=0x7f15d40719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:49.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.995+0000 7f15db4af640 1 -- 172.21.15.17:0/315313065 shutdown_connections 2024-09-05T07:29:49.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.995+0000 7f15db4af640 1 -- 172.21.15.17:0/315313065 wait complete. 2024-09-05T07:29:49.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.996+0000 7f15db4af640 1 Processor -- start 2024-09-05T07:29:49.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.996+0000 7f15db4af640 1 -- start start 2024-09-05T07:29:49.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.997+0000 7f15db4af640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15d40c9620 0x7f15d414c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:49.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.997+0000 7f15db4af640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f15d40cae80 0x7f15d4149530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:49.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.997+0000 7f15db4af640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15d40cb260 0x7f15d414e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:49.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.997+0000 7f15db4af640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f15d40c8e20 con 0x7f15d40cb260 2024-09-05T07:29:49.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.997+0000 7f15db4af640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f15d40c4bd0 con 0x7f15d40c9620 2024-09-05T07:29:49.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.997+0000 7f15db4af640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f15d40c9100 con 0x7f15d40cae80 2024-09-05T07:29:49.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.997+0000 7f15d8a4a640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f15d40cae80 0x7f15d4149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:49.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.997+0000 7f15d9a4c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15d40cb260 0x7f15d414e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:49.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.998+0000 7f15d924b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15d40c9620 0x7f15d414c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:49.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.998+0000 7f15d8a4a640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f15d40cae80 0x7f15d4149530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:49342/0 (socket says 172.21.15.17:49342) 2024-09-05T07:29:49.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.998+0000 7f15d9a4c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15d40cb260 0x7f15d414e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56354/0 (socket says 172.21.15.17:56354) 2024-09-05T07:29:49.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:49.998+0000 7f15d8a4a640 1 -- 172.21.15.17:0/3209369809 learned_addr learned my addr 172.21.15.17:0/3209369809 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:50.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.001+0000 7f15d9a4c640 1 -- 172.21.15.17:0/3209369809 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f15d40cae80 msgr2=0x7f15d4149530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:50.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.001+0000 7f15d9a4c640 1 --2- 172.21.15.17:0/3209369809 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f15d40cae80 0x7f15d4149530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:50.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.001+0000 7f15d9a4c640 1 -- 172.21.15.17:0/3209369809 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15d40c9620 msgr2=0x7f15d414c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:50.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.001+0000 7f15d9a4c640 1 --2- 172.21.15.17:0/3209369809 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15d40c9620 0x7f15d414c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:50.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.001+0000 7f15d9a4c640 1 -- 172.21.15.17:0/3209369809 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d4149d90 con 0x7f15d40cb260 2024-09-05T07:29:50.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.003+0000 7f15d9a4c640 1 --2- 172.21.15.17:0/3209369809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15d40cb260 0x7f15d414e170 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f15cc00c700 tx=0x7f15cc00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:50.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.007+0000 7f15c9ffb640 1 -- 172.21.15.17:0/3209369809 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15cc003b70 con 0x7f15d40cb260 2024-09-05T07:29:50.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.007+0000 7f15c9ffb640 1 -- 172.21.15.17:0/3209369809 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15cc003d10 con 0x7f15d40cb260 2024-09-05T07:29:50.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.007+0000 7f15c9ffb640 1 -- 172.21.15.17:0/3209369809 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15cc005310 con 0x7f15d40cb260 2024-09-05T07:29:50.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.007+0000 7f15db4af640 1 -- 172.21.15.17:0/3209369809 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15d41544e0 con 0x7f15d40cb260 2024-09-05T07:29:50.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.007+0000 7f15db4af640 1 -- 172.21.15.17:0/3209369809 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15d41f3bb0 con 0x7f15d40cb260 2024-09-05T07:29:50.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.008+0000 7f15db4af640 1 -- 172.21.15.17:0/3209369809 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15d40c3900 con 0x7f15d40cb260 2024-09-05T07:29:50.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.280+0000 7f15c9ffb640 1 -- 172.21.15.17:0/3209369809 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f15cc0054b0 con 0x7f15d40cb260 2024-09-05T07:29:50.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.281+0000 7f15c9ffb640 1 --2- 172.21.15.17:0/3209369809 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f15b806be80 0x7f15b806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:50.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.281+0000 7f15d924b640 1 --2- 172.21.15.17:0/3209369809 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f15b806be80 0x7f15b806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:50.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.282+0000 7f15d924b640 1 --2- 172.21.15.17:0/3209369809 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f15b806be80 0x7f15b806e340 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f15d0034000 tx=0x7f15d002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:50.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.295+0000 7f15c9ffb640 1 -- 172.21.15.17:0/3209369809 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f15cc0057a0 con 0x7f15d40cb260 2024-09-05T07:29:50.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.295+0000 7f15c9ffb640 1 -- 172.21.15.17:0/3209369809 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f15d4149d90 con 0x7f15d40cb260 2024-09-05T07:29:50.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.515+0000 7f15db4af640 1 -- 172.21.15.17:0/3209369809 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15d40c34b0 con 0x7f15d40cb260 2024-09-05T07:29:50.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.546+0000 7f15c9ffb640 1 -- 172.21.15.17:0/3209369809 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6938 (secure 0 0 0) 0x7f15cc0598d0 con 0x7f15d40cb260 2024-09-05T07:29:50.547 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:29:50.547 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":18,"btime":"2024-09-05T07:29:49:192665+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4221,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/1677649004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1677649004},{"type":"v1","addr":"172.21.15.17:6833","nonce":1677649004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-05T07:29:30.282161+0000","modified":"2024-09-05T07:29:49.192601+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4261,"mds_1":4258,"mds_2":4241,"mds_3":4233,"mds_4":4230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4230":{"gid":4230,"name":"d","rank":4,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.26:6837/840343339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":840343339},{"type":"v1","addr":"172.21.15.26:6837","nonce":840343339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4233":{"gid":4233,"name":"b","rank":3,"incarnation":15,"state":"up:active","state_seq":7,"addr":"172.21.15.26:6839/914231229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":914231229},{"type":"v1","addr":"172.21.15.26:6839","nonce":914231229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4241":{"gid":4241,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":6,"addr":"172.21.15.17:6837/4100397916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":4100397916},{"type":"v1","addr":"172.21.15.17:6837","nonce":4100397916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4258":{"gid":4258,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.17:6835/2818017162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2818017162},{"type":"v1","addr":"172.21.15.17:6835","nonce":2818017162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4261":{"gid":4261,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/656329439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":656329439},{"type":"v1","addr":"172.21.15.26:6835","nonce":656329439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4261,"qdb_cluster":[4230,4233,4241,4258,4261]},"id":1}]} 2024-09-05T07:29:50.548 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 18 2024-09-05T07:29:50.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.548+0000 7f15db4af640 1 -- 172.21.15.17:0/3209369809 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f15b806be80 msgr2=0x7f15b806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:50.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.548+0000 7f15db4af640 1 --2- 172.21.15.17:0/3209369809 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f15b806be80 0x7f15b806e340 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f15d0034000 tx=0x7f15d002e000 comp rx=0 tx=0).stop 2024-09-05T07:29:50.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.548+0000 7f15db4af640 1 -- 172.21.15.17:0/3209369809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15d40cb260 msgr2=0x7f15d414e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:50.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.548+0000 7f15db4af640 1 --2- 172.21.15.17:0/3209369809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15d40cb260 0x7f15d414e170 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f15cc00c700 tx=0x7f15cc00cbc0 comp rx=0 tx=0).stop 2024-09-05T07:29:50.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.548+0000 7f15db4af640 1 -- 172.21.15.17:0/3209369809 shutdown_connections 2024-09-05T07:29:50.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.548+0000 7f15db4af640 1 --2- 172.21.15.17:0/3209369809 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f15b806be80 0x7f15b806e340 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:50.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.548+0000 7f15db4af640 1 --2- 172.21.15.17:0/3209369809 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f15d40cae80 0x7f15d4149530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:50.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.548+0000 7f15db4af640 1 --2- 172.21.15.17:0/3209369809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15d40cb260 0x7f15d414e170 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:50.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.548+0000 7f15db4af640 1 --2- 172.21.15.17:0/3209369809 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15d40c9620 0x7f15d414c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:50.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.548+0000 7f15db4af640 1 -- 172.21.15.17:0/3209369809 >> 172.21.15.17:0/3209369809 conn(0x7f15d40715f0 msgr2=0x7f15d415a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:50.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.548+0000 7f15db4af640 1 -- 172.21.15.17:0/3209369809 shutdown_connections 2024-09-05T07:29:50.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.548+0000 7f15db4af640 1 -- 172.21.15.17:0/3209369809 wait complete. 2024-09-05T07:29:50.561 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-05T07:29:50.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.661+0000 7f9bdaa65640 1 Processor -- start 2024-09-05T07:29:50.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.661+0000 7f9bdaa65640 1 -- start start 2024-09-05T07:29:50.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.662+0000 7f9bdaa65640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9bd4154770 0x7f9bd415b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:50.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.662+0000 7f9bdaa65640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9bd40cafa0 0x7f9bd40d05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:50.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.662+0000 7f9bdaa65640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bd406c8c0 con 0x7f9bd40d0b00 2024-09-05T07:29:50.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.662+0000 7f9bdaa65640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd40c5310 con 0x7f9bd40cafa0 2024-09-05T07:29:50.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.662+0000 7f9bdaa65640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd40cb950 con 0x7f9bd4154770 2024-09-05T07:29:50.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.662+0000 7f9bcbfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9bd40cafa0 0x7f9bd40d05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:50.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.663+0000 7f9bd8801640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9bd4154770 0x7f9bd415b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:50.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.663+0000 7f9bcbfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9bd40cafa0 0x7f9bd40d05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56358/0 (socket says 172.21.15.17:56358) 2024-09-05T07:29:50.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.663+0000 7f9bcbfff640 1 -- 172.21.15.17:0/4127566864 learned_addr learned my addr 172.21.15.17:0/4127566864 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:50.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.665+0000 7f9bcbfff640 1 -- 172.21.15.17:0/4127566864 >> v2:172.21.15.26:3300/0 conn(0x7f9bd4154770 msgr2=0x7f9bd415b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:50.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.665+0000 7f9bcbfff640 1 --2- 172.21.15.17:0/4127566864 >> v2:172.21.15.26:3300/0 conn(0x7f9bd4154770 0x7f9bd415b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:50.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.665+0000 7f9bcbfff640 1 -- 172.21.15.17:0/4127566864 >> v1:172.21.15.17:6789/0 conn(0x7f9bd40d0b00 legacy=0x7f9bd40c5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:50.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.665+0000 7f9bcbfff640 1 -- 172.21.15.17:0/4127566864 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd406cb60 con 0x7f9bd40cafa0 2024-09-05T07:29:50.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.667+0000 7f9bcbfff640 1 --2- 172.21.15.17:0/4127566864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bd40cafa0 0x7f9bd40d05c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9bd40c5490 tx=0x7f9bc402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=588a2057467b8136 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:50.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.671+0000 7f9bcb7fe640 1 -- 172.21.15.17:0/4127566864 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc4037070 con 0x7f9bd40cafa0 2024-09-05T07:29:50.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.671+0000 7f9bcb7fe640 1 -- 172.21.15.17:0/4127566864 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bc4032440 con 0x7f9bd40cafa0 2024-09-05T07:29:50.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.671+0000 7f9bcb7fe640 1 -- 172.21.15.17:0/4127566864 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc4032810 con 0x7f9bd40cafa0 2024-09-05T07:29:50.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.672+0000 7f9bdaa65640 1 -- 172.21.15.17:0/4127566864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bd40cafa0 msgr2=0x7f9bd40d05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:50.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.672+0000 7f9bdaa65640 1 --2- 172.21.15.17:0/4127566864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bd40cafa0 0x7f9bd40d05c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9bd40c5490 tx=0x7f9bc402a180 comp rx=0 tx=0).stop 2024-09-05T07:29:50.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.672+0000 7f9bdaa65640 1 -- 172.21.15.17:0/4127566864 shutdown_connections 2024-09-05T07:29:50.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.672+0000 7f9bdaa65640 1 --2- 172.21.15.17:0/4127566864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bd40cafa0 0x7f9bd40d05c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:50.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.672+0000 7f9bdaa65640 1 --2- 172.21.15.17:0/4127566864 >> v2:172.21.15.26:3300/0 conn(0x7f9bd4154770 0x7f9bd415b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:50.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.672+0000 7f9bdaa65640 1 -- 172.21.15.17:0/4127566864 >> 172.21.15.17:0/4127566864 conn(0x7f9bd4073710 msgr2=0x7f9bd4073b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:50.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.672+0000 7f9bdaa65640 1 -- 172.21.15.17:0/4127566864 shutdown_connections 2024-09-05T07:29:50.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.672+0000 7f9bdaa65640 1 -- 172.21.15.17:0/4127566864 wait complete. 2024-09-05T07:29:50.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.673+0000 7f9bdaa65640 1 Processor -- start 2024-09-05T07:29:50.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.673+0000 7f9bdaa65640 1 -- start start 2024-09-05T07:29:50.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.674+0000 7f9bdaa65640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd40cafa0 0x7f9bd40c7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:50.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.674+0000 7f9bdaa65640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9bd40d0b00 0x7f9bd40b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:50.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.674+0000 7f9bdaa65640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bd4154770 0x7f9bd4156c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:50.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.674+0000 7f9bdaa65640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd4154b50 con 0x7f9bd4154770 2024-09-05T07:29:50.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.674+0000 7f9bdaa65640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd40cbc30 con 0x7f9bd40cafa0 2024-09-05T07:29:50.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.674+0000 7f9bdaa65640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd406bca0 con 0x7f9bd40d0b00 2024-09-05T07:29:50.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.675+0000 7f9bd9002640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bd4154770 0x7f9bd4156c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:50.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.675+0000 7f9bd9002640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bd4154770 0x7f9bd4156c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56368/0 (socket says 172.21.15.17:56368) 2024-09-05T07:29:50.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.675+0000 7f9bd9002640 1 -- 172.21.15.17:0/186828995 learned_addr learned my addr 172.21.15.17:0/186828995 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:50.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.675+0000 7f9bd8801640 1 --2- 172.21.15.17:0/186828995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd40cafa0 0x7f9bd40c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:50.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.675+0000 7f9bcbfff640 1 --2- 172.21.15.17:0/186828995 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9bd40d0b00 0x7f9bd40b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:50.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.679+0000 7f9bd9002640 1 -- 172.21.15.17:0/186828995 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9bd40d0b00 msgr2=0x7f9bd40b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:50.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.679+0000 7f9bd9002640 1 --2- 172.21.15.17:0/186828995 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9bd40d0b00 0x7f9bd40b4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:50.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.679+0000 7f9bd9002640 1 -- 172.21.15.17:0/186828995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd40cafa0 msgr2=0x7f9bd40c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:50.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.679+0000 7f9bd9002640 1 --2- 172.21.15.17:0/186828995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd40cafa0 0x7f9bd40c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:50.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.679+0000 7f9bd9002640 1 -- 172.21.15.17:0/186828995 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd40cf420 con 0x7f9bd4154770 2024-09-05T07:29:50.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.681+0000 7f9bd9002640 1 --2- 172.21.15.17:0/186828995 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bd4154770 0x7f9bd4156c70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc00c390 tx=0x7f9bcc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:50.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.684+0000 7f9bc97fa640 1 -- 172.21.15.17:0/186828995 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc017070 con 0x7f9bd4154770 2024-09-05T07:29:50.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.684+0000 7f9bc97fa640 1 -- 172.21.15.17:0/186828995 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bcc0035f0 con 0x7f9bd4154770 2024-09-05T07:29:50.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.684+0000 7f9bdaa65640 1 -- 172.21.15.17:0/186828995 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bd40cf700 con 0x7f9bd4154770 2024-09-05T07:29:50.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.684+0000 7f9bc97fa640 1 -- 172.21.15.17:0/186828995 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc003a20 con 0x7f9bd4154770 2024-09-05T07:29:50.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.685+0000 7f9bdaa65640 1 -- 172.21.15.17:0/186828995 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bd40cc4f0 con 0x7f9bd4154770 2024-09-05T07:29:50.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.685+0000 7f9bdaa65640 1 -- 172.21.15.17:0/186828995 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bd40cfc20 con 0x7f9bd4154770 2024-09-05T07:29:50.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.961+0000 7f9bc97fa640 1 -- 172.21.15.17:0/186828995 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9bcc01a070 con 0x7f9bd4154770 2024-09-05T07:29:50.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.961+0000 7f9bc97fa640 1 --2- 172.21.15.17:0/186828995 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f9bc006be80 0x7f9bc006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:50.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.962+0000 7f9bd8801640 1 --2- 172.21.15.17:0/186828995 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f9bc006be80 0x7f9bc006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:50.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.962+0000 7f9bd8801640 1 --2- 172.21.15.17:0/186828995 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f9bc006be80 0x7f9bc006e340 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0011340 tx=0x7f9bd000b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:50.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.976+0000 7f9bc97fa640 1 -- 172.21.15.17:0/186828995 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f9bcc056a10 con 0x7f9bd4154770 2024-09-05T07:29:50.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:50.976+0000 7f9bc97fa640 1 -- 172.21.15.17:0/186828995 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9bcc021020 con 0x7f9bd4154770 2024-09-05T07:29:51.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.154+0000 7f9bdaa65640 1 -- 172.21.15.17:0/186828995 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9bd40d05c0 con 0x7f9bd4154770 2024-09-05T07:29:51.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.194+0000 7f9bc97fa640 1 -- 172.21.15.17:0/186828995 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16621 (secure 0 0 0) 0x7f9bcc058970 con 0x7f9bd4154770 2024-09-05T07:29:51.195 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:29:51.195 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":22,"fsid":"848dac54-74f8-48f3-8686-c6495dcb972b","created":"2024-09-05T07:28:54.070215+0000","modified":"2024-09-05T07:29:31.467668+0000","last_up_change":"2024-09-05T07:29:11.992790+0000","last_in_change":"2024-09-05T07:29:00.001829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T07:29:10.227047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T07:29:27.905154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T07:29:29.039672+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f01a8b4-dc10-4cdf-a65e-b7f96de4e2b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2731314060},{"type":"v1","addr":"172.21.15.17:6825","nonce":2731314060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2731314060},{"type":"v1","addr":"172.21.15.17:6827","nonce":2731314060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2731314060},{"type":"v1","addr":"172.21.15.17:6831","nonce":2731314060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2731314060},{"type":"v1","addr":"172.21.15.17:6829","nonce":2731314060}]},"public_addr":"172.21.15.17:6825/2731314060","cluster_addr":"172.21.15.17:6827/2731314060","heartbeat_back_addr":"172.21.15.17:6831/2731314060","heartbeat_front_addr":"172.21.15.17:6829/2731314060","state":["exists","up"]},{"osd":1,"uuid":"d16867fb-2290-486c-9ac8-327ca54326d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3327408852},{"type":"v1","addr":"172.21.15.17:6817","nonce":3327408852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3327408852},{"type":"v1","addr":"172.21.15.17:6819","nonce":3327408852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3327408852},{"type":"v1","addr":"172.21.15.17:6823","nonce":3327408852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3327408852},{"type":"v1","addr":"172.21.15.17:6821","nonce":3327408852}]},"public_addr":"172.21.15.17:6817/3327408852","cluster_addr":"172.21.15.17:6819/3327408852","heartbeat_back_addr":"172.21.15.17:6823/3327408852","heartbeat_front_addr":"172.21.15.17:6821/3327408852","state":["exists","up"]},{"osd":2,"uuid":"632ad558-bd14-4240-a8f1-5beda951b3b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":363420609},{"type":"v1","addr":"172.21.15.17:6809","nonce":363420609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":363420609},{"type":"v1","addr":"172.21.15.17:6811","nonce":363420609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":363420609},{"type":"v1","addr":"172.21.15.17:6815","nonce":363420609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":363420609},{"type":"v1","addr":"172.21.15.17:6813","nonce":363420609}]},"public_addr":"172.21.15.17:6809/363420609","cluster_addr":"172.21.15.17:6811/363420609","heartbeat_back_addr":"172.21.15.17:6815/363420609","heartbeat_front_addr":"172.21.15.17:6813/363420609","state":["exists","up"]},{"osd":3,"uuid":"9727a970-8f98-45b9-8eca-62da1f28ff17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":3512342499},{"type":"v1","addr":"172.21.15.17:6801","nonce":3512342499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":3512342499},{"type":"v1","addr":"172.21.15.17:6803","nonce":3512342499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":3512342499},{"type":"v1","addr":"172.21.15.17:6807","nonce":3512342499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":3512342499},{"type":"v1","addr":"172.21.15.17:6805","nonce":3512342499}]},"public_addr":"172.21.15.17:6801/3512342499","cluster_addr":"172.21.15.17:6803/3512342499","heartbeat_back_addr":"172.21.15.17:6807/3512342499","heartbeat_front_addr":"172.21.15.17:6805/3512342499","state":["exists","up"]},{"osd":4,"uuid":"0e0141e0-51f1-4229-861f-1992afe70c96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6803","nonce":3740556509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6805","nonce":3740556509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6809","nonce":3740556509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6807","nonce":3740556509}]},"public_addr":"172.21.15.26:6803/3740556509","cluster_addr":"172.21.15.26:6805/3740556509","heartbeat_back_addr":"172.21.15.26:6809/3740556509","heartbeat_front_addr":"172.21.15.26:6807/3740556509","state":["exists","up"]},{"osd":5,"uuid":"5603d79b-fcf8-45aa-a1db-96918af450be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3020770750},{"type":"v1","addr":"172.21.15.26:6819","nonce":3020770750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3020770750},{"type":"v1","addr":"172.21.15.26:6821","nonce":3020770750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3020770750},{"type":"v1","addr":"172.21.15.26:6825","nonce":3020770750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3020770750},{"type":"v1","addr":"172.21.15.26:6823","nonce":3020770750}]},"public_addr":"172.21.15.26:6819/3020770750","cluster_addr":"172.21.15.26:6821/3020770750","heartbeat_back_addr":"172.21.15.26:6825/3020770750","heartbeat_front_addr":"172.21.15.26:6823/3020770750","state":["exists","up"]},{"osd":6,"uuid":"14f3b696-1b3c-4749-8f61-ac10edbb5b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6811","nonce":158775588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6813","nonce":158775588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6817","nonce":158775588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6815","nonce":158775588}]},"public_addr":"172.21.15.26:6811/158775588","cluster_addr":"172.21.15.26:6813/158775588","heartbeat_back_addr":"172.21.15.26:6817/158775588","heartbeat_front_addr":"172.21.15.26:6815/158775588","state":["exists","up"]},{"osd":7,"uuid":"be7b4121-c71b-4908-ba4a-9c4389423201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":4176189153},{"type":"v1","addr":"172.21.15.26:6827","nonce":4176189153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":4176189153},{"type":"v1","addr":"172.21.15.26:6829","nonce":4176189153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":4176189153},{"type":"v1","addr":"172.21.15.26:6833","nonce":4176189153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":4176189153},{"type":"v1","addr":"172.21.15.26:6831","nonce":4176189153}]},"public_addr":"172.21.15.26:6827/4176189153","cluster_addr":"172.21.15.26:6829/4176189153","heartbeat_back_addr":"172.21.15.26:6833/4176189153","heartbeat_front_addr":"172.21.15.26:6831/4176189153","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.923722+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.404043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.275202+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.434925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.159606+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.379036+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.196000+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.387333+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T07:29:51.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.196+0000 7f9bdaa65640 1 -- 172.21.15.17:0/186828995 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f9bc006be80 msgr2=0x7f9bc006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:51.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.196+0000 7f9bdaa65640 1 --2- 172.21.15.17:0/186828995 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f9bc006be80 0x7f9bc006e340 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0011340 tx=0x7f9bd000b040 comp rx=0 tx=0).stop 2024-09-05T07:29:51.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.196+0000 7f9bdaa65640 1 -- 172.21.15.17:0/186828995 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bd4154770 msgr2=0x7f9bd4156c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:51.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.196+0000 7f9bdaa65640 1 --2- 172.21.15.17:0/186828995 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bd4154770 0x7f9bd4156c70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc00c390 tx=0x7f9bcc00c850 comp rx=0 tx=0).stop 2024-09-05T07:29:51.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.197+0000 7f9bdaa65640 1 -- 172.21.15.17:0/186828995 shutdown_connections 2024-09-05T07:29:51.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.197+0000 7f9bdaa65640 1 --2- 172.21.15.17:0/186828995 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f9bc006be80 0x7f9bc006e340 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:51.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.197+0000 7f9bdaa65640 1 --2- 172.21.15.17:0/186828995 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9bd40d0b00 0x7f9bd40b4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:51.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.197+0000 7f9bdaa65640 1 --2- 172.21.15.17:0/186828995 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bd4154770 0x7f9bd4156c70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:51.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.197+0000 7f9bdaa65640 1 --2- 172.21.15.17:0/186828995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9bd40cafa0 0x7f9bd40c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:51.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.197+0000 7f9bdaa65640 1 -- 172.21.15.17:0/186828995 >> 172.21.15.17:0/186828995 conn(0x7f9bd4073710 msgr2=0x7f9bd4152140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:51.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.197+0000 7f9bdaa65640 1 -- 172.21.15.17:0/186828995 shutdown_connections 2024-09-05T07:29:51.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.197+0000 7f9bdaa65640 1 -- 172.21.15.17:0/186828995 wait complete. 2024-09-05T07:29:51.209 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-05T07:29:51.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.311+0000 7f831492a640 1 Processor -- start 2024-09-05T07:29:51.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.311+0000 7f831492a640 1 -- start start 2024-09-05T07:29:51.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.312+0000 7f831492a640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8310067fa0 0x7f8310072ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:51.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.312+0000 7f831492a640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83100c78e0 con 0x7f8310067bc0 2024-09-05T07:29:51.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.312+0000 7f831492a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f831006d460 con 0x7f831015b9e0 2024-09-05T07:29:51.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.312+0000 7f831492a640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f83100c7ba0 con 0x7f8310067fa0 2024-09-05T07:29:51.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.313+0000 7f830dd9b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8310067fa0 0x7f8310072ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:51.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.313+0000 7f830ed9d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f831015b9e0 0x7f83101654d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.17:59076/0 (socket says 172.21.15.17:59076) 2024-09-05T07:29:51.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.313+0000 7f830ed9d640 1 -- 172.21.15.17:0/3478556737 learned_addr learned my addr 172.21.15.17:0/3478556737 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:29:51.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.316+0000 7f830d59a640 1 -- 172.21.15.17:0/3478556737 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3510551635 0 0) 0x7f831006d460 con 0x7f831015b9e0 2024-09-05T07:29:51.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.316+0000 7f830d59a640 1 -- 172.21.15.17:0/3478556737 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82fc003520 con 0x7f831015b9e0 2024-09-05T07:29:51.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.317+0000 7f830dd9b640 1 -- 172.21.15.17:0/3478556737 >> v1:172.21.15.26:6789/0 conn(0x7f831015b9e0 legacy=0x7f83101654d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:51.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.317+0000 7f830dd9b640 1 -- 172.21.15.17:0/3478556737 >> v1:172.21.15.17:6789/0 conn(0x7f8310067bc0 legacy=0x7f831015b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:51.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.317+0000 7f830dd9b640 1 -- 172.21.15.17:0/3478556737 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83100c7e80 con 0x7f8310067fa0 2024-09-05T07:29:51.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.320+0000 7f830dd9b640 1 --2- 172.21.15.17:0/3478556737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8310067fa0 0x7f8310072ac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f82f80097a0 tx=0x7f82f802a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8edfcaa9d1a09d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:51.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.325+0000 7f830d59a640 1 -- 172.21.15.17:0/3478556737 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f8037070 con 0x7f8310067fa0 2024-09-05T07:29:51.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.325+0000 7f830d59a640 1 -- 172.21.15.17:0/3478556737 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82f8032640 con 0x7f8310067fa0 2024-09-05T07:29:51.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.325+0000 7f830d59a640 1 -- 172.21.15.17:0/3478556737 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f8032a10 con 0x7f8310067fa0 2024-09-05T07:29:51.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.326+0000 7f831492a640 1 -- 172.21.15.17:0/3478556737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8310067fa0 msgr2=0x7f8310072ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:51.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.326+0000 7f831492a640 1 --2- 172.21.15.17:0/3478556737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8310067fa0 0x7f8310072ac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f82f80097a0 tx=0x7f82f802a2c0 comp rx=0 tx=0).stop 2024-09-05T07:29:51.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.326+0000 7f831492a640 1 -- 172.21.15.17:0/3478556737 shutdown_connections 2024-09-05T07:29:51.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.326+0000 7f831492a640 1 --2- 172.21.15.17:0/3478556737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8310067fa0 0x7f8310072ac0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:51.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.326+0000 7f831492a640 1 -- 172.21.15.17:0/3478556737 >> 172.21.15.17:0/3478556737 conn(0x7f83100c9ae0 msgr2=0x7f83100c9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:51.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.326+0000 7f831492a640 1 -- 172.21.15.17:0/3478556737 shutdown_connections 2024-09-05T07:29:51.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.326+0000 7f831492a640 1 -- 172.21.15.17:0/3478556737 wait complete. 2024-09-05T07:29:51.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.327+0000 7f831492a640 1 Processor -- start 2024-09-05T07:29:51.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.327+0000 7f831492a640 1 -- start start 2024-09-05T07:29:51.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.328+0000 7f831492a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8310067bc0 0x7f8310159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:51.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.328+0000 7f831492a640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8310067fa0 0x7f83101f42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:51.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.328+0000 7f831492a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f831015b9e0 0x7f8310152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:51.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.328+0000 7f831492a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8310072730 con 0x7f8310067bc0 2024-09-05T07:29:51.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.328+0000 7f831492a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f83100c8440 con 0x7f831015b9e0 2024-09-05T07:29:51.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.328+0000 7f831492a640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f83100c8960 con 0x7f8310067fa0 2024-09-05T07:29:51.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.329+0000 7f830e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8310067bc0 0x7f8310159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:51.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.329+0000 7f830ed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f831015b9e0 0x7f8310152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:51.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.329+0000 7f830e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8310067bc0 0x7f8310159790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56380/0 (socket says 172.21.15.17:56380) 2024-09-05T07:29:51.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.329+0000 7f830e59c640 1 -- 172.21.15.17:0/1600629526 learned_addr learned my addr 172.21.15.17:0/1600629526 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:51.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.329+0000 7f830dd9b640 1 --2- 172.21.15.17:0/1600629526 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8310067fa0 0x7f83101f42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:51.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.333+0000 7f830e59c640 1 -- 172.21.15.17:0/1600629526 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8310067fa0 msgr2=0x7f83101f42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:51.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.333+0000 7f830e59c640 1 --2- 172.21.15.17:0/1600629526 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8310067fa0 0x7f83101f42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:51.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.333+0000 7f830e59c640 1 -- 172.21.15.17:0/1600629526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f831015b9e0 msgr2=0x7f8310152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:51.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.333+0000 7f830e59c640 1 --2- 172.21.15.17:0/1600629526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f831015b9e0 0x7f8310152b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:51.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.333+0000 7f830e59c640 1 -- 172.21.15.17:0/1600629526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83100c2d80 con 0x7f8310067bc0 2024-09-05T07:29:51.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.335+0000 7f830e59c640 1 --2- 172.21.15.17:0/1600629526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8310067bc0 0x7f8310159790 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f830800c7c0 tx=0x7f830800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:51.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.339+0000 7f8306ffd640 1 -- 172.21.15.17:0/1600629526 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8308016020 con 0x7f8310067bc0 2024-09-05T07:29:51.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.339+0000 7f8306ffd640 1 -- 172.21.15.17:0/1600629526 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8308006d50 con 0x7f8310067bc0 2024-09-05T07:29:51.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.339+0000 7f831492a640 1 -- 172.21.15.17:0/1600629526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83100c2ae0 con 0x7f8310067bc0 2024-09-05T07:29:51.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.339+0000 7f8306ffd640 1 -- 172.21.15.17:0/1600629526 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8308003bb0 con 0x7f8310067bc0 2024-09-05T07:29:51.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.339+0000 7f831492a640 1 -- 172.21.15.17:0/1600629526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83101f3ab0 con 0x7f8310067bc0 2024-09-05T07:29:51.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.340+0000 7f831492a640 1 -- 172.21.15.17:0/1600629526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8310074290 con 0x7f8310067bc0 2024-09-05T07:29:51.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.360+0000 7f8306ffd640 1 -- 172.21.15.17:0/1600629526 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f830800a850 con 0x7f8310067bc0 2024-09-05T07:29:51.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.360+0000 7f8306ffd640 1 --2- 172.21.15.17:0/1600629526 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f82f006be60 0x7f82f006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:51.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.360+0000 7f830dd9b640 1 --2- 172.21.15.17:0/1600629526 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f82f006be60 0x7f82f006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:51.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.361+0000 7f830dd9b640 1 --2- 172.21.15.17:0/1600629526 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f82f006be60 0x7f82f006e320 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f82f8034000 tx=0x7f82f802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:51.524 INFO:tasks.ceph.mds.f.smithi026.stderr:2024-09-05T07:29:51.523+0000 f741640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-05T07:29:51.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.647+0000 7f8306ffd640 1 -- 172.21.15.17:0/1600629526 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8308057c80 con 0x7f8310067bc0 2024-09-05T07:29:51.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.648+0000 7f8306ffd640 1 -- 172.21.15.17:0/1600629526 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8308020020 con 0x7f8310067bc0 2024-09-05T07:29:51.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.859+0000 7f831492a640 1 -- 172.21.15.17:0/1600629526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f831015be90 con 0x7f8310067bc0 2024-09-05T07:29:51.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.872+0000 7f8306ffd640 1 -- 172.21.15.17:0/1600629526 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6938 (secure 0 0 0) 0x7f831015be90 con 0x7f8310067bc0 2024-09-05T07:29:51.873 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:29:51.873 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":18,"btime":"2024-09-05T07:29:49:192665+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4221,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/1677649004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1677649004},{"type":"v1","addr":"172.21.15.17:6833","nonce":1677649004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-05T07:29:30.282161+0000","modified":"2024-09-05T07:29:49.192601+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4261,"mds_1":4258,"mds_2":4241,"mds_3":4233,"mds_4":4230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4230":{"gid":4230,"name":"d","rank":4,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.26:6837/840343339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":840343339},{"type":"v1","addr":"172.21.15.26:6837","nonce":840343339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4233":{"gid":4233,"name":"b","rank":3,"incarnation":15,"state":"up:active","state_seq":7,"addr":"172.21.15.26:6839/914231229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":914231229},{"type":"v1","addr":"172.21.15.26:6839","nonce":914231229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4241":{"gid":4241,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":6,"addr":"172.21.15.17:6837/4100397916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":4100397916},{"type":"v1","addr":"172.21.15.17:6837","nonce":4100397916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4258":{"gid":4258,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.17:6835/2818017162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2818017162},{"type":"v1","addr":"172.21.15.17:6835","nonce":2818017162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4261":{"gid":4261,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/656329439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":656329439},{"type":"v1","addr":"172.21.15.26:6835","nonce":656329439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4261,"qdb_cluster":[4230,4233,4241,4258,4261]},"id":1}]} 2024-09-05T07:29:51.873 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 18 2024-09-05T07:29:51.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.875+0000 7f831492a640 1 -- 172.21.15.17:0/1600629526 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f82f006be60 msgr2=0x7f82f006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:51.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.875+0000 7f831492a640 1 --2- 172.21.15.17:0/1600629526 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f82f006be60 0x7f82f006e320 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f82f8034000 tx=0x7f82f802e000 comp rx=0 tx=0).stop 2024-09-05T07:29:51.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.875+0000 7f831492a640 1 -- 172.21.15.17:0/1600629526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8310067bc0 msgr2=0x7f8310159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:51.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.875+0000 7f831492a640 1 --2- 172.21.15.17:0/1600629526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8310067bc0 0x7f8310159790 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f830800c7c0 tx=0x7f830800cc80 comp rx=0 tx=0).stop 2024-09-05T07:29:51.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.875+0000 7f831492a640 1 -- 172.21.15.17:0/1600629526 shutdown_connections 2024-09-05T07:29:51.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.875+0000 7f831492a640 1 --2- 172.21.15.17:0/1600629526 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f82f006be60 0x7f82f006e320 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:51.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.875+0000 7f831492a640 1 --2- 172.21.15.17:0/1600629526 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8310067fa0 0x7f83101f42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:51.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.875+0000 7f831492a640 1 --2- 172.21.15.17:0/1600629526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f831015b9e0 0x7f8310152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:51.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.875+0000 7f831492a640 1 --2- 172.21.15.17:0/1600629526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8310067bc0 0x7f8310159790 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:51.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.875+0000 7f831492a640 1 -- 172.21.15.17:0/1600629526 >> 172.21.15.17:0/1600629526 conn(0x7f83100c9ae0 msgr2=0x7f831006e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:51.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.875+0000 7f831492a640 1 -- 172.21.15.17:0/1600629526 shutdown_connections 2024-09-05T07:29:51.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:51.875+0000 7f831492a640 1 -- 172.21.15.17:0/1600629526 wait complete. 2024-09-05T07:29:52.493 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-05T07:29:30.282161+0000', 'modified': '2024-09-05T07:29:49.192601+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4261, 'mds_1': 4258, 'mds_2': 4241, 'mds_3': 4233, 'mds_4': 4230}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4230': {'gid': 4230, 'name': 'd', 'rank': 4, 'incarnation': 17, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.26:6837/840343339', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6836', 'nonce': 840343339}, {'type': 'v1', 'addr': '172.21.15.26:6837', 'nonce': 840343339}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4233': {'gid': 4233, 'name': 'b', 'rank': 3, 'incarnation': 15, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.26:6839/914231229', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6838', 'nonce': 914231229}, {'type': 'v1', 'addr': '172.21.15.26:6839', 'nonce': 914231229}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4241': {'gid': 4241, 'name': 'a', 'rank': 2, 'incarnation': 13, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.17:6837/4100397916', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6836', 'nonce': 4100397916}, {'type': 'v1', 'addr': '172.21.15.17:6837', 'nonce': 4100397916}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4258': {'gid': 4258, 'name': 'e', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.17:6835/2818017162', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6834', 'nonce': 2818017162}, {'type': 'v1', 'addr': '172.21.15.17:6835', 'nonce': 2818017162}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4261': {'gid': 4261, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.26:6835/656329439', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6834', 'nonce': 656329439}, {'type': 'v1', 'addr': '172.21.15.26:6835', 'nonce': 656329439}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4261, 'qdb_cluster': [4230, 4233, 4241, 4258, 4261]} 2024-09-05T07:29:52.494 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-05T07:29:52.494 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-05T07:29:52.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.600+0000 7ff287647640 1 Processor -- start 2024-09-05T07:29:52.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.600+0000 7ff287647640 1 -- start start 2024-09-05T07:29:52.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.601+0000 7ff287647640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff2800d0b80 0x7ff2801546a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:52.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.601+0000 7ff287647640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff2800cabb0 0x7ff280154be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:52.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.601+0000 7ff287647640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff28015a9a0 con 0x7ff2800d07a0 2024-09-05T07:29:52.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.601+0000 7ff287647640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7ff2800cb160 con 0x7ff2800cabb0 2024-09-05T07:29:52.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.601+0000 7ff287647640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7ff28015ac80 con 0x7ff2800d0b80 2024-09-05T07:29:52.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.601+0000 7ff285be4640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff2800cabb0 0x7ff280154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:52.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.602+0000 7ff285be4640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff2800cabb0 0x7ff280154be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56392/0 (socket says 172.21.15.17:56392) 2024-09-05T07:29:52.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.602+0000 7ff285be4640 1 -- 172.21.15.17:0/546757862 learned_addr learned my addr 172.21.15.17:0/546757862 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:52.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.602+0000 7ff284be2640 1 --2- 172.21.15.17:0/546757862 >> v2:172.21.15.26:3300/0 conn(0x7ff2800d0b80 0x7ff2801546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:52.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.604+0000 7ff285be4640 1 -- 172.21.15.17:0/546757862 >> v2:172.21.15.26:3300/0 conn(0x7ff2800d0b80 msgr2=0x7ff2801546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:52.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.604+0000 7ff285be4640 1 --2- 172.21.15.17:0/546757862 >> v2:172.21.15.26:3300/0 conn(0x7ff2800d0b80 0x7ff2801546a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:52.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.604+0000 7ff285be4640 1 -- 172.21.15.17:0/546757862 >> v1:172.21.15.26:6789/0 conn(0x7ff2800d07a0 legacy=0x7ff2800cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:52.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.604+0000 7ff285be4640 1 -- 172.21.15.17:0/546757862 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff28015af60 con 0x7ff2800cabb0 2024-09-05T07:29:52.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.606+0000 7ff285be4640 1 --2- 172.21.15.17:0/546757862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2800cabb0 0x7ff280154be0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff28006c290 tx=0x7ff27802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9dd32d32af65b9a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:52.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.611+0000 7ff277fff640 1 -- 172.21.15.17:0/546757862 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff278036070 con 0x7ff2800cabb0 2024-09-05T07:29:52.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.611+0000 7ff277fff640 1 -- 172.21.15.17:0/546757862 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff278031600 con 0x7ff2800cabb0 2024-09-05T07:29:52.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.611+0000 7ff277fff640 1 -- 172.21.15.17:0/546757862 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2780319d0 con 0x7ff2800cabb0 2024-09-05T07:29:52.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.612+0000 7ff287647640 1 -- 172.21.15.17:0/546757862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2800cabb0 msgr2=0x7ff280154be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:52.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.612+0000 7ff287647640 1 --2- 172.21.15.17:0/546757862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2800cabb0 0x7ff280154be0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff28006c290 tx=0x7ff27802a730 comp rx=0 tx=0).stop 2024-09-05T07:29:52.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.612+0000 7ff287647640 1 -- 172.21.15.17:0/546757862 shutdown_connections 2024-09-05T07:29:52.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.612+0000 7ff287647640 1 --2- 172.21.15.17:0/546757862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2800cabb0 0x7ff280154be0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:52.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.612+0000 7ff287647640 1 --2- 172.21.15.17:0/546757862 >> v2:172.21.15.26:3300/0 conn(0x7ff2800d0b80 0x7ff2801546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:52.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.612+0000 7ff287647640 1 -- 172.21.15.17:0/546757862 >> 172.21.15.17:0/546757862 conn(0x7ff280073710 msgr2=0x7ff280073b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:52.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.612+0000 7ff287647640 1 -- 172.21.15.17:0/546757862 shutdown_connections 2024-09-05T07:29:52.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.612+0000 7ff287647640 1 -- 172.21.15.17:0/546757862 wait complete. 2024-09-05T07:29:52.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.613+0000 7ff287647640 1 Processor -- start 2024-09-05T07:29:52.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.613+0000 7ff287647640 1 -- start start 2024-09-05T07:29:52.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.614+0000 7ff287647640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2800cabb0 0x7ff28015c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:52.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.614+0000 7ff287647640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff2800d07a0 0x7ff2800b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:52.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.614+0000 7ff287647640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2800d0b80 0x7ff2801f38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:52.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.614+0000 7ff287647640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff28006cb30 con 0x7ff2800d0b80 2024-09-05T07:29:52.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.614+0000 7ff287647640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ff28006c9b0 con 0x7ff2800cabb0 2024-09-05T07:29:52.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.614+0000 7ff287647640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7ff28015de90 con 0x7ff2800d07a0 2024-09-05T07:29:52.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.615+0000 7ff285be4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2800d0b80 0x7ff2801f38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:52.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.615+0000 7ff2853e3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2800cabb0 0x7ff28015c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:52.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.615+0000 7ff284be2640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff2800d07a0 0x7ff2800b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:52.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.615+0000 7ff285be4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2800d0b80 0x7ff2801f38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56408/0 (socket says 172.21.15.17:56408) 2024-09-05T07:29:52.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.615+0000 7ff285be4640 1 -- 172.21.15.17:0/456088445 learned_addr learned my addr 172.21.15.17:0/456088445 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:52.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.618+0000 7ff285be4640 1 -- 172.21.15.17:0/456088445 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff2800d07a0 msgr2=0x7ff2800b3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:52.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.618+0000 7ff285be4640 1 --2- 172.21.15.17:0/456088445 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff2800d07a0 0x7ff2800b3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:52.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.618+0000 7ff285be4640 1 -- 172.21.15.17:0/456088445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2800cabb0 msgr2=0x7ff28015c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:52.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.618+0000 7ff285be4640 1 --2- 172.21.15.17:0/456088445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2800cabb0 0x7ff28015c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:52.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.618+0000 7ff285be4640 1 -- 172.21.15.17:0/456088445 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff28015c9e0 con 0x7ff2800d0b80 2024-09-05T07:29:52.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.621+0000 7ff285be4640 1 --2- 172.21.15.17:0/456088445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2800d0b80 0x7ff2801f38a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff278009f40 tx=0x7ff278004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:52.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.624+0000 7ff275ffb640 1 -- 172.21.15.17:0/456088445 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff278036050 con 0x7ff2800d0b80 2024-09-05T07:29:52.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.624+0000 7ff275ffb640 1 -- 172.21.15.17:0/456088445 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff278042070 con 0x7ff2800d0b80 2024-09-05T07:29:52.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.624+0000 7ff287647640 1 -- 172.21.15.17:0/456088445 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff28015ba00 con 0x7ff2800d0b80 2024-09-05T07:29:52.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.624+0000 7ff275ffb640 1 -- 172.21.15.17:0/456088445 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff278009510 con 0x7ff2800d0b80 2024-09-05T07:29:52.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.624+0000 7ff287647640 1 -- 172.21.15.17:0/456088445 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff28015bca0 con 0x7ff2800d0b80 2024-09-05T07:29:52.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.627+0000 7ff28a3dd740 1 Processor -- start 2024-09-05T07:29:52.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.627+0000 7ff28a3dd740 1 -- start start 2024-09-05T07:29:52.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.628+0000 7ff28a3dd740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cbffd3d750 0x55cbffd759e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:52.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.628+0000 7ff28a3dd740 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55cbffd3af80 0x55cbffd75f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:52.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.628+0000 7ff28a3dd740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cbffd3db30 0x55cbffd39a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:52.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.628+0000 7ff28a3dd740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55cbffc9e520 con 0x55cbffd3db30 2024-09-05T07:29:52.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.628+0000 7ff28a3dd740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55cbffc463e0 con 0x55cbffd3d750 2024-09-05T07:29:52.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.628+0000 7ff28a3dd740 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x55cbffc9a4e0 con 0x55cbffd3af80 2024-09-05T07:29:52.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.629+0000 7ff2853e3640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55cbffd3af80 0x55cbffd75f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:52.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.629+0000 7ff284be2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cbffd3d750 0x55cbffd759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:52.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.629+0000 7ff2853e3640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55cbffd3af80 0x55cbffd75f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:49388/0 (socket says 172.21.15.17:49388) 2024-09-05T07:29:52.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.629+0000 7ff2853e3640 1 -- 172.21.15.17:0/2046235948 learned_addr learned my addr 172.21.15.17:0/2046235948 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:52.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.633+0000 7ff284be2640 1 --2- 172.21.15.17:0/2046235948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cbffd3db30 0x55cbffd39a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:52.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.633+0000 7ff2853e3640 1 -- 172.21.15.17:0/2046235948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cbffd3d750 msgr2=0x55cbffd759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:52.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.633+0000 7ff2853e3640 1 --2- 172.21.15.17:0/2046235948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cbffd3d750 0x55cbffd759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:52.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.633+0000 7ff2853e3640 1 -- 172.21.15.17:0/2046235948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cbffd3db30 msgr2=0x55cbffd39a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:52.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.633+0000 7ff2853e3640 1 --2- 172.21.15.17:0/2046235948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cbffd3db30 0x55cbffd39a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:52.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.633+0000 7ff2853e3640 1 -- 172.21.15.17:0/2046235948 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbffc612f0 con 0x55cbffd3af80 2024-09-05T07:29:52.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.636+0000 7ff2853e3640 1 --2- 172.21.15.17:0/2046235948 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55cbffd3af80 0x55cbffd75f20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff27c001910 tx=0x7ff27c007e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccb00ab1405f0c9c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:52.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.640+0000 7ff26affd640 1 -- 172.21.15.17:0/2046235948 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27c0052e0 con 0x55cbffd3af80 2024-09-05T07:29:52.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.640+0000 7ff26affd640 1 -- 172.21.15.17:0/2046235948 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff27c018070 con 0x55cbffd3af80 2024-09-05T07:29:52.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.640+0000 7ff26affd640 1 -- 172.21.15.17:0/2046235948 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27c00fad0 con 0x55cbffd3af80 2024-09-05T07:29:52.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.641+0000 7ff28a3dd740 1 -- 172.21.15.17:0/2046235948 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55cbffd3af80 msgr2=0x55cbffd75f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:52.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.641+0000 7ff28a3dd740 1 --2- 172.21.15.17:0/2046235948 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55cbffd3af80 0x55cbffd75f20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff27c001910 tx=0x7ff27c007e30 comp rx=0 tx=0).stop 2024-09-05T07:29:52.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.641+0000 7ff28a3dd740 1 -- 172.21.15.17:0/2046235948 shutdown_connections 2024-09-05T07:29:52.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.641+0000 7ff28a3dd740 1 --2- 172.21.15.17:0/2046235948 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55cbffd3af80 0x55cbffd75f20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:52.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.641+0000 7ff28a3dd740 1 --2- 172.21.15.17:0/2046235948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cbffd3db30 0x55cbffd39a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:52.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.641+0000 7ff28a3dd740 1 --2- 172.21.15.17:0/2046235948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cbffd3d750 0x55cbffd759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:52.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.641+0000 7ff28a3dd740 1 -- 172.21.15.17:0/2046235948 >> 172.21.15.17:0/2046235948 conn(0x55cbffd3be70 msgr2=0x55cbffd3c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:52.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.641+0000 7ff28a3dd740 1 -- 172.21.15.17:0/2046235948 shutdown_connections 2024-09-05T07:29:52.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.641+0000 7ff28a3dd740 1 -- 172.21.15.17:0/2046235948 wait complete. 2024-09-05T07:29:52.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.642+0000 7ff28a3dd740 1 -- start start 2024-09-05T07:29:52.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.642+0000 7ff28a3dd740 1 Processor -- start 2024-09-05T07:29:52.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.644+0000 7ff28a3dd740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cbffd3af80 0x55cbffd6a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:52.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.644+0000 7ff28a3dd740 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55cbffd3d750 0x55cbffd6f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:52.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.644+0000 7ff28a3dd740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cbffd3db30 0x55cbffd8f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:52.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.644+0000 7ff28a3dd740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55cbffd3cfe0 con 0x55cbffd3af80 2024-09-05T07:29:52.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.644+0000 7ff28a3dd740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55cbffc27450 con 0x55cbffd3db30 2024-09-05T07:29:52.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.644+0000 7ff28a3dd740 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x55cbffd75550 con 0x55cbffd3d750 2024-09-05T07:29:52.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.644+0000 7ff28a3dd740 10 client.0 _ll_register_callbacks cb 0x55cbff9b0ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:29:52.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.644+0000 7ff2853e3640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55cbffd3d750 0x55cbffd6f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:52.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.645+0000 7ff284be2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cbffd3db30 0x55cbffd8f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:52.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.645+0000 7ff2853e3640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55cbffd3d750 0x55cbffd6f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:49402/0 (socket says 172.21.15.17:49402) 2024-09-05T07:29:52.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.645+0000 7ff2853e3640 1 -- 172.21.15.17:0/471471533 learned_addr learned my addr 172.21.15.17:0/471471533 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:52.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.647+0000 7ff275ffb640 1 -- 172.21.15.17:0/456088445 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff278007bf0 con 0x7ff2800d0b80 2024-09-05T07:29:52.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.647+0000 7ff275ffb640 1 --2- 172.21.15.17:0/456088445 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7ff26406be20 0x7ff26406e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:52.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.648+0000 7ff285be4640 1 --2- 172.21.15.17:0/456088445 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7ff26406be20 0x7ff26406e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:52.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.648+0000 7ff285be4640 1 --2- 172.21.15.17:0/456088445 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7ff26406be20 0x7ff26406e2e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff2780072a0 tx=0x7ff2780071f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:52.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.650+0000 7ff284be2640 1 -- 172.21.15.17:0/471471533 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55cbffd3d750 msgr2=0x55cbffd6f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:52.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.650+0000 7ff284be2640 1 --2- 172.21.15.17:0/471471533 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55cbffd3d750 0x55cbffd6f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:52.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.650+0000 7ff284be2640 1 -- 172.21.15.17:0/471471533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cbffd3af80 msgr2=0x55cbffd6a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:52.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.650+0000 7ff284be2640 1 --2- 172.21.15.17:0/471471533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cbffd3af80 0x55cbffd6a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:52.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.650+0000 7ff284be2640 1 -- 172.21.15.17:0/471471533 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbff9b12d0 con 0x55cbffd3db30 2024-09-05T07:29:52.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.652+0000 7ff275ffb640 1 -- 172.21.15.17:0/456088445 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff278077e60 con 0x7ff2800d0b80 2024-09-05T07:29:52.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.653+0000 7ff284be2640 1 --2- 172.21.15.17:0/471471533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cbffd3db30 0x55cbffd8f2f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff28014e180 tx=0x7ff270016df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76714c4e36d1931 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:52.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.653+0000 7ff25ffff640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-05T07:29:52.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.657+0000 7ff25ffff640 1 -- 172.21.15.17:0/471471533 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff270015b20 con 0x55cbffd3db30 2024-09-05T07:29:52.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.657+0000 7ff25ffff640 1 -- 172.21.15.17:0/471471533 <== mon.1 v2:172.21.15.26:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff270015cc0 con 0x55cbffd3db30 2024-09-05T07:29:52.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.657+0000 7ff28a3dd740 1 -- 172.21.15.17:0/471471533 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff27c018070 con 0x55cbffd3db30 2024-09-05T07:29:52.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.658+0000 7ff25ffff640 1 -- 172.21.15.17:0/471471533 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7ff270004030 con 0x55cbffd3db30 2024-09-05T07:29:52.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.659+0000 7ff28a3dd740 10 client.4495 fetch_fsmap learned FSMap version 18 2024-09-05T07:29:52.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.659+0000 7ff28a3dd740 1 -- 172.21.15.17:0/471471533 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55cbffa7b6b0 con 0x55cbffd3db30 2024-09-05T07:29:52.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.672+0000 7ff25ffff640 1 -- 172.21.15.17:0/471471533 <== mon.1 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff27c018070 con 0x55cbffd3db30 2024-09-05T07:29:52.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.673+0000 7ff25ffff640 1 -- 172.21.15.17:0/471471533 <== mon.1 v2:172.21.15.26:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7ff2700041d0 con 0x55cbffd3db30 2024-09-05T07:29:52.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.673+0000 7ff28a3dd740 10 client.4495 fetch_fsmap finished waiting for FSMap version 18 2024-09-05T07:29:52.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.673+0000 7ff28a3dd740 10 client.4495 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-05T07:29:52.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.673+0000 7ff28a3dd740 20 client.4495 populate_metadata read hostname 'smithi017' 2024-09-05T07:29:52.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.673+0000 7ff28a3dd740 1 --2- 172.21.15.17:0/471471533 >> [v2:172.21.15.26:6836/840343339,v1:172.21.15.26:6837/840343339] conn(0x55cbffd90220 0x55cbffd90870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:52.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.673+0000 7ff28a3dd740 4 client.4495 mds_command: new command op to 4230 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T07:29:52.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.673+0000 7ff28a3dd740 1 -- 172.21.15.17:0/471471533 --> [v2:172.21.15.26:6836/840343339,v1:172.21.15.26:6837/840343339] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cbffcabc50 con 0x55cbffd90220 2024-09-05T07:29:52.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.683+0000 7ff2853e3640 1 --2- 172.21.15.17:0/471471533 >> [v2:172.21.15.26:6836/840343339,v1:172.21.15.26:6837/840343339] conn(0x55cbffd90220 0x55cbffd90870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:52.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.775+0000 7ff2853e3640 1 --2- 172.21.15.17:0/471471533 >> [v2:172.21.15.26:6836/840343339,v1:172.21.15.26:6837/840343339] conn(0x55cbffd90220 0x55cbffd90870 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a7bcd29f1c5ef835 server_cookie=ea80e4a3be45013 in_seq=0 out_seq=0 2024-09-05T07:29:52.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.775+0000 7ff25ffff640 10 client.4495 ms_handle_connect on v2:172.21.15.26:6836/840343339 2024-09-05T07:29:52.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.909+0000 7ff25ffff640 1 -- 172.21.15.17:0/471471533 <== mds.4 v2:172.21.15.26:6836/840343339 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cbffcabc50 con 0x55cbffd90220 2024-09-05T07:29:52.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.909+0000 7ff25ffff640 10 client.4495 handle_command_reply: tid=0 2024-09-05T07:29:52.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.909+0000 7ff28a3dd740 1 client.4495 shutdown 2024-09-05T07:29:52.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.909+0000 7ff28a3dd740 1 -- 172.21.15.17:0/471471533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cbffd3db30 msgr2=0x55cbffd8f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:52.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.909+0000 7ff28a3dd740 1 --2- 172.21.15.17:0/471471533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cbffd3db30 0x55cbffd8f2f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff28014e180 tx=0x7ff270016df0 comp rx=0 tx=0).stop 2024-09-05T07:29:52.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.909+0000 7ff28a3dd740 1 -- 172.21.15.17:0/471471533 shutdown_connections 2024-09-05T07:29:52.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.909+0000 7ff28a3dd740 1 --2- 172.21.15.17:0/471471533 >> [v2:172.21.15.26:6836/840343339,v1:172.21.15.26:6837/840343339] conn(0x55cbffd90220 0x55cbffd90870 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:52.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.909+0000 7ff28a3dd740 1 --2- 172.21.15.17:0/471471533 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55cbffd3d750 0x55cbffd6f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:52.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.909+0000 7ff28a3dd740 1 --2- 172.21.15.17:0/471471533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cbffd3db30 0x55cbffd8f2f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:52.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.909+0000 7ff28a3dd740 1 --2- 172.21.15.17:0/471471533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cbffd3af80 0x55cbffd6a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:52.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.909+0000 7ff25ffff640 0 client.4495 ms_handle_reset on v2:172.21.15.26:6836/840343339 2024-09-05T07:29:52.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.909+0000 7ff28a3dd740 1 -- 172.21.15.17:0/471471533 >> 172.21.15.17:0/471471533 conn(0x55cbffd3be70 msgr2=0x55cbffd70c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:52.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.909+0000 7ff28a3dd740 1 -- 172.21.15.17:0/471471533 shutdown_connections 2024-09-05T07:29:52.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.909+0000 7ff28a3dd740 1 -- 172.21.15.17:0/471471533 wait complete. 2024-09-05T07:29:52.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.909+0000 7ff28a3dd740 20 client.4495 trim_cache size 0 max 16384 2024-09-05T07:29:52.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.927+0000 7ff28a3dd740 1 Processor -- start 2024-09-05T07:29:52.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.928+0000 7ff28a3dd740 1 -- start start 2024-09-05T07:29:52.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.928+0000 7ff28a3dd740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cbffd3af80 0x55cbffd711b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:52.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.928+0000 7ff28a3dd740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cbffd3d750 0x55cbffd6a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:52.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.928+0000 7ff28a3dd740 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55cbffd3db30 0x55cbffd6a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:52.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.928+0000 7ff28a3dd740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff28014cdb0 con 0x55cbffd3af80 2024-09-05T07:29:52.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.928+0000 7ff28a3dd740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55cbffd6f1d0 con 0x55cbffd3d750 2024-09-05T07:29:52.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.928+0000 7ff28a3dd740 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x55cbffd70390 con 0x55cbffd3db30 2024-09-05T07:29:52.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.929+0000 7ff284be2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cbffd3af80 0x55cbffd711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:52.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.929+0000 7ff284be2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cbffd3af80 0x55cbffd711b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56428/0 (socket says 172.21.15.17:56428) 2024-09-05T07:29:52.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.929+0000 7ff284be2640 1 -- 172.21.15.17:0/3580748179 learned_addr learned my addr 172.21.15.17:0/3580748179 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:52.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.929+0000 7ff2853e3640 1 --2- 172.21.15.17:0/3580748179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cbffd3d750 0x55cbffd6a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:52.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.929+0000 7ff284be2640 1 --2- 172.21.15.17:0/3580748179 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55cbffd3db30 0x55cbffd6a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:52.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.931+0000 7ff284be2640 1 -- 172.21.15.17:0/3580748179 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55cbffd3db30 msgr2=0x55cbffd6a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:52.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.931+0000 7ff284be2640 1 --2- 172.21.15.17:0/3580748179 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55cbffd3db30 0x55cbffd6a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:52.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.931+0000 7ff284be2640 1 -- 172.21.15.17:0/3580748179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cbffd3d750 msgr2=0x55cbffd6a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:52.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.931+0000 7ff284be2640 1 --2- 172.21.15.17:0/3580748179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cbffd3d750 0x55cbffd6a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:52.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.931+0000 7ff284be2640 1 -- 172.21.15.17:0/3580748179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbffd7a7f0 con 0x55cbffd3af80 2024-09-05T07:29:52.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.933+0000 7ff284be2640 1 --2- 172.21.15.17:0/3580748179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cbffd3af80 0x55cbffd711b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff28014e180 tx=0x7ff270013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f24a848b2b613bd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:52.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.937+0000 7ff26a7fc640 1 -- 172.21.15.17:0/3580748179 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff270015d20 con 0x55cbffd3af80 2024-09-05T07:29:52.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.937+0000 7ff26a7fc640 1 -- 172.21.15.17:0/3580748179 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff270003610 con 0x55cbffd3af80 2024-09-05T07:29:52.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.937+0000 7ff26a7fc640 1 -- 172.21.15.17:0/3580748179 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff270003a00 con 0x55cbffd3af80 2024-09-05T07:29:52.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.937+0000 7ff28a3dd740 1 -- 172.21.15.17:0/3580748179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cbffd3af80 msgr2=0x55cbffd711b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:52.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.937+0000 7ff28a3dd740 1 --2- 172.21.15.17:0/3580748179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cbffd3af80 0x55cbffd711b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff28014e180 tx=0x7ff270013000 comp rx=0 tx=0).stop 2024-09-05T07:29:52.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.937+0000 7ff28a3dd740 1 -- 172.21.15.17:0/3580748179 shutdown_connections 2024-09-05T07:29:52.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.937+0000 7ff28a3dd740 1 --2- 172.21.15.17:0/3580748179 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55cbffd3db30 0x55cbffd6a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:52.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.937+0000 7ff28a3dd740 1 --2- 172.21.15.17:0/3580748179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cbffd3d750 0x55cbffd6a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:52.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.937+0000 7ff28a3dd740 1 --2- 172.21.15.17:0/3580748179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cbffd3af80 0x55cbffd711b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:52.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.937+0000 7ff28a3dd740 1 -- 172.21.15.17:0/3580748179 >> 172.21.15.17:0/3580748179 conn(0x55cbffd3be70 msgr2=0x55cbffd3b360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:52.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.938+0000 7ff28a3dd740 1 -- 172.21.15.17:0/3580748179 shutdown_connections 2024-09-05T07:29:52.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.938+0000 7ff28a3dd740 1 -- 172.21.15.17:0/3580748179 wait complete. 2024-09-05T07:29:52.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.938+0000 7ff28a3dd740 1 -- start start 2024-09-05T07:29:52.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.938+0000 7ff28a3dd740 1 Processor -- start 2024-09-05T07:29:52.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.939+0000 7ff28a3dd740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cbffd3af80 0x55cbffd7fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:52.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.939+0000 7ff28a3dd740 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55cbffd3d750 0x55cbffd69500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:52.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.939+0000 7ff28a3dd740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cbffd3db30 0x55cbffd398b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:52.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.939+0000 7ff28a3dd740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55cbffd906f0 con 0x55cbffd3af80 2024-09-05T07:29:52.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.939+0000 7ff28a3dd740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55cbffd900a0 con 0x55cbffd3db30 2024-09-05T07:29:52.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.939+0000 7ff28a3dd740 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x55cbffd8c940 con 0x55cbffd3d750 2024-09-05T07:29:52.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.939+0000 7ff28a3dd740 10 client.0 _ll_register_callbacks cb 0x7ff270009950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:29:52.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.940+0000 7ff284be2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cbffd3af80 0x55cbffd7fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:52.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.940+0000 7ff2853e3640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55cbffd3d750 0x55cbffd69500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:52.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.940+0000 7ff284be2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cbffd3db30 0x55cbffd398b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:52.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.940+0000 7ff284be2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cbffd3af80 0x55cbffd7fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56438/0 (socket says 172.21.15.17:56438) 2024-09-05T07:29:52.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.940+0000 7ff284be2640 1 -- 172.21.15.17:0/961494868 learned_addr learned my addr 172.21.15.17:0/961494868 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:52.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.943+0000 7ff2853e3640 1 -- 172.21.15.17:0/961494868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cbffd3db30 msgr2=0x55cbffd398b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:52.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.943+0000 7ff2853e3640 1 --2- 172.21.15.17:0/961494868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cbffd3db30 0x55cbffd398b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:52.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.943+0000 7ff2853e3640 1 -- 172.21.15.17:0/961494868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cbffd3af80 msgr2=0x55cbffd7fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:52.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.943+0000 7ff2853e3640 1 --2- 172.21.15.17:0/961494868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cbffd3af80 0x55cbffd7fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:52.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.943+0000 7ff2853e3640 1 -- 172.21.15.17:0/961494868 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55cbffd75140 con 0x55cbffd3d750 2024-09-05T07:29:52.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.945+0000 7ff2853e3640 1 --2- 172.21.15.17:0/961494868 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55cbffd3d750 0x55cbffd69500 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff27c001eb0 tx=0x7ff27c000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5c1998f1b8e5e8e server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:52.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.945+0000 7ff25ffff640 10 client.0 ms_handle_connect on v2:172.21.15.26:3301/0 2024-09-05T07:29:52.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.949+0000 7ff25ffff640 1 -- 172.21.15.17:0/961494868 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27c00fad0 con 0x55cbffd3d750 2024-09-05T07:29:52.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.949+0000 7ff25ffff640 1 -- 172.21.15.17:0/961494868 <== mon.2 v2:172.21.15.26:3301/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff27c00fc70 con 0x55cbffd3d750 2024-09-05T07:29:52.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.949+0000 7ff28a3dd740 1 -- 172.21.15.17:0/961494868 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff270003610 con 0x55cbffd3d750 2024-09-05T07:29:52.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.951+0000 7ff25ffff640 1 -- 172.21.15.17:0/961494868 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7ff27c0067d0 con 0x55cbffd3d750 2024-09-05T07:29:52.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.951+0000 7ff28a3dd740 10 client.4433 fetch_fsmap learned FSMap version 18 2024-09-05T07:29:52.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.951+0000 7ff28a3dd740 1 -- 172.21.15.17:0/961494868 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55cbffd80860 con 0x55cbffd3d750 2024-09-05T07:29:52.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.965+0000 7ff25ffff640 1 -- 172.21.15.17:0/961494868 <== mon.2 v2:172.21.15.26:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff270003610 con 0x55cbffd3d750 2024-09-05T07:29:52.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.965+0000 7ff25ffff640 1 -- 172.21.15.17:0/961494868 <== mon.2 v2:172.21.15.26:3301/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7ff27c006970 con 0x55cbffd3d750 2024-09-05T07:29:52.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.965+0000 7ff28a3dd740 10 client.4433 fetch_fsmap finished waiting for FSMap version 18 2024-09-05T07:29:52.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.965+0000 7ff28a3dd740 10 client.4433 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-05T07:29:52.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.965+0000 7ff28a3dd740 20 client.4433 populate_metadata read hostname 'smithi017' 2024-09-05T07:29:52.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.965+0000 7ff28a3dd740 1 --2- 172.21.15.17:0/961494868 >> [v2:172.21.15.26:6836/840343339,v1:172.21.15.26:6837/840343339] conn(0x55cbffdfed70 0x55cbffdfb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:52.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.965+0000 7ff28a3dd740 4 client.4433 mds_command: new command op to 4230 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-05T07:29:52.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.965+0000 7ff28a3dd740 1 -- 172.21.15.17:0/961494868 --> [v2:172.21.15.26:6836/840343339,v1:172.21.15.26:6837/840343339] -- command(tid 0: {"prefix": "status"}) -- 0x55cbffca5fa0 con 0x55cbffdfed70 2024-09-05T07:29:52.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.965+0000 7ff284be2640 1 --2- 172.21.15.17:0/961494868 >> [v2:172.21.15.26:6836/840343339,v1:172.21.15.26:6837/840343339] conn(0x55cbffdfed70 0x55cbffdfb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:52.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.969+0000 7ff25ffff640 10 client.4433 ms_handle_connect on v2:172.21.15.26:6836/840343339 2024-09-05T07:29:52.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.969+0000 7ff284be2640 1 --2- 172.21.15.17:0/961494868 >> [v2:172.21.15.26:6836/840343339,v1:172.21.15.26:6837/840343339] conn(0x55cbffdfed70 0x55cbffdfb7e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1c971d5097af4b65 server_cookie=219ffc4416565d72 in_seq=0 out_seq=0 2024-09-05T07:29:52.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.987+0000 7ff25ffff640 1 -- 172.21.15.17:0/961494868 <== mds.4 v2:172.21.15.26:6836/840343339 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55cbffca5fa0 con 0x55cbffdfed70 2024-09-05T07:29:52.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.988+0000 7ff25ffff640 10 client.4433 handle_command_reply: tid=0 2024-09-05T07:29:52.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.988+0000 7ff28a3dd740 1 client.4433 shutdown 2024-09-05T07:29:52.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.988+0000 7ff28a3dd740 1 -- 172.21.15.17:0/961494868 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55cbffd3d750 msgr2=0x55cbffd69500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:52.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.988+0000 7ff28a3dd740 1 --2- 172.21.15.17:0/961494868 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55cbffd3d750 0x55cbffd69500 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff27c001eb0 tx=0x7ff27c000ed0 comp rx=0 tx=0).stop 2024-09-05T07:29:52.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.988+0000 7ff28a3dd740 1 -- 172.21.15.17:0/961494868 shutdown_connections 2024-09-05T07:29:52.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.988+0000 7ff28a3dd740 1 --2- 172.21.15.17:0/961494868 >> [v2:172.21.15.26:6836/840343339,v1:172.21.15.26:6837/840343339] conn(0x55cbffdfed70 0x55cbffdfb7e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:52.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.988+0000 7ff28a3dd740 1 --2- 172.21.15.17:0/961494868 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55cbffd3d750 0x55cbffd69500 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:52.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.988+0000 7ff25ffff640 0 client.4433 ms_handle_reset on v2:172.21.15.26:6836/840343339 2024-09-05T07:29:52.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.988+0000 7ff28a3dd740 1 --2- 172.21.15.17:0/961494868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cbffd3db30 0x55cbffd398b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:52.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.988+0000 7ff28a3dd740 1 --2- 172.21.15.17:0/961494868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cbffd3af80 0x55cbffd7fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:52.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.988+0000 7ff28a3dd740 1 -- 172.21.15.17:0/961494868 >> 172.21.15.17:0/961494868 conn(0x55cbffd3be70 msgr2=0x55cbffd69e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:52.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.988+0000 7ff28a3dd740 1 -- 172.21.15.17:0/961494868 shutdown_connections 2024-09-05T07:29:52.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.988+0000 7ff28a3dd740 1 -- 172.21.15.17:0/961494868 wait complete. 2024-09-05T07:29:52.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.988+0000 7ff28a3dd740 20 client.4433 trim_cache size 0 max 16384 2024-09-05T07:29:52.991 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-05T07:29:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "848dac54-74f8-48f3-8686-c6495dcb972b", 2024-09-05T07:29:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 4, 2024-09-05T07:29:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4230, 2024-09-05T07:29:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-05T07:29:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-05T07:29:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-05T07:29:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 5.7949996429999997, 2024-09-05T07:29:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 18, 2024-09-05T07:29:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 22, 2024-09-05T07:29:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 22, 2024-09-05T07:29:52.991 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 28.477112431999998 2024-09-05T07:29:52.992 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-05T07:29:52.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.989+0000 7ff287647640 1 -- 172.21.15.17:0/456088445 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7ff26406be20 msgr2=0x7ff26406e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:52.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.989+0000 7ff287647640 1 --2- 172.21.15.17:0/456088445 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7ff26406be20 0x7ff26406e2e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff2780072a0 tx=0x7ff2780071f0 comp rx=0 tx=0).stop 2024-09-05T07:29:52.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.989+0000 7ff287647640 1 -- 172.21.15.17:0/456088445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2800d0b80 msgr2=0x7ff2801f38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:52.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.989+0000 7ff287647640 1 --2- 172.21.15.17:0/456088445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2800d0b80 0x7ff2801f38a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff278009f40 tx=0x7ff278004a40 comp rx=0 tx=0).stop 2024-09-05T07:29:52.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.989+0000 7ff287647640 1 -- 172.21.15.17:0/456088445 shutdown_connections 2024-09-05T07:29:52.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.989+0000 7ff287647640 1 --2- 172.21.15.17:0/456088445 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7ff26406be20 0x7ff26406e2e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:52.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.989+0000 7ff287647640 1 --2- 172.21.15.17:0/456088445 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff2800d07a0 0x7ff2800b3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:52.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.989+0000 7ff287647640 1 --2- 172.21.15.17:0/456088445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2800d0b80 0x7ff2801f38a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:52.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.989+0000 7ff287647640 1 --2- 172.21.15.17:0/456088445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2800cabb0 0x7ff28015c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:52.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.989+0000 7ff287647640 1 -- 172.21.15.17:0/456088445 >> 172.21.15.17:0/456088445 conn(0x7ff280073710 msgr2=0x7ff280153a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:52.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.989+0000 7ff287647640 1 -- 172.21.15.17:0/456088445 shutdown_connections 2024-09-05T07:29:52.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:52.989+0000 7ff287647640 1 -- 172.21.15.17:0/456088445 wait complete. 2024-09-05T07:29:53.000 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-05T07:29:53.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.099+0000 7ff3b60ba640 1 Processor -- start 2024-09-05T07:29:53.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.099+0000 7ff3b60ba640 1 -- start start 2024-09-05T07:29:53.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.100+0000 7ff3b60ba640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff3b0158d20 0x7ff3b00ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.100+0000 7ff3b60ba640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff3b015eb60 0x7ff3b01627d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.100+0000 7ff3b60ba640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3b00b13e0 con 0x7ff3b0162d10 2024-09-05T07:29:53.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.100+0000 7ff3b60ba640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7ff3b0159100 con 0x7ff3b015eb60 2024-09-05T07:29:53.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.100+0000 7ff3b60ba640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7ff3b015eff0 con 0x7ff3b0158d20 2024-09-05T07:29:53.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.101+0000 7ff3aeffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff3b015eb60 0x7ff3b01627d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.101+0000 7ff3af7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff3b0158d20 0x7ff3b00ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.101+0000 7ff3af7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff3b0158d20 0x7ff3b00ca0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:58504/0 (socket says 172.21.15.17:58504) 2024-09-05T07:29:53.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.101+0000 7ff3af7fe640 1 -- 172.21.15.17:0/4258179353 learned_addr learned my addr 172.21.15.17:0/4258179353 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:53.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.103+0000 7ff3af7fe640 1 -- 172.21.15.17:0/4258179353 >> v2:172.21.15.17:3300/0 conn(0x7ff3b015eb60 msgr2=0x7ff3b01627d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:53.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.103+0000 7ff3af7fe640 1 --2- 172.21.15.17:0/4258179353 >> v2:172.21.15.17:3300/0 conn(0x7ff3b015eb60 0x7ff3b01627d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.103+0000 7ff3af7fe640 1 -- 172.21.15.17:0/4258179353 >> v1:172.21.15.17:6789/0 conn(0x7ff3b0162d10 legacy=0x7ff3b00cafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:53.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.103+0000 7ff3af7fe640 1 -- 172.21.15.17:0/4258179353 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3b00ca5e0 con 0x7ff3b0158d20 2024-09-05T07:29:53.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.105+0000 7ff3af7fe640 1 --2- 172.21.15.17:0/4258179353 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3b0158d20 0x7ff3b00ca0a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0072400 tx=0x7ff3a002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=641f4aa77440f9dd server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:53.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.109+0000 7ff3ae7fc640 1 -- 172.21.15.17:0/4258179353 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a0037070 con 0x7ff3b0158d20 2024-09-05T07:29:53.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.109+0000 7ff3ae7fc640 1 -- 172.21.15.17:0/4258179353 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3a0032440 con 0x7ff3b0158d20 2024-09-05T07:29:53.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.109+0000 7ff3ae7fc640 1 -- 172.21.15.17:0/4258179353 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a0032810 con 0x7ff3b0158d20 2024-09-05T07:29:53.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.110+0000 7ff3b60ba640 1 -- 172.21.15.17:0/4258179353 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3b0158d20 msgr2=0x7ff3b00ca0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:53.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.110+0000 7ff3b60ba640 1 --2- 172.21.15.17:0/4258179353 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3b0158d20 0x7ff3b00ca0a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0072400 tx=0x7ff3a002a230 comp rx=0 tx=0).stop 2024-09-05T07:29:53.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.110+0000 7ff3b60ba640 1 -- 172.21.15.17:0/4258179353 shutdown_connections 2024-09-05T07:29:53.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.110+0000 7ff3b60ba640 1 --2- 172.21.15.17:0/4258179353 >> v2:172.21.15.17:3300/0 conn(0x7ff3b015eb60 0x7ff3b01627d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.110+0000 7ff3b60ba640 1 --2- 172.21.15.17:0/4258179353 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3b0158d20 0x7ff3b00ca0a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.110+0000 7ff3b60ba640 1 -- 172.21.15.17:0/4258179353 >> 172.21.15.17:0/4258179353 conn(0x7ff3b0071670 msgr2=0x7ff3b0071a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:53.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.110+0000 7ff3b60ba640 1 -- 172.21.15.17:0/4258179353 shutdown_connections 2024-09-05T07:29:53.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.110+0000 7ff3b60ba640 1 -- 172.21.15.17:0/4258179353 wait complete. 2024-09-05T07:29:53.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.111+0000 7ff3b60ba640 1 Processor -- start 2024-09-05T07:29:53.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.111+0000 7ff3b60ba640 1 -- start start 2024-09-05T07:29:53.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.112+0000 7ff3b60ba640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3b0158d20 0x7ff3b01495e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.112+0000 7ff3b60ba640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff3b0162d10 0x7ff3b015fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.112+0000 7ff3b60ba640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3b01605c0 0x7ff3b015fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.112+0000 7ff3b60ba640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b015f870 con 0x7ff3b01605c0 2024-09-05T07:29:53.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.112+0000 7ff3b60ba640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b015f590 con 0x7ff3b0158d20 2024-09-05T07:29:53.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.112+0000 7ff3b60ba640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7ff3b01622b0 con 0x7ff3b0162d10 2024-09-05T07:29:53.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.113+0000 7ff3affff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3b01605c0 0x7ff3b015fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.113+0000 7ff3af7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3b0158d20 0x7ff3b01495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.113+0000 7ff3aeffd640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff3b0162d10 0x7ff3b015fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.113+0000 7ff3af7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3b0158d20 0x7ff3b01495e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:58520/0 (socket says 172.21.15.17:58520) 2024-09-05T07:29:53.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.113+0000 7ff3af7fe640 1 -- 172.21.15.17:0/4076177309 learned_addr learned my addr 172.21.15.17:0/4076177309 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:53.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.116+0000 7ff3af7fe640 1 -- 172.21.15.17:0/4076177309 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff3b0162d10 msgr2=0x7ff3b015fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:53.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.116+0000 7ff3af7fe640 1 --2- 172.21.15.17:0/4076177309 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff3b0162d10 0x7ff3b015fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.116+0000 7ff3af7fe640 1 -- 172.21.15.17:0/4076177309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3b01605c0 msgr2=0x7ff3b015fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:53.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.116+0000 7ff3af7fe640 1 --2- 172.21.15.17:0/4076177309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3b01605c0 0x7ff3b015fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.116+0000 7ff3af7fe640 1 -- 172.21.15.17:0/4076177309 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3b015dd20 con 0x7ff3b0158d20 2024-09-05T07:29:53.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.119+0000 7ff3af7fe640 1 --2- 172.21.15.17:0/4076177309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3b0158d20 0x7ff3b01495e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0000c00 tx=0x7ff3a00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:53.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.122+0000 7ff397fff640 1 -- 172.21.15.17:0/4076177309 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a0041020 con 0x7ff3b0158d20 2024-09-05T07:29:53.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.122+0000 7ff397fff640 1 -- 172.21.15.17:0/4076177309 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3a0030720 con 0x7ff3b0158d20 2024-09-05T07:29:53.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.122+0000 7ff3b60ba640 1 -- 172.21.15.17:0/4076177309 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3b015e000 con 0x7ff3b0158d20 2024-09-05T07:29:53.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.122+0000 7ff397fff640 1 -- 172.21.15.17:0/4076177309 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a0037040 con 0x7ff3b0158d20 2024-09-05T07:29:53.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.123+0000 7ff3b60ba640 1 -- 172.21.15.17:0/4076177309 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3b015e5c0 con 0x7ff3b0158d20 2024-09-05T07:29:53.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.125+0000 7ff3b8e5a740 1 Processor -- start 2024-09-05T07:29:53.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.125+0000 7ff3b8e5a740 1 -- start start 2024-09-05T07:29:53.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.126+0000 7ff3b8e5a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56220df3b750 0x56220df739e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.126+0000 7ff3b8e5a740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56220df38f80 0x56220df73f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.126+0000 7ff3b8e5a740 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x56220df3bb30 0x56220df37a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.126+0000 7ff3b8e5a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56220de9c520 con 0x56220df3b750 2024-09-05T07:29:53.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.126+0000 7ff3b8e5a740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x56220de443e0 con 0x56220df38f80 2024-09-05T07:29:53.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.126+0000 7ff3b8e5a740 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x56220de984e0 con 0x56220df3bb30 2024-09-05T07:29:53.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.127+0000 7ff3affff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56220df3b750 0x56220df739e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.127+0000 7ff3aeffd640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x56220df3bb30 0x56220df37a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.127+0000 7ff3affff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56220df3b750 0x56220df739e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56470/0 (socket says 172.21.15.17:56470) 2024-09-05T07:29:53.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.127+0000 7ff3affff640 1 -- 172.21.15.17:0/182049305 learned_addr learned my addr 172.21.15.17:0/182049305 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:53.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.129+0000 7ff3affff640 1 -- 172.21.15.17:0/182049305 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x56220df3bb30 msgr2=0x56220df37a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:53.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.129+0000 7ff3affff640 1 --2- 172.21.15.17:0/182049305 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x56220df3bb30 0x56220df37a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.129+0000 7ff3affff640 1 -- 172.21.15.17:0/182049305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56220df38f80 msgr2=0x56220df73f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:53.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.129+0000 7ff3affff640 1 --2- 172.21.15.17:0/182049305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56220df38f80 0x56220df73f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.129+0000 7ff3affff640 1 -- 172.21.15.17:0/182049305 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56220de5f2f0 con 0x56220df3b750 2024-09-05T07:29:53.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.131+0000 7ff3affff640 1 --2- 172.21.15.17:0/182049305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56220df3b750 0x56220df739e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff3a800b530 tx=0x7ff3a8009630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c73e022cd30cc339 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:53.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.135+0000 7ff3957fa640 1 -- 172.21.15.17:0/182049305 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a8003970 con 0x56220df3b750 2024-09-05T07:29:53.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.135+0000 7ff3957fa640 1 -- 172.21.15.17:0/182049305 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3a8003b10 con 0x56220df3b750 2024-09-05T07:29:53.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.135+0000 7ff3957fa640 1 -- 172.21.15.17:0/182049305 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a800a7f0 con 0x56220df3b750 2024-09-05T07:29:53.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.136+0000 7ff3b8e5a740 1 -- 172.21.15.17:0/182049305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56220df3b750 msgr2=0x56220df739e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:53.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.136+0000 7ff3b8e5a740 1 --2- 172.21.15.17:0/182049305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56220df3b750 0x56220df739e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff3a800b530 tx=0x7ff3a8009630 comp rx=0 tx=0).stop 2024-09-05T07:29:53.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.136+0000 7ff3b8e5a740 1 -- 172.21.15.17:0/182049305 shutdown_connections 2024-09-05T07:29:53.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.136+0000 7ff3b8e5a740 1 --2- 172.21.15.17:0/182049305 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x56220df3bb30 0x56220df37a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.136+0000 7ff3b8e5a740 1 --2- 172.21.15.17:0/182049305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56220df38f80 0x56220df73f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.136+0000 7ff3b8e5a740 1 --2- 172.21.15.17:0/182049305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56220df3b750 0x56220df739e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.136+0000 7ff3b8e5a740 1 -- 172.21.15.17:0/182049305 >> 172.21.15.17:0/182049305 conn(0x56220df39e70 msgr2=0x56220df3a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:53.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.136+0000 7ff3b8e5a740 1 -- 172.21.15.17:0/182049305 shutdown_connections 2024-09-05T07:29:53.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.136+0000 7ff3b8e5a740 1 -- 172.21.15.17:0/182049305 wait complete. 2024-09-05T07:29:53.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.136+0000 7ff3b8e5a740 1 -- start start 2024-09-05T07:29:53.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.136+0000 7ff3b8e5a740 1 Processor -- start 2024-09-05T07:29:53.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.137+0000 7ff3b8e5a740 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x56220df38f80 0x56220df61a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.137+0000 7ff3b8e5a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56220df3b750 0x56220df5e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.137+0000 7ff3b8e5a740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56220df3bb30 0x56220df6b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.137+0000 7ff3b8e5a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56220df3afe0 con 0x56220df3b750 2024-09-05T07:29:53.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.137+0000 7ff3b8e5a740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x56220de25450 con 0x56220df3bb30 2024-09-05T07:29:53.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.137+0000 7ff3b8e5a740 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x56220df73550 con 0x56220df38f80 2024-09-05T07:29:53.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.137+0000 7ff3b8e5a740 10 client.0 _ll_register_callbacks cb 0x56220dbaeac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:29:53.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.138+0000 7ff3affff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x56220df38f80 0x56220df61a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.138+0000 7ff3af7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56220df3b750 0x56220df5e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.138+0000 7ff3affff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x56220df38f80 0x56220df61a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:49458/0 (socket says 172.21.15.17:49458) 2024-09-05T07:29:53.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.138+0000 7ff3affff640 1 -- 172.21.15.17:0/4256055458 learned_addr learned my addr 172.21.15.17:0/4256055458 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:53.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.141+0000 7ff3affff640 1 -- 172.21.15.17:0/4256055458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56220df3bb30 msgr2=0x56220df6b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:53.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.141+0000 7ff3affff640 1 --2- 172.21.15.17:0/4256055458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56220df3bb30 0x56220df6b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.141+0000 7ff3affff640 1 -- 172.21.15.17:0/4256055458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56220df3b750 msgr2=0x56220df5e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:53.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.141+0000 7ff3affff640 1 --2- 172.21.15.17:0/4256055458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56220df3b750 0x56220df5e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.141+0000 7ff3affff640 1 -- 172.21.15.17:0/4256055458 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x56220dbaf2d0 con 0x56220df38f80 2024-09-05T07:29:53.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.143+0000 7ff3affff640 1 --2- 172.21.15.17:0/4256055458 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x56220df38f80 0x56220df61a50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff3a800be80 tx=0x7ff3a8004a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a206313000fa888 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:53.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.143+0000 7ff38e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.26:3301/0 2024-09-05T07:29:53.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.146+0000 7ff397fff640 1 -- 172.21.15.17:0/4076177309 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff3a0044020 con 0x7ff3b0158d20 2024-09-05T07:29:53.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.146+0000 7ff38e7fc640 1 -- 172.21.15.17:0/4256055458 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a800a7f0 con 0x56220df38f80 2024-09-05T07:29:53.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.146+0000 7ff38e7fc640 1 -- 172.21.15.17:0/4256055458 <== mon.2 v2:172.21.15.26:3301/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff3a800a990 con 0x56220df38f80 2024-09-05T07:29:53.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.146+0000 7ff3b8e5a740 1 -- 172.21.15.17:0/4256055458 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3a8003b10 con 0x56220df38f80 2024-09-05T07:29:53.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.147+0000 7ff397fff640 1 --2- 172.21.15.17:0/4076177309 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7ff39c06bdf0 0x7ff39c06e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.147+0000 7ff3af7fe640 1 --2- 172.21.15.17:0/4076177309 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7ff39c06bdf0 0x7ff39c06e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.147+0000 7ff3af7fe640 1 --2- 172.21.15.17:0/4076177309 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7ff39c06bdf0 0x7ff39c06e2b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0082220 tx=0x7ff3a00094d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:53.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.148+0000 7ff38e7fc640 1 -- 172.21.15.17:0/4256055458 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7ff3a802f050 con 0x56220df38f80 2024-09-05T07:29:53.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.149+0000 7ff3b8e5a740 10 client.4442 fetch_fsmap learned FSMap version 18 2024-09-05T07:29:53.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.149+0000 7ff3b8e5a740 1 -- 172.21.15.17:0/4256055458 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x56220dc796b0 con 0x56220df38f80 2024-09-05T07:29:53.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.151+0000 7ff397fff640 1 -- 172.21.15.17:0/4076177309 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff3a00a9f00 con 0x7ff3b0158d20 2024-09-05T07:29:53.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.151+0000 7ff38e7fc640 1 -- 172.21.15.17:0/4256055458 <== mon.2 v2:172.21.15.26:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3a8003b10 con 0x56220df38f80 2024-09-05T07:29:53.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.154+0000 7ff38e7fc640 1 -- 172.21.15.17:0/4256055458 <== mon.2 v2:172.21.15.26:3301/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7ff3a8032020 con 0x56220df38f80 2024-09-05T07:29:53.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.154+0000 7ff3b8e5a740 10 client.4442 fetch_fsmap finished waiting for FSMap version 18 2024-09-05T07:29:53.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.154+0000 7ff3b8e5a740 10 client.4442 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-05T07:29:53.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.154+0000 7ff3b8e5a740 20 client.4442 populate_metadata read hostname 'smithi017' 2024-09-05T07:29:53.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.154+0000 7ff3b8e5a740 1 --2- 172.21.15.17:0/4256055458 >> [v2:172.21.15.26:6838/914231229,v1:172.21.15.26:6839/914231229] conn(0x56220df8ea60 0x56220df5be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.154+0000 7ff3b8e5a740 4 client.4442 mds_command: new command op to 4233 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T07:29:53.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.154+0000 7ff3b8e5a740 1 -- 172.21.15.17:0/4256055458 --> [v2:172.21.15.26:6838/914231229,v1:172.21.15.26:6839/914231229] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56220dea9c50 con 0x56220df8ea60 2024-09-05T07:29:53.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.155+0000 7ff3aeffd640 1 --2- 172.21.15.17:0/4256055458 >> [v2:172.21.15.26:6838/914231229,v1:172.21.15.26:6839/914231229] conn(0x56220df8ea60 0x56220df5be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.203+0000 7ff3aeffd640 1 --2- 172.21.15.17:0/4256055458 >> [v2:172.21.15.26:6838/914231229,v1:172.21.15.26:6839/914231229] conn(0x56220df8ea60 0x56220df5be40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b9324dbd46553c6f server_cookie=7f3a522d1eead467 in_seq=0 out_seq=0 2024-09-05T07:29:53.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.203+0000 7ff38e7fc640 10 client.4442 ms_handle_connect on v2:172.21.15.26:6838/914231229 2024-09-05T07:29:53.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.329+0000 7ff38e7fc640 1 -- 172.21.15.17:0/4256055458 <== mds.3 v2:172.21.15.26:6838/914231229 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56220dea9c50 con 0x56220df8ea60 2024-09-05T07:29:53.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.329+0000 7ff38e7fc640 10 client.4442 handle_command_reply: tid=0 2024-09-05T07:29:53.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.329+0000 7ff3b8e5a740 1 client.4442 shutdown 2024-09-05T07:29:53.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.329+0000 7ff3b8e5a740 1 -- 172.21.15.17:0/4256055458 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x56220df38f80 msgr2=0x56220df61a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:53.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.329+0000 7ff3b8e5a740 1 --2- 172.21.15.17:0/4256055458 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x56220df38f80 0x56220df61a50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff3a800be80 tx=0x7ff3a8004a00 comp rx=0 tx=0).stop 2024-09-05T07:29:53.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.329+0000 7ff3b8e5a740 1 -- 172.21.15.17:0/4256055458 shutdown_connections 2024-09-05T07:29:53.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.329+0000 7ff3b8e5a740 1 --2- 172.21.15.17:0/4256055458 >> [v2:172.21.15.26:6838/914231229,v1:172.21.15.26:6839/914231229] conn(0x56220df8ea60 0x56220df5be40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.329+0000 7ff3b8e5a740 1 --2- 172.21.15.17:0/4256055458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56220df3bb30 0x56220df6b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.329+0000 7ff3b8e5a740 1 --2- 172.21.15.17:0/4256055458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56220df3b750 0x56220df5e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.329+0000 7ff3b8e5a740 1 --2- 172.21.15.17:0/4256055458 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x56220df38f80 0x56220df61a50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.329+0000 7ff38e7fc640 0 client.4442 ms_handle_reset on v2:172.21.15.26:6838/914231229 2024-09-05T07:29:53.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.329+0000 7ff3b8e5a740 1 -- 172.21.15.17:0/4256055458 >> 172.21.15.17:0/4256055458 conn(0x56220df39e70 msgr2=0x56220df39380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:53.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.329+0000 7ff3b8e5a740 1 -- 172.21.15.17:0/4256055458 shutdown_connections 2024-09-05T07:29:53.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.329+0000 7ff3b8e5a740 1 -- 172.21.15.17:0/4256055458 wait complete. 2024-09-05T07:29:53.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.329+0000 7ff3b8e5a740 20 client.4442 trim_cache size 0 max 16384 2024-09-05T07:29:53.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.347+0000 7ff3b8e5a740 1 Processor -- start 2024-09-05T07:29:53.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.347+0000 7ff3b8e5a740 1 -- start start 2024-09-05T07:29:53.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.348+0000 7ff3b8e5a740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56220df38f80 0x56220df6af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.348+0000 7ff3b8e5a740 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x56220df3b750 0x56220df6b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.348+0000 7ff3b8e5a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56220df3bb30 0x56220df6c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.348+0000 7ff3b8e5a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b015c7c0 con 0x56220df3bb30 2024-09-05T07:29:53.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.348+0000 7ff3b8e5a740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x56220df5d650 con 0x56220df38f80 2024-09-05T07:29:53.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.348+0000 7ff3b8e5a740 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x56220df5dbb0 con 0x56220df3b750 2024-09-05T07:29:53.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.349+0000 7ff3affff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56220df3bb30 0x56220df6c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.349+0000 7ff3aeffd640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x56220df3b750 0x56220df6b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.349+0000 7ff3affff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56220df38f80 0x56220df6af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.349+0000 7ff3aeffd640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x56220df3b750 0x56220df6b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:49460/0 (socket says 172.21.15.17:49460) 2024-09-05T07:29:53.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.349+0000 7ff3aeffd640 1 -- 172.21.15.17:0/3222461701 learned_addr learned my addr 172.21.15.17:0/3222461701 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:53.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.351+0000 7ff3affff640 1 -- 172.21.15.17:0/3222461701 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x56220df3b750 msgr2=0x56220df6b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:53.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.351+0000 7ff3affff640 1 --2- 172.21.15.17:0/3222461701 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x56220df3b750 0x56220df6b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.351+0000 7ff3affff640 1 -- 172.21.15.17:0/3222461701 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56220df38f80 msgr2=0x56220df6af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:53.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.351+0000 7ff3affff640 1 --2- 172.21.15.17:0/3222461701 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56220df38f80 0x56220df6af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.351+0000 7ff3affff640 1 -- 172.21.15.17:0/3222461701 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56220df37580 con 0x56220df3bb30 2024-09-05T07:29:53.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.353+0000 7ff3affff640 1 --2- 172.21.15.17:0/3222461701 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56220df3bb30 0x56220df6c040 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff3a800ac40 tx=0x7ff3a8020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=811d9720f6e5a0e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:53.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.357+0000 7ff394ff9640 1 -- 172.21.15.17:0/3222461701 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a802c070 con 0x56220df3bb30 2024-09-05T07:29:53.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.357+0000 7ff394ff9640 1 -- 172.21.15.17:0/3222461701 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3a8009c40 con 0x56220df3bb30 2024-09-05T07:29:53.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.357+0000 7ff394ff9640 1 -- 172.21.15.17:0/3222461701 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a800a7f0 con 0x56220df3bb30 2024-09-05T07:29:53.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.358+0000 7ff3b8e5a740 1 -- 172.21.15.17:0/3222461701 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56220df3bb30 msgr2=0x56220df6c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:53.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.358+0000 7ff3b8e5a740 1 --2- 172.21.15.17:0/3222461701 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56220df3bb30 0x56220df6c040 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff3a800ac40 tx=0x7ff3a8020000 comp rx=0 tx=0).stop 2024-09-05T07:29:53.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.358+0000 7ff3b8e5a740 1 -- 172.21.15.17:0/3222461701 shutdown_connections 2024-09-05T07:29:53.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.358+0000 7ff3b8e5a740 1 --2- 172.21.15.17:0/3222461701 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x56220df3b750 0x56220df6b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.358+0000 7ff3b8e5a740 1 --2- 172.21.15.17:0/3222461701 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56220df3bb30 0x56220df6c040 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.358+0000 7ff3b8e5a740 1 --2- 172.21.15.17:0/3222461701 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56220df38f80 0x56220df6af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.358+0000 7ff3b8e5a740 1 -- 172.21.15.17:0/3222461701 >> 172.21.15.17:0/3222461701 conn(0x56220df39e70 msgr2=0x56220df6eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:53.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.358+0000 7ff3b8e5a740 1 -- 172.21.15.17:0/3222461701 shutdown_connections 2024-09-05T07:29:53.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.358+0000 7ff3b8e5a740 1 -- 172.21.15.17:0/3222461701 wait complete. 2024-09-05T07:29:53.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.358+0000 7ff3b8e5a740 1 -- start start 2024-09-05T07:29:53.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.358+0000 7ff3b8e5a740 1 Processor -- start 2024-09-05T07:29:53.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.359+0000 7ff3b8e5a740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56220df38f80 0x56220dff2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.359+0000 7ff3b8e5a740 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x56220df3b750 0x56220dff3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.359+0000 7ff3b8e5a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56220df3bb30 0x56220df61b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.359+0000 7ff3b8e5a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56220df6e890 con 0x56220df3bb30 2024-09-05T07:29:53.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.359+0000 7ff3b8e5a740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x56220df6bab0 con 0x56220df38f80 2024-09-05T07:29:53.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.359+0000 7ff3b8e5a740 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x56220df8ef40 con 0x56220df3b750 2024-09-05T07:29:53.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.359+0000 7ff3b8e5a740 10 client.0 _ll_register_callbacks cb 0x7ff3a4009710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:29:53.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.360+0000 7ff3affff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56220df3bb30 0x56220df61b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.360+0000 7ff3affff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56220df38f80 0x56220dff2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.360+0000 7ff3aeffd640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x56220df3b750 0x56220dff3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.360+0000 7ff3affff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56220df3bb30 0x56220df61b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56488/0 (socket says 172.21.15.17:56488) 2024-09-05T07:29:53.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.360+0000 7ff3affff640 1 -- 172.21.15.17:0/1622584262 learned_addr learned my addr 172.21.15.17:0/1622584262 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:53.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.363+0000 7ff3affff640 1 -- 172.21.15.17:0/1622584262 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x56220df3b750 msgr2=0x56220dff3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:53.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.363+0000 7ff3affff640 1 --2- 172.21.15.17:0/1622584262 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x56220df3b750 0x56220dff3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.363+0000 7ff3affff640 1 -- 172.21.15.17:0/1622584262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56220df38f80 msgr2=0x56220dff2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:53.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.363+0000 7ff3affff640 1 --2- 172.21.15.17:0/1622584262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56220df38f80 0x56220dff2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.363+0000 7ff3affff640 1 -- 172.21.15.17:0/1622584262 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56220df6b690 con 0x56220df3bb30 2024-09-05T07:29:53.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.365+0000 7ff3affff640 1 --2- 172.21.15.17:0/1622584262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56220df3bb30 0x56220df61b10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff3a800bfd0 tx=0x7ff3a8004a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4deb3c3be5d373de server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:53.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.365+0000 7ff38e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-05T07:29:53.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.369+0000 7ff38e7fc640 1 -- 172.21.15.17:0/1622584262 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a802c070 con 0x56220df3bb30 2024-09-05T07:29:53.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.369+0000 7ff38e7fc640 1 -- 172.21.15.17:0/1622584262 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff3a8034aa0 con 0x56220df3bb30 2024-09-05T07:29:53.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.369+0000 7ff3b8e5a740 1 -- 172.21.15.17:0/1622584262 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3a8009c40 con 0x56220df3bb30 2024-09-05T07:29:53.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.371+0000 7ff38e7fc640 1 -- 172.21.15.17:0/1622584262 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7ff3a8034ca0 con 0x56220df3bb30 2024-09-05T07:29:53.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.371+0000 7ff3b8e5a740 10 client.4479 fetch_fsmap learned FSMap version 18 2024-09-05T07:29:53.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.371+0000 7ff3b8e5a740 1 -- 172.21.15.17:0/1622584262 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x56220dffc8c0 con 0x56220df3bb30 2024-09-05T07:29:53.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.375+0000 7ff38e7fc640 1 -- 172.21.15.17:0/1622584262 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3a8009c40 con 0x56220df3bb30 2024-09-05T07:29:53.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.375+0000 7ff38e7fc640 1 -- 172.21.15.17:0/1622584262 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7ff3a8009030 con 0x56220df3bb30 2024-09-05T07:29:53.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.375+0000 7ff3b8e5a740 10 client.4479 fetch_fsmap finished waiting for FSMap version 18 2024-09-05T07:29:53.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.375+0000 7ff3b8e5a740 10 client.4479 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-05T07:29:53.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.375+0000 7ff3b8e5a740 20 client.4479 populate_metadata read hostname 'smithi017' 2024-09-05T07:29:53.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.375+0000 7ff3b8e5a740 1 --2- 172.21.15.17:0/1622584262 >> [v2:172.21.15.26:6838/914231229,v1:172.21.15.26:6839/914231229] conn(0x56220df73920 0x56220df73d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.375+0000 7ff3b8e5a740 4 client.4479 mds_command: new command op to 4233 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-05T07:29:53.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.375+0000 7ff3b8e5a740 1 -- 172.21.15.17:0/1622584262 --> [v2:172.21.15.26:6838/914231229,v1:172.21.15.26:6839/914231229] -- command(tid 0: {"prefix": "status"}) -- 0x56220df35ce0 con 0x56220df73920 2024-09-05T07:29:53.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.376+0000 7ff3aeffd640 1 --2- 172.21.15.17:0/1622584262 >> [v2:172.21.15.26:6838/914231229,v1:172.21.15.26:6839/914231229] conn(0x56220df73920 0x56220df73d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.379+0000 7ff3aeffd640 1 --2- 172.21.15.17:0/1622584262 >> [v2:172.21.15.26:6838/914231229,v1:172.21.15.26:6839/914231229] conn(0x56220df73920 0x56220df73d00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=41eb06425224df4a server_cookie=281a39830303554d in_seq=0 out_seq=0 2024-09-05T07:29:53.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.379+0000 7ff38e7fc640 10 client.4479 ms_handle_connect on v2:172.21.15.26:6838/914231229 2024-09-05T07:29:53.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.397+0000 7ff38e7fc640 1 -- 172.21.15.17:0/1622584262 <== mds.3 v2:172.21.15.26:6838/914231229 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x56220df35ce0 con 0x56220df73920 2024-09-05T07:29:53.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.397+0000 7ff38e7fc640 10 client.4479 handle_command_reply: tid=0 2024-09-05T07:29:53.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.397+0000 7ff3b8e5a740 1 client.4479 shutdown 2024-09-05T07:29:53.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.397+0000 7ff3b8e5a740 1 -- 172.21.15.17:0/1622584262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56220df3bb30 msgr2=0x56220df61b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:53.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.397+0000 7ff3b8e5a740 1 --2- 172.21.15.17:0/1622584262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56220df3bb30 0x56220df61b10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff3a800bfd0 tx=0x7ff3a8004a00 comp rx=0 tx=0).stop 2024-09-05T07:29:53.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.397+0000 7ff3b8e5a740 1 -- 172.21.15.17:0/1622584262 shutdown_connections 2024-09-05T07:29:53.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.397+0000 7ff3b8e5a740 1 --2- 172.21.15.17:0/1622584262 >> [v2:172.21.15.26:6838/914231229,v1:172.21.15.26:6839/914231229] conn(0x56220df73920 0x56220df73d00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.397+0000 7ff3b8e5a740 1 --2- 172.21.15.17:0/1622584262 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x56220df3b750 0x56220dff3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.397+0000 7ff3b8e5a740 1 --2- 172.21.15.17:0/1622584262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56220df3bb30 0x56220df61b10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.397+0000 7ff38e7fc640 0 client.4479 ms_handle_reset on v2:172.21.15.26:6838/914231229 2024-09-05T07:29:53.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.397+0000 7ff3b8e5a740 1 --2- 172.21.15.17:0/1622584262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56220df38f80 0x56220dff2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.397+0000 7ff3b8e5a740 1 -- 172.21.15.17:0/1622584262 >> 172.21.15.17:0/1622584262 conn(0x56220df39e70 msgr2=0x56220df39360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:53.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.397+0000 7ff3b8e5a740 1 -- 172.21.15.17:0/1622584262 shutdown_connections 2024-09-05T07:29:53.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.397+0000 7ff3b8e5a740 1 -- 172.21.15.17:0/1622584262 wait complete. 2024-09-05T07:29:53.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.397+0000 7ff3b8e5a740 20 client.4479 trim_cache size 0 max 16384 2024-09-05T07:29:53.400 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-05T07:29:53.400 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "848dac54-74f8-48f3-8686-c6495dcb972b", 2024-09-05T07:29:53.400 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 3, 2024-09-05T07:29:53.400 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4233, 2024-09-05T07:29:53.400 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-05T07:29:53.400 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-05T07:29:53.401 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-05T07:29:53.401 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 8.2635300810000007, 2024-09-05T07:29:53.401 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 18, 2024-09-05T07:29:53.401 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 22, 2024-09-05T07:29:53.401 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 22, 2024-09-05T07:29:53.401 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 28.878741161000001 2024-09-05T07:29:53.401 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-05T07:29:53.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.398+0000 7ff3b60ba640 1 -- 172.21.15.17:0/4076177309 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7ff39c06bdf0 msgr2=0x7ff39c06e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:53.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.398+0000 7ff3b60ba640 1 --2- 172.21.15.17:0/4076177309 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7ff39c06bdf0 0x7ff39c06e2b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0082220 tx=0x7ff3a00094d0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.398+0000 7ff3b60ba640 1 -- 172.21.15.17:0/4076177309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3b0158d20 msgr2=0x7ff3b01495e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:53.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.398+0000 7ff3b60ba640 1 --2- 172.21.15.17:0/4076177309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3b0158d20 0x7ff3b01495e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0000c00 tx=0x7ff3a00046c0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.398+0000 7ff3b60ba640 1 -- 172.21.15.17:0/4076177309 shutdown_connections 2024-09-05T07:29:53.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.398+0000 7ff3b60ba640 1 --2- 172.21.15.17:0/4076177309 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7ff39c06bdf0 0x7ff39c06e2b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.398+0000 7ff3b60ba640 1 --2- 172.21.15.17:0/4076177309 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff3b0162d10 0x7ff3b015fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.398+0000 7ff3b60ba640 1 --2- 172.21.15.17:0/4076177309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3b01605c0 0x7ff3b015fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.398+0000 7ff3b60ba640 1 --2- 172.21.15.17:0/4076177309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3b0158d20 0x7ff3b01495e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.398+0000 7ff3b60ba640 1 -- 172.21.15.17:0/4076177309 >> 172.21.15.17:0/4076177309 conn(0x7ff3b0071670 msgr2=0x7ff3b00b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:53.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.398+0000 7ff3b60ba640 1 -- 172.21.15.17:0/4076177309 shutdown_connections 2024-09-05T07:29:53.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.398+0000 7ff3b60ba640 1 -- 172.21.15.17:0/4076177309 wait complete. 2024-09-05T07:29:53.410 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-05T07:29:53.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.511+0000 7f06a75f6640 1 Processor -- start 2024-09-05T07:29:53.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.511+0000 7f06a75f6640 1 -- start start 2024-09-05T07:29:53.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.512+0000 7f06a75f6640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f06a00ccef0 0x7f06a00b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.512+0000 7f06a75f6640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06a00b3b20 con 0x7f06a00cd2d0 2024-09-05T07:29:53.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.512+0000 7f06a75f6640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06a015b590 con 0x7f06a00b43b0 2024-09-05T07:29:53.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.512+0000 7f06a75f6640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f06a00b2d60 con 0x7f06a00ccef0 2024-09-05T07:29:53.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.512+0000 7f06a5392640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f06a00ccef0 0x7f06a00b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.512+0000 7f06a4b91640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f06a00b43b0 0x7f06a0157800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.17:59090/0 (socket says 172.21.15.17:59090) 2024-09-05T07:29:53.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.512+0000 7f06a4b91640 1 -- 172.21.15.17:0/4273396389 learned_addr learned my addr 172.21.15.17:0/4273396389 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:29:53.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.515+0000 7f069ffff640 1 -- 172.21.15.17:0/4273396389 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2105827030 0 0) 0x7f06a015b590 con 0x7f06a00b43b0 2024-09-05T07:29:53.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.515+0000 7f069ffff640 1 -- 172.21.15.17:0/4273396389 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0688003520 con 0x7f06a00b43b0 2024-09-05T07:29:53.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.517+0000 7f06a5392640 1 -- 172.21.15.17:0/4273396389 >> v1:172.21.15.26:6789/0 conn(0x7f06a00b43b0 legacy=0x7f06a0157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:53.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.517+0000 7f06a5392640 1 -- 172.21.15.17:0/4273396389 >> v1:172.21.15.17:6789/0 conn(0x7f06a00cd2d0 legacy=0x7f06a015a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:53.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.517+0000 7f06a5392640 1 -- 172.21.15.17:0/4273396389 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06a00b3040 con 0x7f06a00ccef0 2024-09-05T07:29:53.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.521+0000 7f06a5392640 1 --2- 172.21.15.17:0/4273396389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06a00ccef0 0x7f06a00b3e70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f06980097d0 tx=0x7f069802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f92d6f284707acf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:53.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.524+0000 7f069ffff640 1 -- 172.21.15.17:0/4273396389 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0698037070 con 0x7f06a00ccef0 2024-09-05T07:29:53.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.524+0000 7f069ffff640 1 -- 172.21.15.17:0/4273396389 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0698032440 con 0x7f06a00ccef0 2024-09-05T07:29:53.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.524+0000 7f069ffff640 1 -- 172.21.15.17:0/4273396389 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0698032810 con 0x7f06a00ccef0 2024-09-05T07:29:53.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.525+0000 7f06a75f6640 1 -- 172.21.15.17:0/4273396389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06a00ccef0 msgr2=0x7f06a00b3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:53.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.525+0000 7f06a75f6640 1 --2- 172.21.15.17:0/4273396389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06a00ccef0 0x7f06a00b3e70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f06980097d0 tx=0x7f069802a270 comp rx=0 tx=0).stop 2024-09-05T07:29:53.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.525+0000 7f06a75f6640 1 -- 172.21.15.17:0/4273396389 shutdown_connections 2024-09-05T07:29:53.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.525+0000 7f06a75f6640 1 --2- 172.21.15.17:0/4273396389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06a00ccef0 0x7f06a00b3e70 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.525+0000 7f06a75f6640 1 -- 172.21.15.17:0/4273396389 >> 172.21.15.17:0/4273396389 conn(0x7f06a0072230 msgr2=0x7f06a0072640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:53.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.525+0000 7f06a75f6640 1 -- 172.21.15.17:0/4273396389 shutdown_connections 2024-09-05T07:29:53.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.525+0000 7f06a75f6640 1 -- 172.21.15.17:0/4273396389 wait complete. 2024-09-05T07:29:53.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.526+0000 7f06a75f6640 1 Processor -- start 2024-09-05T07:29:53.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.527+0000 7f06a75f6640 1 -- start start 2024-09-05T07:29:53.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.527+0000 7f06a75f6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06a00b43b0 0x7f06a0154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.527+0000 7f06a75f6640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f06a00ccef0 0x7f06a0155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.527+0000 7f06a75f6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06a00cd2d0 0x7f06a0151630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.527+0000 7f06a75f6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f06a015dee0 con 0x7f06a00b43b0 2024-09-05T07:29:53.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.527+0000 7f06a75f6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f06a00b3600 con 0x7f06a00cd2d0 2024-09-05T07:29:53.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.527+0000 7f06a75f6640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f06a015e060 con 0x7f06a00ccef0 2024-09-05T07:29:53.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.528+0000 7f06a5392640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06a00b43b0 0x7f06a0154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.528+0000 7f06a5b93640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06a00cd2d0 0x7f06a0151630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.528+0000 7f06a4b91640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f06a00ccef0 0x7f06a0155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.528+0000 7f06a5392640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06a00b43b0 0x7f06a0154a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56498/0 (socket says 172.21.15.17:56498) 2024-09-05T07:29:53.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.528+0000 7f06a5392640 1 -- 172.21.15.17:0/762389475 learned_addr learned my addr 172.21.15.17:0/762389475 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:53.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.531+0000 7f06a5392640 1 -- 172.21.15.17:0/762389475 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f06a00ccef0 msgr2=0x7f06a0155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:53.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.531+0000 7f06a5392640 1 --2- 172.21.15.17:0/762389475 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f06a00ccef0 0x7f06a0155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.531+0000 7f06a5392640 1 -- 172.21.15.17:0/762389475 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06a00cd2d0 msgr2=0x7f06a0151630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:53.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.531+0000 7f06a5392640 1 --2- 172.21.15.17:0/762389475 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06a00cd2d0 0x7f06a0151630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.531+0000 7f06a5392640 1 -- 172.21.15.17:0/762389475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06a0154f50 con 0x7f06a00b43b0 2024-09-05T07:29:53.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.533+0000 7f06a5392640 1 --2- 172.21.15.17:0/762389475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06a00b43b0 0x7f06a0154a10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f069802a860 tx=0x7f06980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:53.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.537+0000 7f069dffb640 1 -- 172.21.15.17:0/762389475 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0698037040 con 0x7f06a00b43b0 2024-09-05T07:29:53.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.537+0000 7f069dffb640 1 -- 172.21.15.17:0/762389475 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0698042070 con 0x7f06a00b43b0 2024-09-05T07:29:53.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.537+0000 7f069dffb640 1 -- 172.21.15.17:0/762389475 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069803b930 con 0x7f06a00b43b0 2024-09-05T07:29:53.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.537+0000 7f06a75f6640 1 -- 172.21.15.17:0/762389475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06a01f0130 con 0x7f06a00b43b0 2024-09-05T07:29:53.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.537+0000 7f06a75f6640 1 -- 172.21.15.17:0/762389475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06a01f06b0 con 0x7f06a00b43b0 2024-09-05T07:29:53.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.540+0000 7f06aa46a740 1 Processor -- start 2024-09-05T07:29:53.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.540+0000 7f06aa46a740 1 -- start start 2024-09-05T07:29:53.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.541+0000 7f06aa46a740 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x558c21e2a750 0x558c21e629e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.541+0000 7f06aa46a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c21e27f80 0x558c21e62f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.541+0000 7f06aa46a740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558c21e2ab30 0x558c21e26a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.541+0000 7f06aa46a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x558c21d8b520 con 0x558c21e27f80 2024-09-05T07:29:53.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.541+0000 7f06aa46a740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x558c21d333e0 con 0x558c21e2ab30 2024-09-05T07:29:53.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.541+0000 7f06aa46a740 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x558c21d874e0 con 0x558c21e2a750 2024-09-05T07:29:53.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.541+0000 7f06a5b93640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x558c21e2a750 0x558c21e629e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.541+0000 7f06a4b91640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558c21e2ab30 0x558c21e26a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.541+0000 7f06a5b93640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x558c21e2a750 0x558c21e629e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:49488/0 (socket says 172.21.15.17:49488) 2024-09-05T07:29:53.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.542+0000 7f06a5b93640 1 -- 172.21.15.17:0/3680229030 learned_addr learned my addr 172.21.15.17:0/3680229030 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:53.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.544+0000 7f06a5b93640 1 -- 172.21.15.17:0/3680229030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558c21e2ab30 msgr2=0x558c21e26a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:53.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.544+0000 7f06a5b93640 1 --2- 172.21.15.17:0/3680229030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558c21e2ab30 0x558c21e26a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.544+0000 7f06a5b93640 1 -- 172.21.15.17:0/3680229030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c21e27f80 msgr2=0x558c21e62f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:53.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.544+0000 7f06a5b93640 1 --2- 172.21.15.17:0/3680229030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c21e27f80 0x558c21e62f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.544+0000 7f06a5b93640 1 -- 172.21.15.17:0/3680229030 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c21d4e2f0 con 0x558c21e2a750 2024-09-05T07:29:53.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.546+0000 7f06a5b93640 1 --2- 172.21.15.17:0/3680229030 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x558c21e2a750 0x558c21e629e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f06900017b0 tx=0x7f0690007db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc5a5c5e6f668155 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:53.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.548+0000 7f0686ffd640 1 -- 172.21.15.17:0/3680229030 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06900052e0 con 0x558c21e2a750 2024-09-05T07:29:53.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.549+0000 7f0686ffd640 1 -- 172.21.15.17:0/3680229030 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0690018070 con 0x558c21e2a750 2024-09-05T07:29:53.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.549+0000 7f0686ffd640 1 -- 172.21.15.17:0/3680229030 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069000f9b0 con 0x558c21e2a750 2024-09-05T07:29:53.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.550+0000 7f06aa46a740 1 -- 172.21.15.17:0/3680229030 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x558c21e2a750 msgr2=0x558c21e629e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:53.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.550+0000 7f06aa46a740 1 --2- 172.21.15.17:0/3680229030 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x558c21e2a750 0x558c21e629e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f06900017b0 tx=0x7f0690007db0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.550+0000 7f06aa46a740 1 -- 172.21.15.17:0/3680229030 shutdown_connections 2024-09-05T07:29:53.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.550+0000 7f06aa46a740 1 --2- 172.21.15.17:0/3680229030 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558c21e2ab30 0x558c21e26a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.550+0000 7f06aa46a740 1 --2- 172.21.15.17:0/3680229030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c21e27f80 0x558c21e62f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.550+0000 7f06aa46a740 1 --2- 172.21.15.17:0/3680229030 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x558c21e2a750 0x558c21e629e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.550+0000 7f06aa46a740 1 -- 172.21.15.17:0/3680229030 >> 172.21.15.17:0/3680229030 conn(0x558c21e28e70 msgr2=0x558c21e29270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:53.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.550+0000 7f06aa46a740 1 -- 172.21.15.17:0/3680229030 shutdown_connections 2024-09-05T07:29:53.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.550+0000 7f06aa46a740 1 -- 172.21.15.17:0/3680229030 wait complete. 2024-09-05T07:29:53.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.550+0000 7f06aa46a740 1 -- start start 2024-09-05T07:29:53.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.550+0000 7f06aa46a740 1 Processor -- start 2024-09-05T07:29:53.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.551+0000 7f06aa46a740 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x558c21e27f80 0x558c21e7a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.551+0000 7f06aa46a740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558c21e2a750 0x558c21e57400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.551+0000 7f06aa46a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c21e2ab30 0x558c21e5a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.551+0000 7f06aa46a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x558c21e29fe0 con 0x558c21e2ab30 2024-09-05T07:29:53.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.551+0000 7f06aa46a740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x558c21d14450 con 0x558c21e2a750 2024-09-05T07:29:53.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.551+0000 7f06aa46a740 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x558c21e62550 con 0x558c21e27f80 2024-09-05T07:29:53.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.551+0000 7f06aa46a740 10 client.0 _ll_register_callbacks cb 0x558c21a9dac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:29:53.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.552+0000 7f06a5b93640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x558c21e27f80 0x558c21e7a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.552+0000 7f06a5392640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558c21e2a750 0x558c21e57400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.552+0000 7f06a5b93640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x558c21e27f80 0x558c21e7a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:49492/0 (socket says 172.21.15.17:49492) 2024-09-05T07:29:53.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.552+0000 7f06a5b93640 1 -- 172.21.15.17:0/3121268622 learned_addr learned my addr 172.21.15.17:0/3121268622 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:53.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.555+0000 7f06a5b93640 1 -- 172.21.15.17:0/3121268622 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558c21e2a750 msgr2=0x558c21e57400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:53.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.555+0000 7f06a5b93640 1 --2- 172.21.15.17:0/3121268622 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558c21e2a750 0x558c21e57400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.555+0000 7f06a5b93640 1 -- 172.21.15.17:0/3121268622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c21e2ab30 msgr2=0x558c21e5a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:53.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.555+0000 7f06a5b93640 1 --2- 172.21.15.17:0/3121268622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c21e2ab30 0x558c21e5a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.555+0000 7f06a5b93640 1 -- 172.21.15.17:0/3121268622 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x558c21a9e2d0 con 0x558c21e27f80 2024-09-05T07:29:53.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.557+0000 7f06a5b93640 1 --2- 172.21.15.17:0/3121268622 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x558c21e27f80 0x558c21e7a370 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f069000f5a0 tx=0x7f0690000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=714e7610671a4ebd server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:53.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.557+0000 7f067bfff640 10 client.0 ms_handle_connect on v2:172.21.15.26:3301/0 2024-09-05T07:29:53.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.558+0000 7f069dffb640 1 -- 172.21.15.17:0/762389475 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f069803bad0 con 0x7f06a00b43b0 2024-09-05T07:29:53.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.559+0000 7f069dffb640 1 --2- 172.21.15.17:0/762389475 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f068c06bdf0 0x7f068c06e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.559+0000 7f06a5392640 1 --2- 172.21.15.17:0/762389475 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f068c06bdf0 0x7f068c06e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.559+0000 7f06a5392640 1 --2- 172.21.15.17:0/762389475 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f068c06bdf0 0x7f068c06e2b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0698009560 tx=0x7f06980094d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:53.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.561+0000 7f067bfff640 1 -- 172.21.15.17:0/3121268622 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0690010e90 con 0x558c21e27f80 2024-09-05T07:29:53.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.561+0000 7f067bfff640 1 -- 172.21.15.17:0/3121268622 <== mon.2 v2:172.21.15.26:3301/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f06900035f0 con 0x558c21e27f80 2024-09-05T07:29:53.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.561+0000 7f06aa46a740 1 -- 172.21.15.17:0/3121268622 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0690018070 con 0x558c21e27f80 2024-09-05T07:29:53.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.562+0000 7f069dffb640 1 -- 172.21.15.17:0/762389475 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f06980826e0 con 0x7f06a00b43b0 2024-09-05T07:29:53.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.562+0000 7f067bfff640 1 -- 172.21.15.17:0/3121268622 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f069002c050 con 0x558c21e27f80 2024-09-05T07:29:53.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.562+0000 7f06aa46a740 10 client.4457 fetch_fsmap learned FSMap version 18 2024-09-05T07:29:53.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.562+0000 7f06aa46a740 1 -- 172.21.15.17:0/3121268622 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x558c21b686b0 con 0x558c21e27f80 2024-09-05T07:29:53.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.566+0000 7f067bfff640 1 -- 172.21.15.17:0/3121268622 <== mon.2 v2:172.21.15.26:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0690018070 con 0x558c21e27f80 2024-09-05T07:29:53.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.566+0000 7f067bfff640 1 -- 172.21.15.17:0/3121268622 <== mon.2 v2:172.21.15.26:3301/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f069002f020 con 0x558c21e27f80 2024-09-05T07:29:53.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.566+0000 7f06aa46a740 10 client.4457 fetch_fsmap finished waiting for FSMap version 18 2024-09-05T07:29:53.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.566+0000 7f06aa46a740 10 client.4457 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-05T07:29:53.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.566+0000 7f06aa46a740 20 client.4457 populate_metadata read hostname 'smithi017' 2024-09-05T07:29:53.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.566+0000 7f06aa46a740 1 --2- 172.21.15.17:0/3121268622 >> [v2:172.21.15.17:6836/4100397916,v1:172.21.15.17:6837/4100397916] conn(0x558c21e50df0 0x558c21e884f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.567+0000 7f06aa46a740 4 client.4457 mds_command: new command op to 4241 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T07:29:53.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.567+0000 7f06aa46a740 1 -- 172.21.15.17:0/3121268622 --> [v2:172.21.15.17:6836/4100397916,v1:172.21.15.17:6837/4100397916] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c21d98c50 con 0x558c21e50df0 2024-09-05T07:29:53.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.567+0000 7f06a4b91640 1 --2- 172.21.15.17:0/3121268622 >> [v2:172.21.15.17:6836/4100397916,v1:172.21.15.17:6837/4100397916] conn(0x558c21e50df0 0x558c21e884f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.608+0000 7f067bfff640 10 client.4457 ms_handle_connect on v2:172.21.15.17:6836/4100397916 2024-09-05T07:29:53.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.608+0000 7f06a4b91640 1 --2- 172.21.15.17:0/3121268622 >> [v2:172.21.15.17:6836/4100397916,v1:172.21.15.17:6837/4100397916] conn(0x558c21e50df0 0x558c21e884f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7cae45c5381603ba server_cookie=23c81e90bf7d6f45 in_seq=0 out_seq=0 2024-09-05T07:29:53.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.723+0000 7f067bfff640 1 -- 172.21.15.17:0/3121268622 <== mds.2 v2:172.21.15.17:6836/4100397916 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558c21d98c50 con 0x558c21e50df0 2024-09-05T07:29:53.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.723+0000 7f067bfff640 10 client.4457 handle_command_reply: tid=0 2024-09-05T07:29:53.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.723+0000 7f06aa46a740 1 client.4457 shutdown 2024-09-05T07:29:53.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.724+0000 7f06aa46a740 1 -- 172.21.15.17:0/3121268622 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x558c21e27f80 msgr2=0x558c21e7a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:53.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.724+0000 7f06aa46a740 1 --2- 172.21.15.17:0/3121268622 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x558c21e27f80 0x558c21e7a370 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f069000f5a0 tx=0x7f0690000ed0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.724+0000 7f06aa46a740 1 -- 172.21.15.17:0/3121268622 shutdown_connections 2024-09-05T07:29:53.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.724+0000 7f06aa46a740 1 --2- 172.21.15.17:0/3121268622 >> [v2:172.21.15.17:6836/4100397916,v1:172.21.15.17:6837/4100397916] conn(0x558c21e50df0 0x558c21e884f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.724+0000 7f06aa46a740 1 --2- 172.21.15.17:0/3121268622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c21e2ab30 0x558c21e5a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.724+0000 7f06aa46a740 1 --2- 172.21.15.17:0/3121268622 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558c21e2a750 0x558c21e57400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.724+0000 7f067bfff640 0 client.4457 ms_handle_reset on v2:172.21.15.17:6836/4100397916 2024-09-05T07:29:53.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.724+0000 7f06aa46a740 1 --2- 172.21.15.17:0/3121268622 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x558c21e27f80 0x558c21e7a370 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.724+0000 7f06aa46a740 1 -- 172.21.15.17:0/3121268622 >> 172.21.15.17:0/3121268622 conn(0x558c21e28e70 msgr2=0x558c21e283c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:53.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.724+0000 7f06aa46a740 1 -- 172.21.15.17:0/3121268622 shutdown_connections 2024-09-05T07:29:53.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.724+0000 7f06aa46a740 1 -- 172.21.15.17:0/3121268622 wait complete. 2024-09-05T07:29:53.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.724+0000 7f06aa46a740 20 client.4457 trim_cache size 0 max 16384 2024-09-05T07:29:53.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.742+0000 7f06aa46a740 1 Processor -- start 2024-09-05T07:29:53.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.742+0000 7f06aa46a740 1 -- start start 2024-09-05T07:29:53.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.743+0000 7f06aa46a740 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x558c21e27f80 0x558c21e29250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.743+0000 7f06aa46a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c21e2a750 0x558c21e29790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.743+0000 7f06aa46a740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558c21e2ab30 0x558c21e59ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.743+0000 7f06aa46a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f06a00d05f0 con 0x558c21e2a750 2024-09-05T07:29:53.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.743+0000 7f06aa46a740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x558c21e4f600 con 0x558c21e2ab30 2024-09-05T07:29:53.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.743+0000 7f06aa46a740 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x558c21e4fc00 con 0x558c21e27f80 2024-09-05T07:29:53.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.743+0000 7f06a4b91640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c21e2a750 0x558c21e29790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.743+0000 7f06a5b93640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x558c21e27f80 0x558c21e29250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.743+0000 7f06a5b93640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558c21e2ab30 0x558c21e59ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.744+0000 7f06a4b91640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c21e2a750 0x558c21e29790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56528/0 (socket says 172.21.15.17:56528) 2024-09-05T07:29:53.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.744+0000 7f06a5b93640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x558c21e27f80 0x558c21e29250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:49508/0 (socket says 172.21.15.17:49508) 2024-09-05T07:29:53.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.744+0000 7f06a4b91640 1 -- 172.21.15.17:0/3160878687 learned_addr learned my addr 172.21.15.17:0/3160878687 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:53.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.746+0000 7f06a4b91640 1 -- 172.21.15.17:0/3160878687 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x558c21e27f80 msgr2=0x558c21e29250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:53.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.746+0000 7f06a4b91640 1 --2- 172.21.15.17:0/3160878687 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x558c21e27f80 0x558c21e29250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.746+0000 7f06a4b91640 1 -- 172.21.15.17:0/3160878687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558c21e2ab30 msgr2=0x558c21e59ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:53.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.746+0000 7f06a4b91640 1 --2- 172.21.15.17:0/3160878687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558c21e2ab30 0x558c21e59ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.746+0000 7f06a4b91640 1 -- 172.21.15.17:0/3160878687 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c21e53af0 con 0x558c21e2a750 2024-09-05T07:29:53.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.747+0000 7f06a4b91640 1 --2- 172.21.15.17:0/3160878687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c21e2a750 0x558c21e29790 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0694001cf0 tx=0x7f06940013f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad8fa0c5aacc48cf server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:53.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.753+0000 7f06867fc640 1 -- 172.21.15.17:0/3160878687 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0694017190 con 0x558c21e2a750 2024-09-05T07:29:53.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.753+0000 7f06867fc640 1 -- 172.21.15.17:0/3160878687 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f069401f030 con 0x558c21e2a750 2024-09-05T07:29:53.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.753+0000 7f06867fc640 1 -- 172.21.15.17:0/3160878687 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0694017ce0 con 0x558c21e2a750 2024-09-05T07:29:53.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.754+0000 7f06aa46a740 1 -- 172.21.15.17:0/3160878687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c21e2a750 msgr2=0x558c21e29790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:53.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.754+0000 7f06aa46a740 1 --2- 172.21.15.17:0/3160878687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c21e2a750 0x558c21e29790 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0694001cf0 tx=0x7f06940013f0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.754+0000 7f06aa46a740 1 -- 172.21.15.17:0/3160878687 shutdown_connections 2024-09-05T07:29:53.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.754+0000 7f06aa46a740 1 --2- 172.21.15.17:0/3160878687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558c21e2ab30 0x558c21e59ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.754+0000 7f06aa46a740 1 --2- 172.21.15.17:0/3160878687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c21e2a750 0x558c21e29790 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.754+0000 7f06aa46a740 1 --2- 172.21.15.17:0/3160878687 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x558c21e27f80 0x558c21e29250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.754+0000 7f06aa46a740 1 -- 172.21.15.17:0/3160878687 >> 172.21.15.17:0/3160878687 conn(0x558c21e28e70 msgr2=0x558c21e50210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:53.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.754+0000 7f06aa46a740 1 -- 172.21.15.17:0/3160878687 shutdown_connections 2024-09-05T07:29:53.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.754+0000 7f06aa46a740 1 -- 172.21.15.17:0/3160878687 wait complete. 2024-09-05T07:29:53.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.754+0000 7f06aa46a740 1 -- start start 2024-09-05T07:29:53.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.755+0000 7f06aa46a740 1 Processor -- start 2024-09-05T07:29:53.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.755+0000 7f06aa46a740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558c21e27f80 0x558c21e83c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.755+0000 7f06aa46a740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c21e2a750 0x558c21e6bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.755+0000 7f06aa46a740 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x558c21e2ab30 0x558c21ee51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.755+0000 7f06aa46a740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x558c21e526d0 con 0x558c21e2a750 2024-09-05T07:29:53.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.755+0000 7f06aa46a740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x558c21e57940 con 0x558c21e27f80 2024-09-05T07:29:53.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.755+0000 7f06aa46a740 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x558c21e7ceb0 con 0x558c21e2ab30 2024-09-05T07:29:53.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.756+0000 7f06aa46a740 10 client.0 _ll_register_callbacks cb 0x7f0694006cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:29:53.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.756+0000 7f06a4b91640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c21e2a750 0x558c21e6bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.756+0000 7f06a4b91640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c21e2a750 0x558c21e6bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56530/0 (socket says 172.21.15.17:56530) 2024-09-05T07:29:53.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.756+0000 7f06a4b91640 1 -- 172.21.15.17:0/2954870404 learned_addr learned my addr 172.21.15.17:0/2954870404 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:53.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.756+0000 7f06a5b93640 1 --2- 172.21.15.17:0/2954870404 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x558c21e2ab30 0x558c21ee51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.756+0000 7f06a5b93640 1 --2- 172.21.15.17:0/2954870404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558c21e27f80 0x558c21e83c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.759+0000 7f06a4b91640 1 -- 172.21.15.17:0/2954870404 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x558c21e2ab30 msgr2=0x558c21ee51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:53.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.759+0000 7f06a4b91640 1 --2- 172.21.15.17:0/2954870404 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x558c21e2ab30 0x558c21ee51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.759+0000 7f06a4b91640 1 -- 172.21.15.17:0/2954870404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558c21e27f80 msgr2=0x558c21e83c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:53.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.759+0000 7f06a4b91640 1 --2- 172.21.15.17:0/2954870404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558c21e27f80 0x558c21e83c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.759+0000 7f06a4b91640 1 -- 172.21.15.17:0/2954870404 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c21e7a060 con 0x558c21e2a750 2024-09-05T07:29:53.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.761+0000 7f06a4b91640 1 --2- 172.21.15.17:0/2954870404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c21e2a750 0x558c21e6bf50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0694001560 tx=0x7f0694001a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c3b2df5b1a0ec31 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:53.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.761+0000 7f067bfff640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-05T07:29:53.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.765+0000 7f067bfff640 1 -- 172.21.15.17:0/2954870404 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069402d060 con 0x558c21e2a750 2024-09-05T07:29:53.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.765+0000 7f067bfff640 1 -- 172.21.15.17:0/2954870404 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0694017ca0 con 0x558c21e2a750 2024-09-05T07:29:53.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.765+0000 7f06aa46a740 1 -- 172.21.15.17:0/2954870404 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f069401f030 con 0x558c21e2a750 2024-09-05T07:29:53.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.767+0000 7f067bfff640 1 -- 172.21.15.17:0/2954870404 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f0694033050 con 0x558c21e2a750 2024-09-05T07:29:53.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.767+0000 7f06aa46a740 10 client.4494 fetch_fsmap learned FSMap version 18 2024-09-05T07:29:53.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.767+0000 7f06aa46a740 1 -- 172.21.15.17:0/2954870404 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x558c21e51680 con 0x558c21e2a750 2024-09-05T07:29:53.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.768+0000 7f067bfff640 1 -- 172.21.15.17:0/2954870404 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f069401f030 con 0x558c21e2a750 2024-09-05T07:29:53.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.771+0000 7f067bfff640 1 -- 172.21.15.17:0/2954870404 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f0694036020 con 0x558c21e2a750 2024-09-05T07:29:53.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.771+0000 7f06aa46a740 10 client.4494 fetch_fsmap finished waiting for FSMap version 18 2024-09-05T07:29:53.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.771+0000 7f06aa46a740 10 client.4494 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-05T07:29:53.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.771+0000 7f06aa46a740 20 client.4494 populate_metadata read hostname 'smithi017' 2024-09-05T07:29:53.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.771+0000 7f06aa46a740 1 --2- 172.21.15.17:0/2954870404 >> [v2:172.21.15.17:6836/4100397916,v1:172.21.15.17:6837/4100397916] conn(0x558c21e5c560 0x558c21ef4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.771+0000 7f06aa46a740 4 client.4494 mds_command: new command op to 4241 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-05T07:29:53.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.771+0000 7f06aa46a740 1 -- 172.21.15.17:0/2954870404 --> [v2:172.21.15.17:6836/4100397916,v1:172.21.15.17:6837/4100397916] -- command(tid 0: {"prefix": "status"}) -- 0x558c21d92fa0 con 0x558c21e5c560 2024-09-05T07:29:53.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.772+0000 7f06a5b93640 1 --2- 172.21.15.17:0/2954870404 >> [v2:172.21.15.17:6836/4100397916,v1:172.21.15.17:6837/4100397916] conn(0x558c21e5c560 0x558c21ef4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.774+0000 7f067bfff640 10 client.4494 ms_handle_connect on v2:172.21.15.17:6836/4100397916 2024-09-05T07:29:53.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.774+0000 7f06a5b93640 1 --2- 172.21.15.17:0/2954870404 >> [v2:172.21.15.17:6836/4100397916,v1:172.21.15.17:6837/4100397916] conn(0x558c21e5c560 0x558c21ef4990 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=29a81dd511de534 server_cookie=ce379aa9903ad583 in_seq=0 out_seq=0 2024-09-05T07:29:53.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.793+0000 7f067bfff640 1 -- 172.21.15.17:0/2954870404 <== mds.2 v2:172.21.15.17:6836/4100397916 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x558c21d92fa0 con 0x558c21e5c560 2024-09-05T07:29:53.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.793+0000 7f067bfff640 10 client.4494 handle_command_reply: tid=0 2024-09-05T07:29:53.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.793+0000 7f06aa46a740 1 client.4494 shutdown 2024-09-05T07:29:53.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.793+0000 7f06aa46a740 1 -- 172.21.15.17:0/2954870404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c21e2a750 msgr2=0x558c21e6bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:53.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.793+0000 7f06aa46a740 1 --2- 172.21.15.17:0/2954870404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c21e2a750 0x558c21e6bf50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0694001560 tx=0x7f0694001a90 comp rx=0 tx=0).stop 2024-09-05T07:29:53.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.793+0000 7f06aa46a740 1 -- 172.21.15.17:0/2954870404 shutdown_connections 2024-09-05T07:29:53.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.793+0000 7f06aa46a740 1 --2- 172.21.15.17:0/2954870404 >> [v2:172.21.15.17:6836/4100397916,v1:172.21.15.17:6837/4100397916] conn(0x558c21e5c560 0x558c21ef4990 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.793+0000 7f06aa46a740 1 --2- 172.21.15.17:0/2954870404 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x558c21e2ab30 0x558c21ee51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.793+0000 7f06aa46a740 1 --2- 172.21.15.17:0/2954870404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c21e2a750 0x558c21e6bf50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.793+0000 7f067bfff640 0 client.4494 ms_handle_reset on v2:172.21.15.17:6836/4100397916 2024-09-05T07:29:53.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.793+0000 7f06aa46a740 1 --2- 172.21.15.17:0/2954870404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558c21e27f80 0x558c21e83c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.793+0000 7f06aa46a740 1 -- 172.21.15.17:0/2954870404 >> 172.21.15.17:0/2954870404 conn(0x558c21e28e70 msgr2=0x558c21e29250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:53.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.793+0000 7f06aa46a740 1 -- 172.21.15.17:0/2954870404 shutdown_connections 2024-09-05T07:29:53.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.793+0000 7f06aa46a740 1 -- 172.21.15.17:0/2954870404 wait complete. 2024-09-05T07:29:53.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.793+0000 7f06aa46a740 20 client.4494 trim_cache size 0 max 16384 2024-09-05T07:29:53.795 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-05T07:29:53.795 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "848dac54-74f8-48f3-8686-c6495dcb972b", 2024-09-05T07:29:53.795 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 2, 2024-09-05T07:29:53.796 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4241, 2024-09-05T07:29:53.796 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-05T07:29:53.796 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-05T07:29:53.796 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-05T07:29:53.796 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 11.320615070000001, 2024-09-05T07:29:53.796 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 18, 2024-09-05T07:29:53.796 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 22, 2024-09-05T07:29:53.796 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 22, 2024-09-05T07:29:53.796 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 29.312107869999998 2024-09-05T07:29:53.796 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-05T07:29:53.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.794+0000 7f06a75f6640 1 -- 172.21.15.17:0/762389475 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f068c06bdf0 msgr2=0x7f068c06e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:53.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.794+0000 7f06a75f6640 1 --2- 172.21.15.17:0/762389475 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f068c06bdf0 0x7f068c06e2b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0698009560 tx=0x7f06980094d0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.794+0000 7f06a75f6640 1 -- 172.21.15.17:0/762389475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06a00b43b0 msgr2=0x7f06a0154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:53.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.794+0000 7f06a75f6640 1 --2- 172.21.15.17:0/762389475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06a00b43b0 0x7f06a0154a10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f069802a860 tx=0x7f06980046c0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.794+0000 7f06a75f6640 1 -- 172.21.15.17:0/762389475 shutdown_connections 2024-09-05T07:29:53.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.794+0000 7f06a75f6640 1 --2- 172.21.15.17:0/762389475 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f068c06bdf0 0x7f068c06e2b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.794+0000 7f06a75f6640 1 --2- 172.21.15.17:0/762389475 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f06a00ccef0 0x7f06a0155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.794+0000 7f06a75f6640 1 --2- 172.21.15.17:0/762389475 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06a00cd2d0 0x7f06a0151630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.794+0000 7f06a75f6640 1 --2- 172.21.15.17:0/762389475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06a00b43b0 0x7f06a0154a10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.794+0000 7f06a75f6640 1 -- 172.21.15.17:0/762389475 >> 172.21.15.17:0/762389475 conn(0x7f06a0072230 msgr2=0x7f06a0156a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:53.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.794+0000 7f06a75f6640 1 -- 172.21.15.17:0/762389475 shutdown_connections 2024-09-05T07:29:53.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.794+0000 7f06a75f6640 1 -- 172.21.15.17:0/762389475 wait complete. 2024-09-05T07:29:53.805 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-09-05T07:29:53.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.905+0000 7f3746f31640 1 Processor -- start 2024-09-05T07:29:53.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.905+0000 7f3746f31640 1 -- start start 2024-09-05T07:29:53.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.906+0000 7f3746f31640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f37400ce300 0x7f374015e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.906+0000 7f3746f31640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f37400ce6e0 0x7f37400c9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.906+0000 7f3746f31640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f374015ac60 con 0x7f37400ca590 2024-09-05T07:29:53.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.906+0000 7f3746f31640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f374015edc0 con 0x7f37400ce300 2024-09-05T07:29:53.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.906+0000 7f3746f31640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f374015af40 con 0x7f37400ce6e0 2024-09-05T07:29:53.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.907+0000 7f3744ccd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f37400ce300 0x7f374015e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.907+0000 7f373ffff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f37400ce6e0 0x7f37400c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.907+0000 7f37454ce640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f37400ca590 0x7f37400c7590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.17:59096/0 (socket says 172.21.15.17:59096) 2024-09-05T07:29:53.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.907+0000 7f37454ce640 1 -- 172.21.15.17:0/186199461 learned_addr learned my addr 172.21.15.17:0/186199461 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:29:53.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.909+0000 7f3744ccd640 1 -- 172.21.15.17:0/186199461 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f37400ce6e0 msgr2=0x7f37400c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:53.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.909+0000 7f3744ccd640 1 --2- 172.21.15.17:0/186199461 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f37400ce6e0 0x7f37400c9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.909+0000 7f3744ccd640 1 -- 172.21.15.17:0/186199461 >> v1:172.21.15.26:6789/0 conn(0x7f37400ca590 legacy=0x7f37400c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:53.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.909+0000 7f3744ccd640 1 -- 172.21.15.17:0/186199461 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f374015b220 con 0x7f37400ce300 2024-09-05T07:29:53.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.911+0000 7f3744ccd640 1 --2- 172.21.15.17:0/186199461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37400ce300 0x7f374015e880 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3730009d90 tx=0x7f373002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29beb526a7d3bebf server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:53.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.915+0000 7f373f7fe640 1 -- 172.21.15.17:0/186199461 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3730007740 con 0x7f37400ce300 2024-09-05T07:29:53.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.915+0000 7f373f7fe640 1 -- 172.21.15.17:0/186199461 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37300078e0 con 0x7f37400ce300 2024-09-05T07:29:53.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.915+0000 7f373f7fe640 1 -- 172.21.15.17:0/186199461 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3730007cb0 con 0x7f37400ce300 2024-09-05T07:29:53.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.916+0000 7f3746f31640 1 -- 172.21.15.17:0/186199461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37400ce300 msgr2=0x7f374015e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:53.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.916+0000 7f3746f31640 1 --2- 172.21.15.17:0/186199461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37400ce300 0x7f374015e880 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3730009d90 tx=0x7f373002a6f0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.916+0000 7f3746f31640 1 -- 172.21.15.17:0/186199461 shutdown_connections 2024-09-05T07:29:53.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.916+0000 7f3746f31640 1 --2- 172.21.15.17:0/186199461 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f37400ce6e0 0x7f37400c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.916+0000 7f3746f31640 1 --2- 172.21.15.17:0/186199461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37400ce300 0x7f374015e880 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.916+0000 7f3746f31640 1 -- 172.21.15.17:0/186199461 >> 172.21.15.17:0/186199461 conn(0x7f374006fbd0 msgr2=0x7f3740067950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:53.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.916+0000 7f3746f31640 1 -- 172.21.15.17:0/186199461 shutdown_connections 2024-09-05T07:29:53.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.916+0000 7f3746f31640 1 -- 172.21.15.17:0/186199461 wait complete. 2024-09-05T07:29:53.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.917+0000 7f3746f31640 1 Processor -- start 2024-09-05T07:29:53.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.917+0000 7f3746f31640 1 -- start start 2024-09-05T07:29:53.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.918+0000 7f3746f31640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37400ca590 0x7f3740153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.918+0000 7f3746f31640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37400ce300 0x7f3740153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.918+0000 7f3746f31640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f37400ce6e0 0x7f37401f3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.918+0000 7f3746f31640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f374015b7e0 con 0x7f37400ce300 2024-09-05T07:29:53.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.918+0000 7f3746f31640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f37400c5e10 con 0x7f37400ca590 2024-09-05T07:29:53.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.918+0000 7f3746f31640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f374015a900 con 0x7f37400ce6e0 2024-09-05T07:29:53.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.918+0000 7f373ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37400ce300 0x7f3740153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.918+0000 7f3744ccd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37400ca590 0x7f3740153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.918+0000 7f37454ce640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f37400ce6e0 0x7f37401f3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.919+0000 7f37454ce640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f37400ce6e0 0x7f37401f3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:49520/0 (socket says 172.21.15.17:49520) 2024-09-05T07:29:53.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.919+0000 7f3744ccd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37400ca590 0x7f3740153010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:58592/0 (socket says 172.21.15.17:58592) 2024-09-05T07:29:53.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.919+0000 7f37454ce640 1 -- 172.21.15.17:0/1977829486 learned_addr learned my addr 172.21.15.17:0/1977829486 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:53.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.922+0000 7f37454ce640 1 -- 172.21.15.17:0/1977829486 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37400ca590 msgr2=0x7f3740153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:53.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.922+0000 7f37454ce640 1 --2- 172.21.15.17:0/1977829486 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37400ca590 0x7f3740153010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.922+0000 7f37454ce640 1 -- 172.21.15.17:0/1977829486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37400ce300 msgr2=0x7f3740153e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:53.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.922+0000 7f37454ce640 1 --2- 172.21.15.17:0/1977829486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37400ce300 0x7f3740153e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.922+0000 7f37454ce640 1 -- 172.21.15.17:0/1977829486 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37400c7f60 con 0x7f37400ce6e0 2024-09-05T07:29:53.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.925+0000 7f37454ce640 1 --2- 172.21.15.17:0/1977829486 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f37400ce6e0 0x7f37401f3750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f373800c450 tx=0x7f373800c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:53.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.929+0000 7f373d7fa640 1 -- 172.21.15.17:0/1977829486 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3738017070 con 0x7f37400ce6e0 2024-09-05T07:29:53.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.929+0000 7f373d7fa640 1 -- 172.21.15.17:0/1977829486 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3738005ce0 con 0x7f37400ce6e0 2024-09-05T07:29:53.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.929+0000 7f373d7fa640 1 -- 172.21.15.17:0/1977829486 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3738007270 con 0x7f37400ce6e0 2024-09-05T07:29:53.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.929+0000 7f3746f31640 1 -- 172.21.15.17:0/1977829486 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37400c3fa0 con 0x7f37400ce6e0 2024-09-05T07:29:53.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.929+0000 7f3746f31640 1 -- 172.21.15.17:0/1977829486 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3740154360 con 0x7f37400ce6e0 2024-09-05T07:29:53.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.932+0000 7f3749ccb740 1 Processor -- start 2024-09-05T07:29:53.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.932+0000 7f3749ccb740 1 -- start start 2024-09-05T07:29:53.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.932+0000 7f3749ccb740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f85de83750 0x55f85debb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.932+0000 7f3749ccb740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f85de80f80 0x55f85debbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.932+0000 7f3749ccb740 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f85de83b30 0x55f85de7fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.932+0000 7f3749ccb740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f85dde4520 con 0x55f85de80f80 2024-09-05T07:29:53.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.932+0000 7f3749ccb740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55f85dd8c3e0 con 0x55f85de83750 2024-09-05T07:29:53.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.932+0000 7f3749ccb740 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x55f85dde04e0 con 0x55f85de83b30 2024-09-05T07:29:53.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.933+0000 7f3744ccd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f85de80f80 0x55f85debbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.933+0000 7f373ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f85de83750 0x55f85debb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.933+0000 7f373ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f85de83750 0x55f85debb9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:58604/0 (socket says 172.21.15.17:58604) 2024-09-05T07:29:53.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.933+0000 7f373ffff640 1 -- 172.21.15.17:0/2631188526 learned_addr learned my addr 172.21.15.17:0/2631188526 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:53.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.935+0000 7f373ffff640 1 -- 172.21.15.17:0/2631188526 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f85de83b30 msgr2=0x55f85de7fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:53.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.935+0000 7f373ffff640 1 --2- 172.21.15.17:0/2631188526 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f85de83b30 0x55f85de7fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.935+0000 7f373ffff640 1 -- 172.21.15.17:0/2631188526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f85de80f80 msgr2=0x55f85debbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:53.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.935+0000 7f373ffff640 1 --2- 172.21.15.17:0/2631188526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f85de80f80 0x55f85debbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.935+0000 7f373ffff640 1 -- 172.21.15.17:0/2631188526 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f85dda72f0 con 0x55f85de83750 2024-09-05T07:29:53.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.935+0000 7f3744ccd640 1 --2- 172.21.15.17:0/2631188526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f85de80f80 0x55f85debbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:29:53.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.937+0000 7f373ffff640 1 --2- 172.21.15.17:0/2631188526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f85de83750 0x55f85debb9e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3734009b80 tx=0x7f3734013710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b15cda19c88cb45 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:53.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.942+0000 7f37267fc640 1 -- 172.21.15.17:0/2631188526 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3734015450 con 0x55f85de83750 2024-09-05T07:29:53.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.942+0000 7f37267fc640 1 -- 172.21.15.17:0/2631188526 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37340155f0 con 0x55f85de83750 2024-09-05T07:29:53.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.942+0000 7f37267fc640 1 -- 172.21.15.17:0/2631188526 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37340159c0 con 0x55f85de83750 2024-09-05T07:29:53.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.943+0000 7f3749ccb740 1 -- 172.21.15.17:0/2631188526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f85de83750 msgr2=0x55f85debb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:53.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.943+0000 7f3749ccb740 1 --2- 172.21.15.17:0/2631188526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f85de83750 0x55f85debb9e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3734009b80 tx=0x7f3734013710 comp rx=0 tx=0).stop 2024-09-05T07:29:53.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.943+0000 7f3749ccb740 1 -- 172.21.15.17:0/2631188526 shutdown_connections 2024-09-05T07:29:53.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.943+0000 7f3749ccb740 1 --2- 172.21.15.17:0/2631188526 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f85de83b30 0x55f85de7fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.943+0000 7f3749ccb740 1 --2- 172.21.15.17:0/2631188526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f85de80f80 0x55f85debbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.943+0000 7f3749ccb740 1 --2- 172.21.15.17:0/2631188526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f85de83750 0x55f85debb9e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.943+0000 7f3749ccb740 1 -- 172.21.15.17:0/2631188526 >> 172.21.15.17:0/2631188526 conn(0x55f85de81e70 msgr2=0x55f85de82270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:53.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.943+0000 7f3749ccb740 1 -- 172.21.15.17:0/2631188526 shutdown_connections 2024-09-05T07:29:53.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.943+0000 7f3749ccb740 1 -- 172.21.15.17:0/2631188526 wait complete. 2024-09-05T07:29:53.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.944+0000 7f3749ccb740 1 -- start start 2024-09-05T07:29:53.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.944+0000 7f3749ccb740 1 Processor -- start 2024-09-05T07:29:53.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.945+0000 7f3749ccb740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f85de80f80 0x55f85ded37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.945+0000 7f3749ccb740 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f85de83750 0x55f85deac830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.945+0000 7f3749ccb740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f85de83b30 0x55f85deab460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.945+0000 7f3749ccb740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f85de82fe0 con 0x55f85de83b30 2024-09-05T07:29:53.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.945+0000 7f3749ccb740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55f85dd6d450 con 0x55f85de80f80 2024-09-05T07:29:53.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.945+0000 7f3749ccb740 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x55f85debb550 con 0x55f85de83750 2024-09-05T07:29:53.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.945+0000 7f3749ccb740 10 client.0 _ll_register_callbacks cb 0x55f85daf6ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:29:53.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.946+0000 7f373ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f85de80f80 0x55f85ded37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.946+0000 7f373ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f85de80f80 0x55f85ded37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:58610/0 (socket says 172.21.15.17:58610) 2024-09-05T07:29:53.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.946+0000 7f373ffff640 1 -- 172.21.15.17:0/1979299771 learned_addr learned my addr 172.21.15.17:0/1979299771 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:53.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.948+0000 7f373ffff640 1 --2- 172.21.15.17:0/1979299771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f85de83b30 0x55f85deab460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.949+0000 7f373ffff640 1 -- 172.21.15.17:0/1979299771 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f85de83750 msgr2=0x55f85deac830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:53.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.949+0000 7f373ffff640 1 --2- 172.21.15.17:0/1979299771 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f85de83750 0x55f85deac830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.949+0000 7f373ffff640 1 -- 172.21.15.17:0/1979299771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f85de83b30 msgr2=0x55f85deab460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:53.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.949+0000 7f373ffff640 1 --2- 172.21.15.17:0/1979299771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f85de83b30 0x55f85deab460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:53.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.949+0000 7f373ffff640 1 -- 172.21.15.17:0/1979299771 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f85daf72d0 con 0x55f85de80f80 2024-09-05T07:29:53.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.950+0000 7f373d7fa640 1 -- 172.21.15.17:0/1977829486 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f373801a070 con 0x7f37400ce6e0 2024-09-05T07:29:53.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.951+0000 7f373d7fa640 1 --2- 172.21.15.17:0/1977829486 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f372c06bda0 0x7f372c06e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:53.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.951+0000 7f3744ccd640 1 --2- 172.21.15.17:0/1977829486 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f372c06bda0 0x7f372c06e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:53.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.951+0000 7f3744ccd640 1 --2- 172.21.15.17:0/1977829486 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f372c06bda0 0x7f372c06e260 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3730034000 tx=0x7f373002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:53.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.951+0000 7f373ffff640 1 --2- 172.21.15.17:0/1979299771 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f85de80f80 0x55f85ded37d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3734009690 tx=0x7f3734016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c034b97b0a2ae433 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:53.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.951+0000 7f371f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-09-05T07:29:53.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.955+0000 7f373d7fa640 1 -- 172.21.15.17:0/1977829486 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f37380563d0 con 0x7f37400ce6e0 2024-09-05T07:29:53.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.958+0000 7f371f7fe640 1 -- 172.21.15.17:0/1979299771 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3734004230 con 0x55f85de80f80 2024-09-05T07:29:53.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.958+0000 7f371f7fe640 1 -- 172.21.15.17:0/1979299771 <== mon.1 v2:172.21.15.26:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f37340043d0 con 0x55f85de80f80 2024-09-05T07:29:53.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:53.958+0000 7f3749ccb740 1 -- 172.21.15.17:0/1979299771 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37340155f0 con 0x55f85de80f80 2024-09-05T07:29:54.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.066+0000 7f371f7fe640 1 -- 172.21.15.17:0/1979299771 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f3734003610 con 0x55f85de80f80 2024-09-05T07:29:54.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.066+0000 7f3749ccb740 10 client.4543 fetch_fsmap learned FSMap version 18 2024-09-05T07:29:54.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.066+0000 7f3749ccb740 1 -- 172.21.15.17:0/1979299771 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55f85dbc16b0 con 0x55f85de80f80 2024-09-05T07:29:54.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.071+0000 7f371f7fe640 1 -- 172.21.15.17:0/1979299771 <== mon.1 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37340155f0 con 0x55f85de80f80 2024-09-05T07:29:54.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.071+0000 7f371f7fe640 1 -- 172.21.15.17:0/1979299771 <== mon.1 v2:172.21.15.26:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f37340037b0 con 0x55f85de80f80 2024-09-05T07:29:54.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.071+0000 7f3749ccb740 10 client.4543 fetch_fsmap finished waiting for FSMap version 18 2024-09-05T07:29:54.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.071+0000 7f3749ccb740 10 client.4543 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-05T07:29:54.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.071+0000 7f3749ccb740 20 client.4543 populate_metadata read hostname 'smithi017' 2024-09-05T07:29:54.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.071+0000 7f3749ccb740 1 --2- 172.21.15.17:0/1979299771 >> [v2:172.21.15.17:6834/2818017162,v1:172.21.15.17:6835/2818017162] conn(0x55f85ded6c70 0x55f85dee18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:54.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.071+0000 7f3749ccb740 4 client.4543 mds_command: new command op to 4258 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T07:29:54.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.071+0000 7f3749ccb740 1 -- 172.21.15.17:0/1979299771 --> [v2:172.21.15.17:6834/2818017162,v1:172.21.15.17:6835/2818017162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f85ddf1c50 con 0x55f85ded6c70 2024-09-05T07:29:54.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.072+0000 7f373ffff640 1 --2- 172.21.15.17:0/1979299771 >> [v2:172.21.15.17:6834/2818017162,v1:172.21.15.17:6835/2818017162] conn(0x55f85ded6c70 0x55f85dee18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:54.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.120+0000 7f373ffff640 1 --2- 172.21.15.17:0/1979299771 >> [v2:172.21.15.17:6834/2818017162,v1:172.21.15.17:6835/2818017162] conn(0x55f85ded6c70 0x55f85dee18c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=450e978c6dc6018c server_cookie=e29752166ec2b6eb in_seq=0 out_seq=0 2024-09-05T07:29:54.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.120+0000 7f371f7fe640 10 client.4543 ms_handle_connect on v2:172.21.15.17:6834/2818017162 2024-09-05T07:29:54.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.246+0000 7f371f7fe640 1 -- 172.21.15.17:0/1979299771 <== mds.1 v2:172.21.15.17:6834/2818017162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f85ddf1c50 con 0x55f85ded6c70 2024-09-05T07:29:54.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.246+0000 7f371f7fe640 10 client.4543 handle_command_reply: tid=0 2024-09-05T07:29:54.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.246+0000 7f3749ccb740 1 client.4543 shutdown 2024-09-05T07:29:54.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.246+0000 7f3749ccb740 1 -- 172.21.15.17:0/1979299771 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f85de80f80 msgr2=0x55f85ded37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:54.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.246+0000 7f3749ccb740 1 --2- 172.21.15.17:0/1979299771 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f85de80f80 0x55f85ded37d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3734009690 tx=0x7f3734016000 comp rx=0 tx=0).stop 2024-09-05T07:29:54.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.246+0000 7f3749ccb740 1 -- 172.21.15.17:0/1979299771 shutdown_connections 2024-09-05T07:29:54.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.246+0000 7f3749ccb740 1 --2- 172.21.15.17:0/1979299771 >> [v2:172.21.15.17:6834/2818017162,v1:172.21.15.17:6835/2818017162] conn(0x55f85ded6c70 0x55f85dee18c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.246+0000 7f3749ccb740 1 --2- 172.21.15.17:0/1979299771 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f85de83750 0x55f85deac830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.246+0000 7f371f7fe640 0 client.4543 ms_handle_reset on v2:172.21.15.17:6834/2818017162 2024-09-05T07:29:54.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.246+0000 7f3749ccb740 1 --2- 172.21.15.17:0/1979299771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f85de83b30 0x55f85deab460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.246+0000 7f3749ccb740 1 --2- 172.21.15.17:0/1979299771 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f85de80f80 0x55f85ded37d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.246+0000 7f3749ccb740 1 -- 172.21.15.17:0/1979299771 >> 172.21.15.17:0/1979299771 conn(0x55f85de81e70 msgr2=0x55f85deb6b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:54.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.246+0000 7f3749ccb740 1 -- 172.21.15.17:0/1979299771 shutdown_connections 2024-09-05T07:29:54.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.246+0000 7f3749ccb740 1 -- 172.21.15.17:0/1979299771 wait complete. 2024-09-05T07:29:54.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.247+0000 7f3749ccb740 20 client.4543 trim_cache size 0 max 16384 2024-09-05T07:29:54.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.265+0000 7f3749ccb740 1 Processor -- start 2024-09-05T07:29:54.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.265+0000 7f3749ccb740 1 -- start start 2024-09-05T07:29:54.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.266+0000 7f3749ccb740 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f85de80f80 0x55f85deac820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:54.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.266+0000 7f3749ccb740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f85de83750 0x55f85deb5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:54.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.266+0000 7f3749ccb740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f85de83b30 0x55f85deb5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:54.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.266+0000 7f3749ccb740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f37401522f0 con 0x55f85de83750 2024-09-05T07:29:54.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.266+0000 7f3749ccb740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55f85ded3310 con 0x55f85de83b30 2024-09-05T07:29:54.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.266+0000 7f3749ccb740 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x55f85dea95a0 con 0x55f85de80f80 2024-09-05T07:29:54.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.267+0000 7f373ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f85de83750 0x55f85deb5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:54.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.267+0000 7f37454ce640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f85de83b30 0x55f85deb5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:54.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.267+0000 7f3744ccd640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f85de80f80 0x55f85deac820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:54.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.267+0000 7f373ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f85de83750 0x55f85deb5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56582/0 (socket says 172.21.15.17:56582) 2024-09-05T07:29:54.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.267+0000 7f373ffff640 1 -- 172.21.15.17:0/3979138284 learned_addr learned my addr 172.21.15.17:0/3979138284 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:54.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.267+0000 7f37454ce640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f85de83b30 0x55f85deb5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:58624/0 (socket says 172.21.15.17:58624) 2024-09-05T07:29:54.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.269+0000 7f37454ce640 1 -- 172.21.15.17:0/3979138284 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f85de80f80 msgr2=0x55f85deac820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:54.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.269+0000 7f37454ce640 1 --2- 172.21.15.17:0/3979138284 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f85de80f80 0x55f85deac820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.269+0000 7f37454ce640 1 -- 172.21.15.17:0/3979138284 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f85de83750 msgr2=0x55f85deb5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:54.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.269+0000 7f37454ce640 1 --2- 172.21.15.17:0/3979138284 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f85de83750 0x55f85deb5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.269+0000 7f37454ce640 1 -- 172.21.15.17:0/3979138284 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f85de7f580 con 0x55f85de83b30 2024-09-05T07:29:54.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.271+0000 7f37454ce640 1 --2- 172.21.15.17:0/3979138284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f85de83b30 0x55f85deb5a90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f37380884d0 tx=0x7f373805c6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc4f95a64898960b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:54.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.275+0000 7f3725ffb640 1 -- 172.21.15.17:0/3979138284 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3738081e60 con 0x55f85de83b30 2024-09-05T07:29:54.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.275+0000 7f3725ffb640 1 -- 172.21.15.17:0/3979138284 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37380549a0 con 0x55f85de83b30 2024-09-05T07:29:54.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.275+0000 7f3725ffb640 1 -- 172.21.15.17:0/3979138284 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3738060bf0 con 0x55f85de83b30 2024-09-05T07:29:54.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.276+0000 7f3749ccb740 1 -- 172.21.15.17:0/3979138284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f85de83b30 msgr2=0x55f85deb5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:54.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.276+0000 7f3749ccb740 1 --2- 172.21.15.17:0/3979138284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f85de83b30 0x55f85deb5a90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f37380884d0 tx=0x7f373805c6f0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.276+0000 7f3749ccb740 1 -- 172.21.15.17:0/3979138284 shutdown_connections 2024-09-05T07:29:54.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.276+0000 7f3749ccb740 1 --2- 172.21.15.17:0/3979138284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f85de83b30 0x55f85deb5a90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.276+0000 7f3749ccb740 1 --2- 172.21.15.17:0/3979138284 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f85de83750 0x55f85deb5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.276+0000 7f3749ccb740 1 --2- 172.21.15.17:0/3979138284 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f85de80f80 0x55f85deac820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.276+0000 7f3749ccb740 1 -- 172.21.15.17:0/3979138284 >> 172.21.15.17:0/3979138284 conn(0x55f85de81e70 msgr2=0x55f85deab270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:54.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.276+0000 7f3749ccb740 1 -- 172.21.15.17:0/3979138284 shutdown_connections 2024-09-05T07:29:54.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.276+0000 7f3749ccb740 1 -- 172.21.15.17:0/3979138284 wait complete. 2024-09-05T07:29:54.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.276+0000 7f3749ccb740 1 -- start start 2024-09-05T07:29:54.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.276+0000 7f3749ccb740 1 Processor -- start 2024-09-05T07:29:54.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.277+0000 7f3749ccb740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f85de80f80 0x55f85de7dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:54.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.277+0000 7f3749ccb740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f85de83750 0x55f85dea6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:54.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.277+0000 7f3749ccb740 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f85de83b30 0x55f85dea72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:54.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.277+0000 7f3749ccb740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f85deadde0 con 0x55f85de83750 2024-09-05T07:29:54.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.277+0000 7f3749ccb740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55f85deab9f0 con 0x55f85de80f80 2024-09-05T07:29:54.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.277+0000 7f3749ccb740 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x55f85deafe00 con 0x55f85de83b30 2024-09-05T07:29:54.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.277+0000 7f3749ccb740 10 client.0 _ll_register_callbacks cb 0x7f3730009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:29:54.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.278+0000 7f373ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f85de83750 0x55f85dea6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:54.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.278+0000 7f37454ce640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f85de83b30 0x55f85dea72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:54.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.278+0000 7f3744ccd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f85de80f80 0x55f85de7dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:54.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.278+0000 7f3744ccd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f85de80f80 0x55f85de7dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:58638/0 (socket says 172.21.15.17:58638) 2024-09-05T07:29:54.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.278+0000 7f3744ccd640 1 -- 172.21.15.17:0/2304567282 learned_addr learned my addr 172.21.15.17:0/2304567282 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:54.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.281+0000 7f37454ce640 1 -- 172.21.15.17:0/2304567282 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f85de80f80 msgr2=0x55f85de7dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:54.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.281+0000 7f37454ce640 1 --2- 172.21.15.17:0/2304567282 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f85de80f80 0x55f85de7dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.281+0000 7f37454ce640 1 -- 172.21.15.17:0/2304567282 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f85de83750 msgr2=0x55f85dea6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:54.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.281+0000 7f37454ce640 1 --2- 172.21.15.17:0/2304567282 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f85de83750 0x55f85dea6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.281+0000 7f37454ce640 1 -- 172.21.15.17:0/2304567282 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55f85df43f90 con 0x55f85de83b30 2024-09-05T07:29:54.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.281+0000 7f373ffff640 1 --2- 172.21.15.17:0/2304567282 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f85de83750 0x55f85dea6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:29:54.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.284+0000 7f37454ce640 1 --2- 172.21.15.17:0/2304567282 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f85de83b30 0x55f85dea72f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3738054790 tx=0x7f3738014070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=865ee542e6c1e3be server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:54.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.284+0000 7f371f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.26:3301/0 2024-09-05T07:29:54.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.287+0000 7f371f7fe640 1 -- 172.21.15.17:0/2304567282 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3738075060 con 0x55f85de83b30 2024-09-05T07:29:54.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.287+0000 7f371f7fe640 1 -- 172.21.15.17:0/2304567282 <== mon.2 v2:172.21.15.26:3301/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f3738057780 con 0x55f85de83b30 2024-09-05T07:29:54.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.287+0000 7f3749ccb740 1 -- 172.21.15.17:0/2304567282 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37380549a0 con 0x55f85de83b30 2024-09-05T07:29:54.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.289+0000 7f371f7fe640 1 -- 172.21.15.17:0/2304567282 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f3738081e60 con 0x55f85de83b30 2024-09-05T07:29:54.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.289+0000 7f3749ccb740 10 client.4475 fetch_fsmap learned FSMap version 18 2024-09-05T07:29:54.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.289+0000 7f3749ccb740 1 -- 172.21.15.17:0/2304567282 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55f85debb880 con 0x55f85de83b30 2024-09-05T07:29:54.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.293+0000 7f371f7fe640 1 -- 172.21.15.17:0/2304567282 <== mon.2 v2:172.21.15.26:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37380549a0 con 0x55f85de83b30 2024-09-05T07:29:54.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.293+0000 7f371f7fe640 1 -- 172.21.15.17:0/2304567282 <== mon.2 v2:172.21.15.26:3301/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f3738007410 con 0x55f85de83b30 2024-09-05T07:29:54.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.293+0000 7f3749ccb740 10 client.4475 fetch_fsmap finished waiting for FSMap version 18 2024-09-05T07:29:54.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.293+0000 7f3749ccb740 10 client.4475 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-05T07:29:54.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.293+0000 7f3749ccb740 20 client.4475 populate_metadata read hostname 'smithi017' 2024-09-05T07:29:54.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.293+0000 7f3749ccb740 1 --2- 172.21.15.17:0/2304567282 >> [v2:172.21.15.17:6834/2818017162,v1:172.21.15.17:6835/2818017162] conn(0x55f85ded6c70 0x55f85df3cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:54.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.293+0000 7f3749ccb740 4 client.4475 mds_command: new command op to 4258 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-05T07:29:54.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.293+0000 7f3749ccb740 1 -- 172.21.15.17:0/2304567282 --> [v2:172.21.15.17:6834/2818017162,v1:172.21.15.17:6835/2818017162] -- command(tid 0: {"prefix": "status"}) -- 0x55f85ddebfa0 con 0x55f85ded6c70 2024-09-05T07:29:54.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.294+0000 7f3744ccd640 1 --2- 172.21.15.17:0/2304567282 >> [v2:172.21.15.17:6834/2818017162,v1:172.21.15.17:6835/2818017162] conn(0x55f85ded6c70 0x55f85df3cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:54.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.297+0000 7f371f7fe640 10 client.4475 ms_handle_connect on v2:172.21.15.17:6834/2818017162 2024-09-05T07:29:54.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.297+0000 7f3744ccd640 1 --2- 172.21.15.17:0/2304567282 >> [v2:172.21.15.17:6834/2818017162,v1:172.21.15.17:6835/2818017162] conn(0x55f85ded6c70 0x55f85df3cdf0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1bc8729e9a98dd1d server_cookie=6a4e373540ddc99b in_seq=0 out_seq=0 2024-09-05T07:29:54.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.315+0000 7f371f7fe640 1 -- 172.21.15.17:0/2304567282 <== mds.1 v2:172.21.15.17:6834/2818017162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55f85ddebfa0 con 0x55f85ded6c70 2024-09-05T07:29:54.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.315+0000 7f371f7fe640 10 client.4475 handle_command_reply: tid=0 2024-09-05T07:29:54.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.315+0000 7f3749ccb740 1 client.4475 shutdown 2024-09-05T07:29:54.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.315+0000 7f3749ccb740 1 -- 172.21.15.17:0/2304567282 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f85de83b30 msgr2=0x55f85dea72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:54.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.315+0000 7f3749ccb740 1 --2- 172.21.15.17:0/2304567282 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f85de83b30 0x55f85dea72f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3738054790 tx=0x7f3738014070 comp rx=0 tx=0).stop 2024-09-05T07:29:54.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.315+0000 7f3749ccb740 1 -- 172.21.15.17:0/2304567282 shutdown_connections 2024-09-05T07:29:54.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.315+0000 7f3749ccb740 1 --2- 172.21.15.17:0/2304567282 >> [v2:172.21.15.17:6834/2818017162,v1:172.21.15.17:6835/2818017162] conn(0x55f85ded6c70 0x55f85df3cdf0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.315+0000 7f3749ccb740 1 --2- 172.21.15.17:0/2304567282 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f85de83b30 0x55f85dea72f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.315+0000 7f3749ccb740 1 --2- 172.21.15.17:0/2304567282 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f85de83750 0x55f85dea6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.315+0000 7f3749ccb740 1 --2- 172.21.15.17:0/2304567282 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f85de80f80 0x55f85de7dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.315+0000 7f371f7fe640 0 client.4475 ms_handle_reset on v2:172.21.15.17:6834/2818017162 2024-09-05T07:29:54.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.315+0000 7f3749ccb740 1 -- 172.21.15.17:0/2304567282 >> 172.21.15.17:0/2304567282 conn(0x55f85de81e70 msgr2=0x55f85de77f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:54.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.315+0000 7f3749ccb740 1 -- 172.21.15.17:0/2304567282 shutdown_connections 2024-09-05T07:29:54.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.315+0000 7f3749ccb740 1 -- 172.21.15.17:0/2304567282 wait complete. 2024-09-05T07:29:54.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.315+0000 7f3749ccb740 20 client.4475 trim_cache size 0 max 16384 2024-09-05T07:29:54.317 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-05T07:29:54.317 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "848dac54-74f8-48f3-8686-c6495dcb972b", 2024-09-05T07:29:54.317 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 1, 2024-09-05T07:29:54.318 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4258, 2024-09-05T07:29:54.318 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-05T07:29:54.318 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-05T07:29:54.318 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-05T07:29:54.318 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 18.871220384000001, 2024-09-05T07:29:54.318 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 18, 2024-09-05T07:29:54.318 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 22, 2024-09-05T07:29:54.318 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 22, 2024-09-05T07:29:54.318 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 29.932465779000001 2024-09-05T07:29:54.318 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-05T07:29:54.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.316+0000 7f3746f31640 1 -- 172.21.15.17:0/1977829486 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f372c06bda0 msgr2=0x7f372c06e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:54.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.316+0000 7f3746f31640 1 --2- 172.21.15.17:0/1977829486 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f372c06bda0 0x7f372c06e260 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3730034000 tx=0x7f373002e000 comp rx=0 tx=0).stop 2024-09-05T07:29:54.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.316+0000 7f3746f31640 1 -- 172.21.15.17:0/1977829486 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f37400ce6e0 msgr2=0x7f37401f3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:54.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.316+0000 7f3746f31640 1 --2- 172.21.15.17:0/1977829486 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f37400ce6e0 0x7f37401f3750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f373800c450 tx=0x7f373800c910 comp rx=0 tx=0).stop 2024-09-05T07:29:54.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.316+0000 7f3746f31640 1 -- 172.21.15.17:0/1977829486 shutdown_connections 2024-09-05T07:29:54.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.316+0000 7f3746f31640 1 --2- 172.21.15.17:0/1977829486 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f372c06bda0 0x7f372c06e260 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.316+0000 7f3746f31640 1 --2- 172.21.15.17:0/1977829486 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f37400ce6e0 0x7f37401f3750 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.316+0000 7f3746f31640 1 --2- 172.21.15.17:0/1977829486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37400ce300 0x7f3740153e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.316+0000 7f3746f31640 1 --2- 172.21.15.17:0/1977829486 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37400ca590 0x7f3740153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.316+0000 7f3746f31640 1 -- 172.21.15.17:0/1977829486 >> 172.21.15.17:0/1977829486 conn(0x7f374006fbd0 msgr2=0x7f3740071560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:54.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.316+0000 7f3746f31640 1 -- 172.21.15.17:0/1977829486 shutdown_connections 2024-09-05T07:29:54.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.316+0000 7f3746f31640 1 -- 172.21.15.17:0/1977829486 wait complete. 2024-09-05T07:29:54.327 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-09-05T07:29:54.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.428+0000 7fe7a95c6640 1 Processor -- start 2024-09-05T07:29:54.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.428+0000 7fe7a95c6640 1 -- start start 2024-09-05T07:29:54.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.428+0000 7fe7a95c6640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe7a40c72a0 0x7fe7a40c4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:54.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.428+0000 7fe7a95c6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe7a40c7680 0x7fe7a415c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:54.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.428+0000 7fe7a95c6640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7a40c7d10 con 0x7fe7a415c840 2024-09-05T07:29:54.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.428+0000 7fe7a95c6640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fe7a415bb90 con 0x7fe7a40c72a0 2024-09-05T07:29:54.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.428+0000 7fe7a95c6640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fe7a4158b00 con 0x7fe7a40c7680 2024-09-05T07:29:54.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.429+0000 7fe7a2ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe7a40c72a0 0x7fe7a40c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:54.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.429+0000 7fe7a27fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe7a40c7680 0x7fe7a415c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:54.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.429+0000 7fe7a37fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe7a415c840 0x7fe7a4152150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.17:59112/0 (socket says 172.21.15.17:59112) 2024-09-05T07:29:54.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.429+0000 7fe7a37fe640 1 -- 172.21.15.17:0/596040867 learned_addr learned my addr 172.21.15.17:0/596040867 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:29:54.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.432+0000 7fe7a2ffd640 1 -- 172.21.15.17:0/596040867 >> v2:172.21.15.26:3300/0 conn(0x7fe7a40c7680 msgr2=0x7fe7a415c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:54.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.432+0000 7fe7a2ffd640 1 --2- 172.21.15.17:0/596040867 >> v2:172.21.15.26:3300/0 conn(0x7fe7a40c7680 0x7fe7a415c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.432+0000 7fe7a2ffd640 1 -- 172.21.15.17:0/596040867 >> v1:172.21.15.26:6789/0 conn(0x7fe7a415c840 legacy=0x7fe7a4152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:54.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.432+0000 7fe7a2ffd640 1 -- 172.21.15.17:0/596040867 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7a4158de0 con 0x7fe7a40c72a0 2024-09-05T07:29:54.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.434+0000 7fe7a2ffd640 1 --2- 172.21.15.17:0/596040867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7a40c72a0 0x7fe7a40c4d50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe7a40c9e00 tx=0x7fe79402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b67ac2fd914a33a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:54.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.438+0000 7fe7a1ffb640 1 -- 172.21.15.17:0/596040867 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe794007740 con 0x7fe7a40c72a0 2024-09-05T07:29:54.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.438+0000 7fe7a1ffb640 1 -- 172.21.15.17:0/596040867 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7940078e0 con 0x7fe7a40c72a0 2024-09-05T07:29:54.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.438+0000 7fe7a1ffb640 1 -- 172.21.15.17:0/596040867 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe794007cb0 con 0x7fe7a40c72a0 2024-09-05T07:29:54.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.438+0000 7fe7a95c6640 1 -- 172.21.15.17:0/596040867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7a40c72a0 msgr2=0x7fe7a40c4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:54.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.438+0000 7fe7a95c6640 1 --2- 172.21.15.17:0/596040867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7a40c72a0 0x7fe7a40c4d50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe7a40c9e00 tx=0x7fe79402a680 comp rx=0 tx=0).stop 2024-09-05T07:29:54.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.438+0000 7fe7a95c6640 1 -- 172.21.15.17:0/596040867 shutdown_connections 2024-09-05T07:29:54.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.438+0000 7fe7a95c6640 1 --2- 172.21.15.17:0/596040867 >> v2:172.21.15.26:3300/0 conn(0x7fe7a40c7680 0x7fe7a415c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.438+0000 7fe7a95c6640 1 --2- 172.21.15.17:0/596040867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7a40c72a0 0x7fe7a40c4d50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.438+0000 7fe7a95c6640 1 -- 172.21.15.17:0/596040867 >> 172.21.15.17:0/596040867 conn(0x7fe7a406fba0 msgr2=0x7fe7a406ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:54.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.438+0000 7fe7a95c6640 1 -- 172.21.15.17:0/596040867 shutdown_connections 2024-09-05T07:29:54.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.438+0000 7fe7a95c6640 1 -- 172.21.15.17:0/596040867 wait complete. 2024-09-05T07:29:54.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.440+0000 7fe7a95c6640 1 Processor -- start 2024-09-05T07:29:54.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.440+0000 7fe7a95c6640 1 -- start start 2024-09-05T07:29:54.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.441+0000 7fe7a95c6640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe7a40c72a0 0x7fe7a41f4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:54.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.441+0000 7fe7a95c6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7a40c7680 0x7fe7a40c3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:54.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.441+0000 7fe7a95c6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7a415c840 0x7fe7a40cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:54.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.441+0000 7fe7a95c6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a415bde0 con 0x7fe7a415c840 2024-09-05T07:29:54.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.441+0000 7fe7a95c6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a41593a0 con 0x7fe7a40c7680 2024-09-05T07:29:54.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.441+0000 7fe7a95c6640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fe7a4152860 con 0x7fe7a40c72a0 2024-09-05T07:29:54.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.441+0000 7fe7a37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7a415c840 0x7fe7a40cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:54.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.441+0000 7fe7a27fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7a40c7680 0x7fe7a40c3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:54.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.441+0000 7fe7a2ffd640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe7a40c72a0 0x7fe7a41f4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:54.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.442+0000 7fe7a27fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7a40c7680 0x7fe7a40c3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:58656/0 (socket says 172.21.15.17:58656) 2024-09-05T07:29:54.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.442+0000 7fe7a27fc640 1 -- 172.21.15.17:0/1755159904 learned_addr learned my addr 172.21.15.17:0/1755159904 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:54.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.445+0000 7fe7a27fc640 1 -- 172.21.15.17:0/1755159904 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe7a40c72a0 msgr2=0x7fe7a41f4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:54.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.445+0000 7fe7a27fc640 1 --2- 172.21.15.17:0/1755159904 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe7a40c72a0 0x7fe7a41f4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.445+0000 7fe7a27fc640 1 -- 172.21.15.17:0/1755159904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7a415c840 msgr2=0x7fe7a40cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:54.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.445+0000 7fe7a27fc640 1 --2- 172.21.15.17:0/1755159904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7a415c840 0x7fe7a40cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.445+0000 7fe7a27fc640 1 -- 172.21.15.17:0/1755159904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7a40cbc60 con 0x7fe7a40c7680 2024-09-05T07:29:54.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.447+0000 7fe7a27fc640 1 --2- 172.21.15.17:0/1755159904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7a40c7680 0x7fe7a40c3da0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe78c00e9b0 tx=0x7fe78c00ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:54.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.451+0000 7fe79b7fe640 1 -- 172.21.15.17:0/1755159904 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78c017070 con 0x7fe7a40c7680 2024-09-05T07:29:54.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.451+0000 7fe79b7fe640 1 -- 172.21.15.17:0/1755159904 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe78c00c9a0 con 0x7fe7a40c7680 2024-09-05T07:29:54.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.451+0000 7fe79b7fe640 1 -- 172.21.15.17:0/1755159904 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78c00cd90 con 0x7fe7a40c7680 2024-09-05T07:29:54.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.451+0000 7fe7a95c6640 1 -- 172.21.15.17:0/1755159904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7a4073070 con 0x7fe7a40c7680 2024-09-05T07:29:54.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.452+0000 7fe7a95c6640 1 -- 172.21.15.17:0/1755159904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7a40738f0 con 0x7fe7a40c7680 2024-09-05T07:29:54.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.454+0000 7fe7ac436740 1 Processor -- start 2024-09-05T07:29:54.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.454+0000 7fe7ac436740 1 -- start start 2024-09-05T07:29:54.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.455+0000 7fe7ac436740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00069a750 0x55f0006d29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:54.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.455+0000 7fe7ac436740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f000697f80 0x55f0006d2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:54.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.455+0000 7fe7ac436740 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f00069ab30 0x55f000696a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:54.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.455+0000 7fe7ac436740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f0005fb520 con 0x55f00069a750 2024-09-05T07:29:54.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.455+0000 7fe7ac436740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55f0005a33e0 con 0x55f000697f80 2024-09-05T07:29:54.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.455+0000 7fe7ac436740 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x55f0005f74e0 con 0x55f00069ab30 2024-09-05T07:29:54.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.456+0000 7fe7a27fc640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f00069ab30 0x55f000696a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:54.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.456+0000 7fe7a37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00069a750 0x55f0006d29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:54.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.456+0000 7fe7a27fc640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f00069ab30 0x55f000696a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:49564/0 (socket says 172.21.15.17:49564) 2024-09-05T07:29:54.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.456+0000 7fe7a27fc640 1 -- 172.21.15.17:0/3424596922 learned_addr learned my addr 172.21.15.17:0/3424596922 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:54.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.458+0000 7fe7a27fc640 1 -- 172.21.15.17:0/3424596922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f000697f80 msgr2=0x55f0006d2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:54.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.458+0000 7fe7a27fc640 1 --2- 172.21.15.17:0/3424596922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f000697f80 0x55f0006d2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.458+0000 7fe7a27fc640 1 -- 172.21.15.17:0/3424596922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00069a750 msgr2=0x55f0006d29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:54.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.458+0000 7fe7a27fc640 1 --2- 172.21.15.17:0/3424596922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00069a750 0x55f0006d29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.458+0000 7fe7a27fc640 1 -- 172.21.15.17:0/3424596922 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0005be2f0 con 0x55f00069ab30 2024-09-05T07:29:54.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.460+0000 7fe7a27fc640 1 --2- 172.21.15.17:0/3424596922 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f00069ab30 0x55f000696a60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe7a40ca860 tx=0x7fe78c013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86ca801596165c85 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:54.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.464+0000 7fe798ff9640 1 -- 172.21.15.17:0/3424596922 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78c021060 con 0x55f00069ab30 2024-09-05T07:29:54.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.464+0000 7fe798ff9640 1 -- 172.21.15.17:0/3424596922 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe78c013670 con 0x55f00069ab30 2024-09-05T07:29:54.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.464+0000 7fe798ff9640 1 -- 172.21.15.17:0/3424596922 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78c013a20 con 0x55f00069ab30 2024-09-05T07:29:54.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.464+0000 7fe7ac436740 1 -- 172.21.15.17:0/3424596922 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f00069ab30 msgr2=0x55f000696a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:54.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.465+0000 7fe7ac436740 1 --2- 172.21.15.17:0/3424596922 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f00069ab30 0x55f000696a60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe7a40ca860 tx=0x7fe78c013000 comp rx=0 tx=0).stop 2024-09-05T07:29:54.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.465+0000 7fe7ac436740 1 -- 172.21.15.17:0/3424596922 shutdown_connections 2024-09-05T07:29:54.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.465+0000 7fe7ac436740 1 --2- 172.21.15.17:0/3424596922 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f00069ab30 0x55f000696a60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.465+0000 7fe7ac436740 1 --2- 172.21.15.17:0/3424596922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f000697f80 0x55f0006d2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.465+0000 7fe7ac436740 1 --2- 172.21.15.17:0/3424596922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00069a750 0x55f0006d29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.465+0000 7fe7ac436740 1 -- 172.21.15.17:0/3424596922 >> 172.21.15.17:0/3424596922 conn(0x55f000698e70 msgr2=0x55f000699270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:54.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.465+0000 7fe7ac436740 1 -- 172.21.15.17:0/3424596922 shutdown_connections 2024-09-05T07:29:54.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.465+0000 7fe7ac436740 1 -- 172.21.15.17:0/3424596922 wait complete. 2024-09-05T07:29:54.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.465+0000 7fe7ac436740 1 -- start start 2024-09-05T07:29:54.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.465+0000 7fe7ac436740 1 Processor -- start 2024-09-05T07:29:54.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.466+0000 7fe7ac436740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f000697f80 0x55f0006c2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:54.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.466+0000 7fe7ac436740 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f00069a750 0x55f0006bde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:54.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.466+0000 7fe7ac436740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00069ab30 0x55f0006bac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:54.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.466+0000 7fe7ac436740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f0005f74e0 con 0x55f00069ab30 2024-09-05T07:29:54.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.466+0000 7fe7ac436740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55f000584450 con 0x55f000697f80 2024-09-05T07:29:54.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.466+0000 7fe7ac436740 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x55f000699fe0 con 0x55f00069a750 2024-09-05T07:29:54.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.466+0000 7fe7ac436740 10 client.0 _ll_register_callbacks cb 0x55f00030dac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:29:54.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.467+0000 7fe7a2ffd640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f00069a750 0x55f0006bde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:54.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.467+0000 7fe7a27fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00069ab30 0x55f0006bac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:54.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.467+0000 7fe7a2ffd640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f00069a750 0x55f0006bde90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:49576/0 (socket says 172.21.15.17:49576) 2024-09-05T07:29:54.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.467+0000 7fe7a2ffd640 1 -- 172.21.15.17:0/1221199234 learned_addr learned my addr 172.21.15.17:0/1221199234 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:54.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.470+0000 7fe7a2ffd640 1 -- 172.21.15.17:0/1221199234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f000697f80 msgr2=0x55f0006c2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:54.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.470+0000 7fe7a2ffd640 1 --2- 172.21.15.17:0/1221199234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f000697f80 0x55f0006c2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.470+0000 7fe7a2ffd640 1 -- 172.21.15.17:0/1221199234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00069ab30 msgr2=0x55f0006bac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:54.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.470+0000 7fe7a2ffd640 1 --2- 172.21.15.17:0/1221199234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00069ab30 0x55f0006bac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.470+0000 7fe7a2ffd640 1 -- 172.21.15.17:0/1221199234 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55f00030e2d0 con 0x55f00069a750 2024-09-05T07:29:54.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.472+0000 7fe7a2ffd640 1 --2- 172.21.15.17:0/1221199234 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f00069a750 0x55f0006bde90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe794009e80 tx=0x7fe794004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32e6391705c3fd28 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:54.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.473+0000 7fe781ffb640 10 client.0 ms_handle_connect on v2:172.21.15.26:3301/0 2024-09-05T07:29:54.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.475+0000 7fe79b7fe640 1 -- 172.21.15.17:0/1755159904 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe78c01a070 con 0x7fe7a40c7680 2024-09-05T07:29:54.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.475+0000 7fe79b7fe640 1 --2- 172.21.15.17:0/1755159904 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fe78406bdf0 0x7fe78406e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:54.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.475+0000 7fe7a37fe640 1 --2- 172.21.15.17:0/1755159904 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fe78406bdf0 0x7fe78406e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:54.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.476+0000 7fe7a37fe640 1 --2- 172.21.15.17:0/1755159904 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fe78406bdf0 0x7fe78406e2b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe7a40cbb10 tx=0x7fe79c000ed0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:54.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.476+0000 7fe781ffb640 1 -- 172.21.15.17:0/1221199234 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79403c620 con 0x55f00069a750 2024-09-05T07:29:54.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.476+0000 7fe781ffb640 1 -- 172.21.15.17:0/1221199234 <== mon.2 v2:172.21.15.26:3301/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe794046aa0 con 0x55f00069a750 2024-09-05T07:29:54.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.476+0000 7fe7ac436740 1 -- 172.21.15.17:0/1221199234 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe78c013670 con 0x55f00069a750 2024-09-05T07:29:54.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.478+0000 7fe781ffb640 1 -- 172.21.15.17:0/1221199234 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fe794046ca0 con 0x55f00069a750 2024-09-05T07:29:54.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.478+0000 7fe7ac436740 10 client.4484 fetch_fsmap learned FSMap version 18 2024-09-05T07:29:54.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.478+0000 7fe7ac436740 1 -- 172.21.15.17:0/1221199234 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55f0003d86b0 con 0x55f00069a750 2024-09-05T07:29:54.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.480+0000 7fe79b7fe640 1 -- 172.21.15.17:0/1755159904 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe78c013470 con 0x7fe7a40c7680 2024-09-05T07:29:54.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.483+0000 7fe781ffb640 1 -- 172.21.15.17:0/1221199234 <== mon.2 v2:172.21.15.26:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe78c013670 con 0x55f00069a750 2024-09-05T07:29:54.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.483+0000 7fe781ffb640 1 -- 172.21.15.17:0/1221199234 <== mon.2 v2:172.21.15.26:3301/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fe79404d050 con 0x55f00069a750 2024-09-05T07:29:54.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.483+0000 7fe7ac436740 10 client.4484 fetch_fsmap finished waiting for FSMap version 18 2024-09-05T07:29:54.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.483+0000 7fe7ac436740 10 client.4484 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-05T07:29:54.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.483+0000 7fe7ac436740 20 client.4484 populate_metadata read hostname 'smithi017' 2024-09-05T07:29:54.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.483+0000 7fe7ac436740 1 --2- 172.21.15.17:0/1221199234 >> [v2:172.21.15.26:6834/656329439,v1:172.21.15.26:6835/656329439] conn(0x55f0006ea3c0 0x55f0006f8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:54.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.483+0000 7fe7ac436740 4 client.4484 mds_command: new command op to 4261 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T07:29:54.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.483+0000 7fe7ac436740 1 -- 172.21.15.17:0/1221199234 --> [v2:172.21.15.26:6834/656329439,v1:172.21.15.26:6835/656329439] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f000608c50 con 0x55f0006ea3c0 2024-09-05T07:29:54.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.484+0000 7fe7a27fc640 1 --2- 172.21.15.17:0/1221199234 >> [v2:172.21.15.26:6834/656329439,v1:172.21.15.26:6835/656329439] conn(0x55f0006ea3c0 0x55f0006f8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:54.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.524+0000 7fe7a27fc640 1 --2- 172.21.15.17:0/1221199234 >> [v2:172.21.15.26:6834/656329439,v1:172.21.15.26:6835/656329439] conn(0x55f0006ea3c0 0x55f0006f8570 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f34a38a6ce75a0f7 server_cookie=f9c6840448f44925 in_seq=0 out_seq=0 2024-09-05T07:29:54.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.524+0000 7fe781ffb640 10 client.4484 ms_handle_connect on v2:172.21.15.26:6834/656329439 2024-09-05T07:29:54.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.642+0000 7fe781ffb640 1 -- 172.21.15.17:0/1221199234 <== mds.0 v2:172.21.15.26:6834/656329439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f000608c50 con 0x55f0006ea3c0 2024-09-05T07:29:54.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.642+0000 7fe781ffb640 10 client.4484 handle_command_reply: tid=0 2024-09-05T07:29:54.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.642+0000 7fe7ac436740 1 client.4484 shutdown 2024-09-05T07:29:54.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.642+0000 7fe7ac436740 1 -- 172.21.15.17:0/1221199234 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f00069a750 msgr2=0x55f0006bde90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:54.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.642+0000 7fe7ac436740 1 --2- 172.21.15.17:0/1221199234 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f00069a750 0x55f0006bde90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe794009e80 tx=0x7fe794004a40 comp rx=0 tx=0).stop 2024-09-05T07:29:54.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.642+0000 7fe7ac436740 1 -- 172.21.15.17:0/1221199234 shutdown_connections 2024-09-05T07:29:54.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.642+0000 7fe7ac436740 1 --2- 172.21.15.17:0/1221199234 >> [v2:172.21.15.26:6834/656329439,v1:172.21.15.26:6835/656329439] conn(0x55f0006ea3c0 0x55f0006f8570 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.642+0000 7fe7ac436740 1 --2- 172.21.15.17:0/1221199234 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f00069a750 0x55f0006bde90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.642+0000 7fe7ac436740 1 --2- 172.21.15.17:0/1221199234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00069ab30 0x55f0006bac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.642+0000 7fe781ffb640 0 client.4484 ms_handle_reset on v2:172.21.15.26:6834/656329439 2024-09-05T07:29:54.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.642+0000 7fe7ac436740 1 --2- 172.21.15.17:0/1221199234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f000697f80 0x55f0006c2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.642+0000 7fe7ac436740 1 -- 172.21.15.17:0/1221199234 >> 172.21.15.17:0/1221199234 conn(0x55f000698e70 msgr2=0x55f0006d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:54.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.642+0000 7fe7ac436740 1 -- 172.21.15.17:0/1221199234 shutdown_connections 2024-09-05T07:29:54.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.642+0000 7fe7ac436740 1 -- 172.21.15.17:0/1221199234 wait complete. 2024-09-05T07:29:54.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.642+0000 7fe7ac436740 20 client.4484 trim_cache size 0 max 16384 2024-09-05T07:29:54.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.661+0000 7fe7ac436740 1 Processor -- start 2024-09-05T07:29:54.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.661+0000 7fe7ac436740 1 -- start start 2024-09-05T07:29:54.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.661+0000 7fe7ac436740 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f000697f80 0x55f0006939c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:54.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.661+0000 7fe7ac436740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00069a750 0x55f0006ba960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:54.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.661+0000 7fe7ac436740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f00069ab30 0x55f0006baea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:54.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.661+0000 7fe7ac436740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a41466f0 con 0x55f00069a750 2024-09-05T07:29:54.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.661+0000 7fe7ac436740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55f0006c27a0 con 0x55f00069ab30 2024-09-05T07:29:54.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.661+0000 7fe7ac436740 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x55f0006c4ab0 con 0x55f000697f80 2024-09-05T07:29:54.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.662+0000 7fe7a2ffd640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f000697f80 0x55f0006939c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:54.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.662+0000 7fe7a27fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00069a750 0x55f0006ba960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:54.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.662+0000 7fe7a37fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f00069ab30 0x55f0006baea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:54.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.662+0000 7fe7a2ffd640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f000697f80 0x55f0006939c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:49582/0 (socket says 172.21.15.17:49582) 2024-09-05T07:29:54.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.662+0000 7fe7a2ffd640 1 -- 172.21.15.17:0/4113059226 learned_addr learned my addr 172.21.15.17:0/4113059226 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:54.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.665+0000 7fe7a2ffd640 1 -- 172.21.15.17:0/4113059226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f00069ab30 msgr2=0x55f0006baea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:54.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.665+0000 7fe7a2ffd640 1 --2- 172.21.15.17:0/4113059226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f00069ab30 0x55f0006baea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.665+0000 7fe7a2ffd640 1 -- 172.21.15.17:0/4113059226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00069a750 msgr2=0x55f0006ba960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:54.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.665+0000 7fe7a2ffd640 1 --2- 172.21.15.17:0/4113059226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00069a750 0x55f0006ba960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.665+0000 7fe7a2ffd640 1 -- 172.21.15.17:0/4113059226 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f000698c60 con 0x55f000697f80 2024-09-05T07:29:54.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.666+0000 7fe7a2ffd640 1 --2- 172.21.15.17:0/4113059226 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f000697f80 0x55f0006939c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe794046ef0 tx=0x7fe794040000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52302104e2d07559 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:54.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.670+0000 7fe783fff640 1 -- 172.21.15.17:0/4113059226 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe794054070 con 0x55f000697f80 2024-09-05T07:29:54.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.670+0000 7fe783fff640 1 -- 172.21.15.17:0/4113059226 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7940078e0 con 0x55f000697f80 2024-09-05T07:29:54.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.670+0000 7fe783fff640 1 -- 172.21.15.17:0/4113059226 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe794003990 con 0x55f000697f80 2024-09-05T07:29:54.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.671+0000 7fe7ac436740 1 -- 172.21.15.17:0/4113059226 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f000697f80 msgr2=0x55f0006939c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:54.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.671+0000 7fe7ac436740 1 --2- 172.21.15.17:0/4113059226 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f000697f80 0x55f0006939c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe794046ef0 tx=0x7fe794040000 comp rx=0 tx=0).stop 2024-09-05T07:29:54.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.671+0000 7fe7ac436740 1 -- 172.21.15.17:0/4113059226 shutdown_connections 2024-09-05T07:29:54.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.671+0000 7fe7ac436740 1 --2- 172.21.15.17:0/4113059226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f00069ab30 0x55f0006baea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.671+0000 7fe7ac436740 1 --2- 172.21.15.17:0/4113059226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f00069a750 0x55f0006ba960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.671+0000 7fe7ac436740 1 --2- 172.21.15.17:0/4113059226 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f000697f80 0x55f0006939c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.671+0000 7fe7ac436740 1 -- 172.21.15.17:0/4113059226 >> 172.21.15.17:0/4113059226 conn(0x55f000698e70 msgr2=0x55f0006d6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:54.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.671+0000 7fe7ac436740 1 -- 172.21.15.17:0/4113059226 shutdown_connections 2024-09-05T07:29:54.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.671+0000 7fe7ac436740 1 -- 172.21.15.17:0/4113059226 wait complete. 2024-09-05T07:29:54.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.672+0000 7fe7ac436740 1 -- start start 2024-09-05T07:29:54.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.672+0000 7fe7ac436740 1 Processor -- start 2024-09-05T07:29:54.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.672+0000 7fe7ac436740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f000697f80 0x55f0006c1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:54.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.672+0000 7fe7ac436740 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f00069a750 0x55f0006beea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:54.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.672+0000 7fe7ac436740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f00069ab30 0x55f0006bf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:54.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.672+0000 7fe7ac436740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f0006be4c0 con 0x55f000697f80 2024-09-05T07:29:54.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.672+0000 7fe7ac436740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55f0006c0c60 con 0x55f00069ab30 2024-09-05T07:29:54.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.672+0000 7fe7ac436740 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x55f0006bb510 con 0x55f00069a750 2024-09-05T07:29:54.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.672+0000 7fe7ac436740 10 client.0 _ll_register_callbacks cb 0x7fe794009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T07:29:54.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.673+0000 7fe7a2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f000697f80 0x55f0006c1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:54.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.673+0000 7fe7a37fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f00069ab30 0x55f0006bf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:54.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.673+0000 7fe7a27fc640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f00069a750 0x55f0006beea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:54.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.673+0000 7fe7a27fc640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f00069a750 0x55f0006beea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:49588/0 (socket says 172.21.15.17:49588) 2024-09-05T07:29:54.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.673+0000 7fe7a27fc640 1 -- 172.21.15.17:0/863649256 learned_addr learned my addr 172.21.15.17:0/863649256 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:54.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.676+0000 7fe7a27fc640 1 -- 172.21.15.17:0/863649256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f00069ab30 msgr2=0x55f0006bf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:54.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.676+0000 7fe7a27fc640 1 --2- 172.21.15.17:0/863649256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f00069ab30 0x55f0006bf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.676+0000 7fe7a27fc640 1 -- 172.21.15.17:0/863649256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f000697f80 msgr2=0x55f0006c1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:54.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.676+0000 7fe7a27fc640 1 --2- 172.21.15.17:0/863649256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f000697f80 0x55f0006c1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.676+0000 7fe7a27fc640 1 -- 172.21.15.17:0/863649256 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55f000758ca0 con 0x55f00069a750 2024-09-05T07:29:54.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.679+0000 7fe7a27fc640 1 --2- 172.21.15.17:0/863649256 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f00069a750 0x55f0006beea0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe78c00e980 tx=0x7fe78c009110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30d61775abe49ddb server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:54.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.679+0000 7fe781ffb640 10 client.0 ms_handle_connect on v2:172.21.15.26:3301/0 2024-09-05T07:29:54.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.681+0000 7fe781ffb640 1 -- 172.21.15.17:0/863649256 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78c021040 con 0x55f00069a750 2024-09-05T07:29:54.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.681+0000 7fe7ac436740 1 -- 172.21.15.17:0/863649256 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7940078e0 con 0x55f00069a750 2024-09-05T07:29:54.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.683+0000 7fe781ffb640 1 -- 172.21.15.17:0/863649256 <== mon.2 v2:172.21.15.26:3301/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe78c059c00 con 0x55f00069a750 2024-09-05T07:29:54.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.684+0000 7fe781ffb640 1 -- 172.21.15.17:0/863649256 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fe78c064430 con 0x55f00069a750 2024-09-05T07:29:54.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.684+0000 7fe7ac436740 10 client.4490 fetch_fsmap learned FSMap version 18 2024-09-05T07:29:54.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.684+0000 7fe7ac436740 1 -- 172.21.15.17:0/863649256 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55f00075cfa0 con 0x55f00069a750 2024-09-05T07:29:54.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.688+0000 7fe781ffb640 1 -- 172.21.15.17:0/863649256 <== mon.2 v2:172.21.15.26:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7940078e0 con 0x55f00069a750 2024-09-05T07:29:54.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.688+0000 7fe781ffb640 1 -- 172.21.15.17:0/863649256 <== mon.2 v2:172.21.15.26:3301/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fe78c024060 con 0x55f00069a750 2024-09-05T07:29:54.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.688+0000 7fe7ac436740 10 client.4490 fetch_fsmap finished waiting for FSMap version 18 2024-09-05T07:29:54.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.688+0000 7fe7ac436740 10 client.4490 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-05T07:29:54.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.688+0000 7fe7ac436740 20 client.4490 populate_metadata read hostname 'smithi017' 2024-09-05T07:29:54.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.688+0000 7fe7ac436740 1 --2- 172.21.15.17:0/863649256 >> [v2:172.21.15.26:6834/656329439,v1:172.21.15.26:6835/656329439] conn(0x55f0007526a0 0x55f000752a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:54.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.688+0000 7fe7ac436740 4 client.4490 mds_command: new command op to 4261 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-05T07:29:54.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.688+0000 7fe7ac436740 1 -- 172.21.15.17:0/863649256 --> [v2:172.21.15.26:6834/656329439,v1:172.21.15.26:6835/656329439] -- command(tid 0: {"prefix": "status"}) -- 0x55f000602fa0 con 0x55f0007526a0 2024-09-05T07:29:54.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.689+0000 7fe7a2ffd640 1 --2- 172.21.15.17:0/863649256 >> [v2:172.21.15.26:6834/656329439,v1:172.21.15.26:6835/656329439] conn(0x55f0007526a0 0x55f000752a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:54.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.692+0000 7fe7a2ffd640 1 --2- 172.21.15.17:0/863649256 >> [v2:172.21.15.26:6834/656329439,v1:172.21.15.26:6835/656329439] conn(0x55f0007526a0 0x55f000752a80 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99f86aa3a06328e3 server_cookie=b22ead4ae42e3ca4 in_seq=0 out_seq=0 2024-09-05T07:29:54.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.692+0000 7fe781ffb640 10 client.4490 ms_handle_connect on v2:172.21.15.26:6834/656329439 2024-09-05T07:29:54.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.710+0000 7fe781ffb640 1 -- 172.21.15.17:0/863649256 <== mds.0 v2:172.21.15.26:6834/656329439 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55f000602fa0 con 0x55f0007526a0 2024-09-05T07:29:54.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.710+0000 7fe781ffb640 10 client.4490 handle_command_reply: tid=0 2024-09-05T07:29:54.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.710+0000 7fe7ac436740 1 client.4490 shutdown 2024-09-05T07:29:54.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.711+0000 7fe7ac436740 1 -- 172.21.15.17:0/863649256 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f00069a750 msgr2=0x55f0006beea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:54.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.711+0000 7fe7ac436740 1 --2- 172.21.15.17:0/863649256 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f00069a750 0x55f0006beea0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe78c00e980 tx=0x7fe78c009110 comp rx=0 tx=0).stop 2024-09-05T07:29:54.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.711+0000 7fe7ac436740 1 -- 172.21.15.17:0/863649256 shutdown_connections 2024-09-05T07:29:54.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.711+0000 7fe7ac436740 1 --2- 172.21.15.17:0/863649256 >> [v2:172.21.15.26:6834/656329439,v1:172.21.15.26:6835/656329439] conn(0x55f0007526a0 0x55f000752a80 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.711+0000 7fe7ac436740 1 --2- 172.21.15.17:0/863649256 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f00069a750 0x55f0006beea0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.711+0000 7fe781ffb640 0 client.4490 ms_handle_reset on v2:172.21.15.26:6834/656329439 2024-09-05T07:29:54.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.711+0000 7fe7ac436740 1 --2- 172.21.15.17:0/863649256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f00069ab30 0x55f0006bf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.711+0000 7fe7ac436740 1 --2- 172.21.15.17:0/863649256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f000697f80 0x55f0006c1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.711+0000 7fe7ac436740 1 -- 172.21.15.17:0/863649256 >> 172.21.15.17:0/863649256 conn(0x55f000698e70 msgr2=0x55f0006d6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:54.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.711+0000 7fe7ac436740 1 -- 172.21.15.17:0/863649256 shutdown_connections 2024-09-05T07:29:54.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.711+0000 7fe7ac436740 1 -- 172.21.15.17:0/863649256 wait complete. 2024-09-05T07:29:54.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.711+0000 7fe7ac436740 20 client.4490 trim_cache size 0 max 16384 2024-09-05T07:29:54.713 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-05T07:29:54.713 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "848dac54-74f8-48f3-8686-c6495dcb972b", 2024-09-05T07:29:54.713 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-09-05T07:29:54.713 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4261, 2024-09-05T07:29:54.714 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-05T07:29:54.714 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-05T07:29:54.714 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-05T07:29:54.714 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 23.801282456999999, 2024-09-05T07:29:54.714 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 18, 2024-09-05T07:29:54.714 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 22, 2024-09-05T07:29:54.714 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 22, 2024-09-05T07:29:54.714 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 30.300485699999999 2024-09-05T07:29:54.714 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-05T07:29:54.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.711+0000 7fe7a95c6640 1 -- 172.21.15.17:0/1755159904 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fe78406bdf0 msgr2=0x7fe78406e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:54.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.711+0000 7fe7a95c6640 1 --2- 172.21.15.17:0/1755159904 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fe78406bdf0 0x7fe78406e2b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe7a40cbb10 tx=0x7fe79c000ed0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.711+0000 7fe7a95c6640 1 -- 172.21.15.17:0/1755159904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7a40c7680 msgr2=0x7fe7a40c3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:54.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.711+0000 7fe7a95c6640 1 --2- 172.21.15.17:0/1755159904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7a40c7680 0x7fe7a40c3da0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe78c00e9b0 tx=0x7fe78c00ee70 comp rx=0 tx=0).stop 2024-09-05T07:29:54.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.711+0000 7fe7a95c6640 1 -- 172.21.15.17:0/1755159904 shutdown_connections 2024-09-05T07:29:54.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.711+0000 7fe7a95c6640 1 --2- 172.21.15.17:0/1755159904 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fe78406bdf0 0x7fe78406e2b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.711+0000 7fe7a95c6640 1 --2- 172.21.15.17:0/1755159904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7a415c840 0x7fe7a40cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.711+0000 7fe7a95c6640 1 --2- 172.21.15.17:0/1755159904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7a40c7680 0x7fe7a40c3da0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.711+0000 7fe7a95c6640 1 --2- 172.21.15.17:0/1755159904 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe7a40c72a0 0x7fe7a41f4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:54.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.711+0000 7fe7a95c6640 1 -- 172.21.15.17:0/1755159904 >> 172.21.15.17:0/1755159904 conn(0x7fe7a406fba0 msgr2=0x7fe7a406ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:54.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.711+0000 7fe7a95c6640 1 -- 172.21.15.17:0/1755159904 shutdown_connections 2024-09-05T07:29:54.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.711+0000 7fe7a95c6640 1 -- 172.21.15.17:0/1755159904 wait complete. 2024-09-05T07:29:54.723 INFO:teuthology.run_tasks:Running task sequential... 2024-09-05T07:29:54.734 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-05T07:29:54.734 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-05T07:29:54.735 INFO:teuthology.task.print:Enabling mgr modules 2024-09-05T07:29:54.735 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-05T07:29:54.769 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-05T07:29:54.770 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-05T07:29:54.770 INFO:tasks.ceph_fuse:client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2024-09-05T07:29:54.770 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-05T07:29:54.770 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-05T07:29:54.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:29:54.770 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-05T07:29:54.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:29:54.787 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2024-09-05T07:29:54.853 INFO:teuthology.orchestra.run.smithi017.stderr:Cannot find device "ceph-brx" 2024-09-05T07:29:54.854 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T07:29:54.854 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-05T07:29:54.855 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-05T07:29:54.855 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-05T07:29:54.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.997+0000 7f00235f8640 1 Processor -- start 2024-09-05T07:29:54.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.997+0000 7f00235f8640 1 -- start start 2024-09-05T07:29:54.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.998+0000 7f00235f8640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f001c1596c0 0x7f001c0c9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:54.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.998+0000 7f00235f8640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f001c06bcb0 con 0x7f001c0c79c0 2024-09-05T07:29:54.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.998+0000 7f00235f8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f001c06bf50 con 0x7f001c15ca10 2024-09-05T07:29:54.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:54.998+0000 7f00235f8640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f001c06cd10 con 0x7f001c1596c0 2024-09-05T07:29:55.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.029+0000 7f0021394640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f001c1596c0 0x7f001c0c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:55.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.029+0000 7f0021394640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f001c1596c0 0x7f001c0c9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:49600/0 (socket says 172.21.15.17:49600) 2024-09-05T07:29:55.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.029+0000 7f0021394640 1 -- 172.21.15.17:0/3763494737 learned_addr learned my addr 172.21.15.17:0/3763494737 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:55.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.032+0000 7f0021394640 1 -- 172.21.15.17:0/3763494737 >> v1:172.21.15.26:6789/0 conn(0x7f001c15ca10 legacy=0x7f001c0c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:29:55.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.032+0000 7f0021394640 1 -- 172.21.15.17:0/3763494737 >> v1:172.21.15.17:6789/0 conn(0x7f001c0c79c0 legacy=0x7f001c0729b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:55.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.032+0000 7f0021394640 1 -- 172.21.15.17:0/3763494737 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f001c06c230 con 0x7f001c1596c0 2024-09-05T07:29:55.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.035+0000 7f0021394640 1 --2- 172.21.15.17:0/3763494737 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f001c1596c0 0x7f001c0c9290 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f00180098a0 tx=0x7f001802a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a833645feb3add79 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:55.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.041+0000 7f0013fff640 1 -- 172.21.15.17:0/3763494737 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0018037070 con 0x7f001c1596c0 2024-09-05T07:29:55.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.041+0000 7f0013fff640 1 -- 172.21.15.17:0/3763494737 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0018032440 con 0x7f001c1596c0 2024-09-05T07:29:55.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.041+0000 7f0013fff640 1 -- 172.21.15.17:0/3763494737 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0018032810 con 0x7f001c1596c0 2024-09-05T07:29:55.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.042+0000 7f00235f8640 1 -- 172.21.15.17:0/3763494737 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f001c1596c0 msgr2=0x7f001c0c9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:55.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.042+0000 7f00235f8640 1 --2- 172.21.15.17:0/3763494737 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f001c1596c0 0x7f001c0c9290 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f00180098a0 tx=0x7f001802a290 comp rx=0 tx=0).stop 2024-09-05T07:29:55.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.042+0000 7f00235f8640 1 -- 172.21.15.17:0/3763494737 shutdown_connections 2024-09-05T07:29:55.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.042+0000 7f00235f8640 1 --2- 172.21.15.17:0/3763494737 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f001c1596c0 0x7f001c0c9290 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:55.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.042+0000 7f00235f8640 1 -- 172.21.15.17:0/3763494737 >> 172.21.15.17:0/3763494737 conn(0x7f001c0c9ae0 msgr2=0x7f001c0c9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:55.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.042+0000 7f00235f8640 1 -- 172.21.15.17:0/3763494737 shutdown_connections 2024-09-05T07:29:55.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.042+0000 7f00235f8640 1 -- 172.21.15.17:0/3763494737 wait complete. 2024-09-05T07:29:55.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.043+0000 7f00235f8640 1 Processor -- start 2024-09-05T07:29:55.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.043+0000 7f00235f8640 1 -- start start 2024-09-05T07:29:55.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.044+0000 7f00235f8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f001c0c79c0 0x7f001c15ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:55.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.044+0000 7f00235f8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f001c1596c0 0x7f001c14e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:55.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.044+0000 7f00235f8640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f001c15ca10 0x7f001c0cc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:55.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.044+0000 7f00235f8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f001c15cea0 con 0x7f001c1596c0 2024-09-05T07:29:55.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.044+0000 7f00235f8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f001c06c7f0 con 0x7f001c0c79c0 2024-09-05T07:29:55.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.044+0000 7f00235f8640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f001c0c9880 con 0x7f001c15ca10 2024-09-05T07:29:55.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.044+0000 7f0020b93640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f001c1596c0 0x7f001c14e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:55.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.045+0000 7f0021394640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f001c0c79c0 0x7f001c15ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:55.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.045+0000 7f0021b95640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f001c15ca10 0x7f001c0cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:55.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.045+0000 7f0020b93640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f001c1596c0 0x7f001c14e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56660/0 (socket says 172.21.15.17:56660) 2024-09-05T07:29:55.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.045+0000 7f0020b93640 1 -- 172.21.15.17:0/660942972 learned_addr learned my addr 172.21.15.17:0/660942972 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:29:55.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.048+0000 7f0020b93640 1 -- 172.21.15.17:0/660942972 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f001c15ca10 msgr2=0x7f001c0cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:55.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.048+0000 7f0020b93640 1 --2- 172.21.15.17:0/660942972 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f001c15ca10 0x7f001c0cc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:55.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.048+0000 7f0020b93640 1 -- 172.21.15.17:0/660942972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f001c0c79c0 msgr2=0x7f001c15ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:55.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.048+0000 7f0020b93640 1 --2- 172.21.15.17:0/660942972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f001c0c79c0 0x7f001c15ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:55.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.048+0000 7f0020b93640 1 -- 172.21.15.17:0/660942972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f001c15b270 con 0x7f001c1596c0 2024-09-05T07:29:55.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.050+0000 7f0020b93640 1 --2- 172.21.15.17:0/660942972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f001c1596c0 0x7f001c14e8b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f000c00c3a0 tx=0x7f000c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:55.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.054+0000 7f0011ffb640 1 -- 172.21.15.17:0/660942972 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c0052d0 con 0x7f001c1596c0 2024-09-05T07:29:55.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.054+0000 7f0011ffb640 1 -- 172.21.15.17:0/660942972 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f000c005490 con 0x7f001c1596c0 2024-09-05T07:29:55.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.054+0000 7f0011ffb640 1 -- 172.21.15.17:0/660942972 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c007260 con 0x7f001c1596c0 2024-09-05T07:29:55.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.054+0000 7f00235f8640 1 -- 172.21.15.17:0/660942972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f001c15aa10 con 0x7f001c1596c0 2024-09-05T07:29:55.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.054+0000 7f00235f8640 1 -- 172.21.15.17:0/660942972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f001c1f07e0 con 0x7f001c1596c0 2024-09-05T07:29:55.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.055+0000 7f00235f8640 1 -- 172.21.15.17:0/660942972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f001c14edf0 con 0x7f001c1596c0 2024-09-05T07:29:55.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.330+0000 7f0011ffb640 1 -- 172.21.15.17:0/660942972 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f000c007400 con 0x7f001c1596c0 2024-09-05T07:29:55.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.330+0000 7f0011ffb640 1 --2- 172.21.15.17:0/660942972 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f000006be80 0x7f000006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:29:55.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.331+0000 7f0021394640 1 --2- 172.21.15.17:0/660942972 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f000006be80 0x7f000006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:29:55.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.331+0000 7f0021394640 1 --2- 172.21.15.17:0/660942972 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f000006be80 0x7f000006e340 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0018034000 tx=0x7f001802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:29:55.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.346+0000 7f0011ffb640 1 -- 172.21.15.17:0/660942972 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f000c056f20 con 0x7f001c1596c0 2024-09-05T07:29:55.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.346+0000 7f0011ffb640 1 -- 172.21.15.17:0/660942972 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f000c058e80 con 0x7f001c1596c0 2024-09-05T07:29:55.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.558+0000 7f00235f8640 1 -- 172.21.15.17:0/660942972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f001c0c9490 con 0x7f001c1596c0 2024-09-05T07:29:55.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.565+0000 7f0011ffb640 1 -- 172.21.15.17:0/660942972 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+73 (secure 0 0 0) 0x7f000c05d180 con 0x7f001c1596c0 2024-09-05T07:29:55.565 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-05T07:29:55.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.567+0000 7f00235f8640 1 -- 172.21.15.17:0/660942972 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f000006be80 msgr2=0x7f000006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:55.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.567+0000 7f00235f8640 1 --2- 172.21.15.17:0/660942972 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f000006be80 0x7f000006e340 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0018034000 tx=0x7f001802e000 comp rx=0 tx=0).stop 2024-09-05T07:29:55.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.567+0000 7f00235f8640 1 -- 172.21.15.17:0/660942972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f001c1596c0 msgr2=0x7f001c14e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:29:55.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.567+0000 7f00235f8640 1 --2- 172.21.15.17:0/660942972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f001c1596c0 0x7f001c14e8b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f000c00c3a0 tx=0x7f000c00c860 comp rx=0 tx=0).stop 2024-09-05T07:29:55.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.567+0000 7f00235f8640 1 -- 172.21.15.17:0/660942972 shutdown_connections 2024-09-05T07:29:55.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.567+0000 7f00235f8640 1 --2- 172.21.15.17:0/660942972 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f000006be80 0x7f000006e340 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:55.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.567+0000 7f00235f8640 1 --2- 172.21.15.17:0/660942972 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f001c15ca10 0x7f001c0cc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:55.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.567+0000 7f00235f8640 1 --2- 172.21.15.17:0/660942972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f001c1596c0 0x7f001c14e8b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:55.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.567+0000 7f00235f8640 1 --2- 172.21.15.17:0/660942972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f001c0c79c0 0x7f001c15ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:29:55.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.567+0000 7f00235f8640 1 -- 172.21.15.17:0/660942972 >> 172.21.15.17:0/660942972 conn(0x7f001c0c9ae0 msgr2=0x7f001c06e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:29:55.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.567+0000 7f00235f8640 1 -- 172.21.15.17:0/660942972 shutdown_connections 2024-09-05T07:29:55.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55.567+0000 7f00235f8640 1 -- 172.21.15.17:0/660942972 wait complete. 2024-09-05T07:29:55.579 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-05T07:29:55.579 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-05T07:29:55.579 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2024-09-05T07:29:55.579 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-05T07:29:55.579 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-05T07:29:55.579 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-05T07:29:55.579 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-05T07:29:55.579 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-05T07:29:55.579 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-05T07:29:55.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:29:55.580 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2024-09-05T07:29:55.595 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-05T07:29:55.595 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-05T07:29:55.595 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-09-05T07:29:55.595 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-05T07:29:55.595 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-09-05T07:29:55.596 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-05T07:29:55.596 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-05T07:29:55.596 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2024-09-05T07:29:55.596 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2024-09-05T07:29:55.596 INFO:teuthology.orchestra.run.smithi017.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-05T07:29:55.596 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2024-09-05T07:29:55.596 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2024-09-05T07:29:55.596 INFO:teuthology.orchestra.run.smithi017.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-05T07:29:55.596 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2024-09-05T07:29:55.597 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2024-09-05T07:29:55.597 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-05T07:29:55.597 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 42385sec preferred_lft 42385sec 2024-09-05T07:29:55.597 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::bf93:a02d:532e:8a7e/64 scope link noprefixroute 2024-09-05T07:29:55.597 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-05T07:29:55.597 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-05T07:29:55.597 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2024-09-05T07:29:55.597 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2024-09-05T07:29:55.597 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-05T07:29:55.598 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-05T07:29:55.598 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-05T07:29:55.598 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add name ceph-brx type bridge 2024-09-05T07:29:55.598 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr flush dev ceph-brx 2024-09-05T07:29:55.598 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set ceph-brx up 2024-09-05T07:29:55.598 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-05T07:29:55.598 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-05T07:29:55.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-05T07:29:55.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-05T07:29:55.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:29:55.797 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-05T07:29:55.823 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-09-05T07:29:55.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:29:55.824 DEBUG:teuthology.orchestra.run.smithi017:> route 2024-09-05T07:29:55.893 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2024-09-05T07:29:55.893 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-05T07:29:55.893 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-05T07:29:55.893 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-05T07:29:55.894 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-05T07:29:55.894 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-05T07:29:55.894 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-05T07:29:55.894 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-05T07:29:55.894 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-05T07:29:55.894 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-05T07:29:55.894 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-05T07:29:55.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-05T07:29:56.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-05T07:29:56.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:29:56.177 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-05T07:29:56.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:29:56.192 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list-id 2024-09-05T07:29:56.248 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-05T07:29:56.248 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-05T07:29:56.248 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-05T07:29:56.248 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-05T07:29:56.249 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-05T07:29:56.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-05T07:29:56.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-05T07:29:56.377 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-05T07:29:56.378 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-05T07:29:56.378 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-05T07:29:56.378 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-05T07:29:56.378 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-05T07:29:56.378 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-05T07:29:56.378 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-05T07:29:56.378 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-05T07:29:56.378 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-05T07:29:56.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-05T07:29:56.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-05T07:29:56.517 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-05T07:29:56.517 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-05T07:29:56.518 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2024-09-05T07:29:56.518 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set dev brx.0 master ceph-brx 2024-09-05T07:29:56.518 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-05T07:29:56.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-05T07:29:56.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:29:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-05T07:29:56.597 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2024-09-05T07:29:56.597 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-05T07:29:56.598 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-05T07:29:56.613 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-05T07:29:56.614 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-05T07:29:56.614 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-05T07:29:56.668 DEBUG:tasks.ceph_manager:running client.0 under valgrind with args ['sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/client.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-09-05T07:29:56.669 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-05T07:29:56.735 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-05T07:29:56.792 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-05T07:29:56.792 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-05T07:29:56.792 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-05T07:29:56.792 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-05T07:29:56.792 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-05T07:29:56.792 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-05T07:29:56.792 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-05T07:29:56.792 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-05T07:29:56.793 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-05T07:29:56.793 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-05T07:29:56.793 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-05T07:29:56.793 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2024-09-05T07:29:56.793 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-05T07:29:56.793 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-05T07:29:56.793 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-05T07:29:56.793 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-05T07:29:56.793 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-05T07:29:56.793 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-05T07:29:56.793 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-05T07:29:56.793 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-05T07:29:56.793 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysctl.service 2024-09-05T07:29:56.793 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-05T07:29:56.794 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-05T07:29:56.794 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2024-09-05T07:29:56.794 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-05T07:29:56.794 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-05T07:29:56.794 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-05T07:29:56.794 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-05T07:29:56.794 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-05T07:29:56.794 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-05T07:29:56.794 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-05T07:29:56.794 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-05T07:29:56.794 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-05T07:29:56.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:29:56.795 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-05T07:29:56.848 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-05T07:29:56.849 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/client.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-05T07:29:56.890 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-05T07:29:56.916 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-05T07:29:56.973 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-05T07:29:56.973 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-05T07:29:56.974 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-05T07:29:56.974 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-05T07:29:56.974 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-05T07:29:56.974 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-05T07:29:56.974 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-05T07:29:56.974 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-05T07:29:56.974 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-05T07:29:56.974 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-05T07:29:56.974 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-05T07:29:56.974 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2024-09-05T07:29:56.974 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-05T07:29:56.974 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-05T07:29:56.974 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-05T07:29:56.975 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-05T07:29:56.975 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-05T07:29:56.975 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-05T07:29:56.975 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-05T07:29:56.975 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-05T07:29:56.975 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysctl.service 2024-09-05T07:29:56.975 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-05T07:29:56.975 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-05T07:29:56.975 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2024-09-05T07:29:56.975 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-05T07:29:56.975 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-05T07:29:56.975 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-05T07:29:56.975 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-05T07:29:56.975 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-05T07:29:56.976 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-05T07:29:56.976 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-05T07:29:56.976 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-05T07:29:56.976 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-05T07:29:56.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:29:56.976 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-05T07:29:58.131 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-05T07:29:58.159 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-05T07:29:58.215 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-05T07:29:58.215 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-05T07:29:58.215 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-05T07:29:58.216 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-05T07:29:58.216 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-05T07:29:58.216 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-05T07:29:58.216 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-05T07:29:58.216 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-05T07:29:58.216 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-05T07:29:58.216 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-05T07:29:58.216 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-05T07:29:58.216 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2024-09-05T07:29:58.216 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-05T07:29:58.216 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-05T07:29:58.216 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-05T07:29:58.216 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-05T07:29:58.217 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-05T07:29:58.217 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-05T07:29:58.217 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-05T07:29:58.217 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-05T07:29:58.217 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysctl.service 2024-09-05T07:29:58.217 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-05T07:29:58.217 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-05T07:29:58.217 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2024-09-05T07:29:58.217 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-05T07:29:58.217 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-05T07:29:58.217 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-05T07:29:58.217 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-05T07:29:58.217 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-05T07:29:58.218 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-05T07:29:58.218 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-05T07:29:58.218 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-05T07:29:58.218 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-05T07:29:58.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:29:58.218 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-05T07:29:59.372 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-05T07:29:59.398 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-05T07:29:59.454 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-05T07:29:59.454 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-05T07:29:59.454 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-05T07:29:59.454 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-05T07:29:59.454 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-05T07:29:59.455 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-05T07:29:59.455 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-05T07:29:59.455 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-05T07:29:59.455 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-05T07:29:59.455 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-05T07:29:59.455 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-05T07:29:59.455 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2024-09-05T07:29:59.455 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-05T07:29:59.455 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-05T07:29:59.455 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-05T07:29:59.455 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-05T07:29:59.455 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-05T07:29:59.455 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-05T07:29:59.456 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-05T07:29:59.456 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-05T07:29:59.456 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysctl.service 2024-09-05T07:29:59.456 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-05T07:29:59.456 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-05T07:29:59.456 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2024-09-05T07:29:59.456 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-05T07:29:59.456 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-05T07:29:59.456 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-05T07:29:59.456 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-05T07:29:59.456 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-05T07:29:59.456 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-05T07:29:59.456 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-05T07:29:59.457 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-05T07:29:59.457 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-05T07:29:59.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:29:59.457 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-05T07:30:00.613 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-05T07:30:00.639 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-05T07:30:00.695 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-05T07:30:00.696 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-05T07:30:00.696 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-05T07:30:00.696 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-05T07:30:00.696 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-05T07:30:00.696 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-05T07:30:00.696 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-05T07:30:00.696 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-05T07:30:00.696 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-05T07:30:00.696 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-05T07:30:00.696 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-05T07:30:00.696 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2024-09-05T07:30:00.697 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-05T07:30:00.697 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-05T07:30:00.697 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-05T07:30:00.697 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-05T07:30:00.697 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-05T07:30:00.697 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-05T07:30:00.697 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-05T07:30:00.697 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-05T07:30:00.697 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysctl.service 2024-09-05T07:30:00.697 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-05T07:30:00.697 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-05T07:30:00.697 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2024-09-05T07:30:00.697 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-05T07:30:00.697 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-05T07:30:00.698 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-05T07:30:00.698 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-05T07:30:00.698 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-05T07:30:00.698 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-05T07:30:00.698 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-05T07:30:00.698 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-05T07:30:00.698 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-05T07:30:00.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:30:00.698 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-05T07:30:01.854 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-05T07:30:01.879 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-05T07:30:01.935 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-05T07:30:01.935 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-05T07:30:01.935 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-05T07:30:01.935 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-05T07:30:01.936 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-05T07:30:01.936 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-05T07:30:01.936 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-05T07:30:01.936 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-05T07:30:01.936 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-05T07:30:01.936 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-05T07:30:01.936 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-05T07:30:01.936 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2024-09-05T07:30:01.936 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-05T07:30:01.936 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-05T07:30:01.936 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-05T07:30:01.936 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-05T07:30:01.936 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-05T07:30:01.937 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-05T07:30:01.937 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-05T07:30:01.937 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-05T07:30:01.937 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysctl.service 2024-09-05T07:30:01.937 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-05T07:30:01.937 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-05T07:30:01.937 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2024-09-05T07:30:01.937 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-05T07:30:01.937 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-05T07:30:01.937 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-05T07:30:01.937 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-05T07:30:01.937 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-05T07:30:01.937 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-05T07:30:01.938 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-05T07:30:01.938 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-05T07:30:01.938 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-05T07:30:01.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:30:01.939 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-05T07:30:02.945 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[2024-09-05T07:30:02.829+0000 665f280 -1 init, newargv = 0x7b90730 newargc=15 2024-09-05T07:30:02.950 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:44638]: starting ceph client 2024-09-05T07:30:03.097 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-05T07:30:03.124 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-05T07:30:03.180 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-05T07:30:03.180 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-05T07:30:03.181 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-05T07:30:03.181 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-05T07:30:03.181 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-05T07:30:03.181 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-05T07:30:03.181 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-05T07:30:03.181 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-05T07:30:03.181 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-05T07:30:03.181 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-05T07:30:03.181 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-05T07:30:03.181 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2024-09-05T07:30:03.181 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-05T07:30:03.182 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-05T07:30:03.182 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-05T07:30:03.182 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-05T07:30:03.182 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-05T07:30:03.182 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-05T07:30:03.182 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-05T07:30:03.182 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-05T07:30:03.182 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysctl.service 2024-09-05T07:30:03.182 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-05T07:30:03.182 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-05T07:30:03.182 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2024-09-05T07:30:03.182 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-05T07:30:03.182 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-05T07:30:03.183 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-05T07:30:03.183 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-05T07:30:03.183 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-05T07:30:03.183 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-05T07:30:03.183 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-05T07:30:03.183 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-05T07:30:03.183 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-05T07:30:03.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:30:03.183 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-05T07:30:04.124 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[44638]: starting fuse 2024-09-05T07:30:04.337 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-05T07:30:04.362 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-05T07:30:04.422 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-05T07:30:04.422 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-05T07:30:04.422 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-05T07:30:04.422 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-05T07:30:04.422 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-05T07:30:04.422 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-05T07:30:04.422 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-05T07:30:04.422 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-05T07:30:04.423 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-05T07:30:04.423 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-05T07:30:04.423 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-05T07:30:04.423 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2024-09-05T07:30:04.423 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-05T07:30:04.423 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-05T07:30:04.423 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-05T07:30:04.423 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-05T07:30:04.423 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-05T07:30:04.423 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-05T07:30:04.423 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-05T07:30:04.423 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-05T07:30:04.423 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysctl.service 2024-09-05T07:30:04.424 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-05T07:30:04.424 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-05T07:30:04.424 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2024-09-05T07:30:04.424 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-05T07:30:04.424 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-05T07:30:04.424 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-05T07:30:04.424 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-05T07:30:04.424 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-05T07:30:04.424 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-05T07:30:04.424 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-05T07:30:04.424 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-05T07:30:04.424 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-05T07:30:04.424 INFO:teuthology.orchestra.run.smithi017.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-05T07:30:04.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:30:04.425 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-05T07:30:04.477 INFO:teuthology.orchestra.run.smithi017.stdout:43 2024-09-05T07:30:04.477 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-09-05T07:30:04.477 DEBUG:teuthology.orchestra.run.smithi017:> sudo stdin-killer -- python3 -c ' 2024-09-05T07:30:04.477 DEBUG:teuthology.orchestra.run.smithi017:> import glob 2024-09-05T07:30:04.477 DEBUG:teuthology.orchestra.run.smithi017:> import re 2024-09-05T07:30:04.478 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-05T07:30:04.478 DEBUG:teuthology.orchestra.run.smithi017:> import subprocess 2024-09-05T07:30:04.478 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-05T07:30:04.478 DEBUG:teuthology.orchestra.run.smithi017:> def _find_admin_socket(client_name): 2024-09-05T07:30:04.478 DEBUG:teuthology.orchestra.run.smithi017:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-05T07:30:04.478 DEBUG:teuthology.orchestra.run.smithi017:> files = glob.glob(asok_path) 2024-09-05T07:30:04.478 DEBUG:teuthology.orchestra.run.smithi017:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-05T07:30:04.478 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-05T07:30:04.478 DEBUG:teuthology.orchestra.run.smithi017:> # Given a non-glob path, it better be there 2024-09-05T07:30:04.478 DEBUG:teuthology.orchestra.run.smithi017:> if "*" not in asok_path: 2024-09-05T07:30:04.478 DEBUG:teuthology.orchestra.run.smithi017:> assert(len(files) == 1) 2024-09-05T07:30:04.478 DEBUG:teuthology.orchestra.run.smithi017:> return files[0] 2024-09-05T07:30:04.478 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-05T07:30:04.478 DEBUG:teuthology.orchestra.run.smithi017:> for f in files: 2024-09-05T07:30:04.478 DEBUG:teuthology.orchestra.run.smithi017:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-05T07:30:04.479 DEBUG:teuthology.orchestra.run.smithi017:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-05T07:30:04.479 DEBUG:teuthology.orchestra.run.smithi017:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-05T07:30:04.479 DEBUG:teuthology.orchestra.run.smithi017:> contents = proc_f.read() 2024-09-05T07:30:04.479 DEBUG:teuthology.orchestra.run.smithi017:> if mountpoint in contents: 2024-09-05T07:30:04.479 DEBUG:teuthology.orchestra.run.smithi017:> return f 2024-09-05T07:30:04.479 DEBUG:teuthology.orchestra.run.smithi017:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-05T07:30:04.479 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-05T07:30:04.479 DEBUG:teuthology.orchestra.run.smithi017:> print(_find_admin_socket("client.0")) 2024-09-05T07:30:04.479 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-05T07:30:04.597 INFO:teuthology.orchestra.run.smithi017.stdout:/var/run/ceph/ceph-client.0.44638.asok 2024-09-05T07:30:04.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:30:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-05T07:30:04.608 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44638.asok 2024-09-05T07:30:04.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:30:04.608 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44638.asok status 2024-09-05T07:30:04.847 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-05T07:30:04.848 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": { 2024-09-05T07:30:04.848 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_sha1": "91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4", 2024-09-05T07:30:04.848 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 19.1.1-259-g91c8a7e5 (91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4) squid (stable)", 2024-09-05T07:30:04.848 INFO:teuthology.orchestra.run.smithi017.stdout: "entity_id": "0", 2024-09-05T07:30:04.848 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": "smithi017", 2024-09-05T07:30:04.848 INFO:teuthology.orchestra.run.smithi017.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-05T07:30:04.848 INFO:teuthology.orchestra.run.smithi017.stdout: "pid": "44638", 2024-09-05T07:30:04.848 INFO:teuthology.orchestra.run.smithi017.stdout: "root": "/" 2024-09-05T07:30:04.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-05T07:30:04.848 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_count": 0, 2024-09-05T07:30:04.848 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_pinned_count": 0, 2024-09-05T07:30:04.849 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4539, 2024-09-05T07:30:04.849 INFO:teuthology.orchestra.run.smithi017.stdout: "inst": { 2024-09-05T07:30:04.849 INFO:teuthology.orchestra.run.smithi017.stdout: "name": { 2024-09-05T07:30:04.849 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "client", 2024-09-05T07:30:04.849 INFO:teuthology.orchestra.run.smithi017.stdout: "num": 4539 2024-09-05T07:30:04.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-05T07:30:04.849 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-05T07:30:04.849 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-05T07:30:04.849 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:0", 2024-09-05T07:30:04.850 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1783321229 2024-09-05T07:30:04.850 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-05T07:30:04.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-05T07:30:04.850 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-05T07:30:04.850 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-05T07:30:04.850 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:0", 2024-09-05T07:30:04.850 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1783321229 2024-09-05T07:30:04.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-05T07:30:04.850 INFO:teuthology.orchestra.run.smithi017.stdout: "inst_str": "client.4539 172.21.15.17:0/1783321229", 2024-09-05T07:30:04.850 INFO:teuthology.orchestra.run.smithi017.stdout: "addr_str": "172.21.15.17:0/1783321229", 2024-09-05T07:30:04.850 INFO:teuthology.orchestra.run.smithi017.stdout: "inode_count": 1, 2024-09-05T07:30:04.850 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_epoch": 18, 2024-09-05T07:30:04.850 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch": 24, 2024-09-05T07:30:04.851 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch_barrier": 0, 2024-09-05T07:30:04.851 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklisted": false, 2024-09-05T07:30:04.851 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs" 2024-09-05T07:30:04.851 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-05T07:30:04.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:30:04.857 DEBUG:teuthology.orchestra.run.smithi017:> stat --file-system '--printf=%T 2024-09-05T07:30:04.857 DEBUG:teuthology.orchestra.run.smithi017:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-05T07:30:04.919 INFO:teuthology.orchestra.run.smithi017.stdout:fuseblk 2024-09-05T07:30:04.919 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-05T07:30:04.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:30:04.920 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-05T07:30:05.279 INFO:teuthology.run_tasks:Running task workunit... 2024-09-05T07:30:05.294 INFO:tasks.workunit:Pulling workunits from ref 91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 2024-09-05T07:30:05.294 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-05T07:30:05.294 INFO:tasks.workunit:timeout=3h 2024-09-05T07:30:05.294 INFO:tasks.workunit:cleanup=True 2024-09-05T07:30:05.295 DEBUG:teuthology.orchestra.run.smithi017:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-05T07:30:05.389 INFO:teuthology.orchestra.run.smithi017.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-05T07:30:05.389 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-05T07:30:05.389 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 2bh/43d Inode: 1 Links: 2 2024-09-05T07:30:05.389 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T07:30:05.389 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-05T07:30:05.389 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-05T07:30:05.389 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-05 07:29:31.227499441 +0000 2024-09-05T07:30:05.389 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-05 07:30:04.967049453 +0000 2024-09-05T07:30:05.390 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: - 2024-09-05T07:30:05.390 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-05T07:30:05.390 DEBUG:teuthology.orchestra.run.smithi017:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-05T07:30:06.034 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 2024-09-05T07:30:06.050 INFO:tasks.workunit.client.0.smithi017.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-05T07:30:07.361 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:30:07.364 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:30:37.421 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:30:37.424 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:31:07.484 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:31:07.488 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:31:11.258 INFO:tasks.workunit.client.0.smithi017.stderr:Updating files: 94% (12154/12892) Updating files: 95% (12248/12892) Updating files: 96% (12377/12892) Updating files: 97% (12506/12892) Updating files: 98% (12635/12892) Updating files: 99% (12764/12892) Updating files: 100% (12892/12892) Updating files: 100% (12892/12892), done. 2024-09-05T07:31:11.845 INFO:tasks.workunit.client.0.smithi017.stderr:Note: switching to '91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4'. 2024-09-05T07:31:11.845 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-05T07:31:11.845 INFO:tasks.workunit.client.0.smithi017.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-05T07:31:11.845 INFO:tasks.workunit.client.0.smithi017.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-05T07:31:11.845 INFO:tasks.workunit.client.0.smithi017.stderr:state without impacting any branches by switching back to a branch. 2024-09-05T07:31:11.845 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-05T07:31:11.845 INFO:tasks.workunit.client.0.smithi017.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-05T07:31:11.845 INFO:tasks.workunit.client.0.smithi017.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-05T07:31:11.845 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-05T07:31:11.846 INFO:tasks.workunit.client.0.smithi017.stderr: git switch -c 2024-09-05T07:31:11.846 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-05T07:31:11.846 INFO:tasks.workunit.client.0.smithi017.stderr:Or undo this operation with: 2024-09-05T07:31:11.846 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-05T07:31:11.846 INFO:tasks.workunit.client.0.smithi017.stderr: git switch - 2024-09-05T07:31:11.846 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-05T07:31:11.846 INFO:tasks.workunit.client.0.smithi017.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-05T07:31:11.846 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-05T07:31:11.846 INFO:tasks.workunit.client.0.smithi017.stderr:HEAD is now at 91c8a7e56f7 Merge pull request #59582 from zdover23/wip-doc-2024-09-04-backport-59546-to-squid 2024-09-05T07:31:11.849 DEBUG:teuthology.orchestra.run.smithi017:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-05T07:31:11.893 INFO:tasks.workunit.client.0.smithi017.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-05T07:31:11.895 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-05T07:31:11.895 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-05T07:31:12.446 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-05T07:31:12.509 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-05T07:31:12.548 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-05T07:31:12.549 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-05T07:31:12.550 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-05T07:31:12.588 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-05T07:31:12.591 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-05T07:31:12.592 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-05T07:31:12.647 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2024-09-05T07:31:12.648 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2024-09-05T07:31:12.649 DEBUG:teuthology.orchestra.run.smithi017:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2024-09-05T07:31:12.937 INFO:tasks.workunit.client.0.smithi017.stderr:+ dbench 1 2024-09-05T07:31:12.947 INFO:tasks.workunit.client.0.smithi017.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-09-05T07:31:12.948 INFO:tasks.workunit.client.0.smithi017.stdout: 2024-09-05T07:31:12.948 INFO:tasks.workunit.client.0.smithi017.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-09-05T07:31:12.948 INFO:tasks.workunit.client.0.smithi017.stdout:0 of 1 processes prepared for launch 0 sec 2024-09-05T07:31:13.048 INFO:tasks.workunit.client.0.smithi017.stdout:1 of 1 processes prepared for launch 0 sec 2024-09-05T07:31:13.048 INFO:tasks.workunit.client.0.smithi017.stdout:releasing clients 2024-09-05T07:31:14.048 INFO:tasks.workunit.client.0.smithi017.stdout: 1 31 1.05 MB/sec warmup 1 sec latency 21.154 ms 2024-09-05T07:31:15.048 INFO:tasks.workunit.client.0.smithi017.stdout: 1 111 2.62 MB/sec warmup 2 sec latency 225.533 ms 2024-09-05T07:31:16.048 INFO:tasks.workunit.client.0.smithi017.stdout: 1 147 2.09 MB/sec warmup 3 sec latency 186.791 ms 2024-09-05T07:31:17.048 INFO:tasks.workunit.client.0.smithi017.stdout: 1 189 1.90 MB/sec warmup 4 sec latency 203.737 ms 2024-09-05T07:31:18.048 INFO:tasks.workunit.client.0.smithi017.stdout: 1 231 1.78 MB/sec warmup 5 sec latency 194.962 ms 2024-09-05T07:31:19.048 INFO:tasks.workunit.client.0.smithi017.stdout: 1 271 1.70 MB/sec warmup 6 sec latency 192.063 ms 2024-09-05T07:31:20.049 INFO:tasks.workunit.client.0.smithi017.stdout: 1 305 1.60 MB/sec warmup 7 sec latency 316.550 ms 2024-09-05T07:31:21.049 INFO:tasks.workunit.client.0.smithi017.stdout: 1 339 1.53 MB/sec warmup 8 sec latency 333.739 ms 2024-09-05T07:31:22.049 INFO:tasks.workunit.client.0.smithi017.stdout: 1 373 1.48 MB/sec warmup 9 sec latency 221.546 ms 2024-09-05T07:31:23.049 INFO:tasks.workunit.client.0.smithi017.stdout: 1 413 1.46 MB/sec warmup 10 sec latency 262.964 ms 2024-09-05T07:31:24.049 INFO:tasks.workunit.client.0.smithi017.stdout: 1 445 1.42 MB/sec warmup 11 sec latency 247.839 ms 2024-09-05T07:31:25.049 INFO:tasks.workunit.client.0.smithi017.stdout: 1 477 1.39 MB/sec warmup 12 sec latency 307.563 ms 2024-09-05T07:31:26.049 INFO:tasks.workunit.client.0.smithi017.stdout: 1 511 1.36 MB/sec warmup 13 sec latency 304.570 ms 2024-09-05T07:31:27.049 INFO:tasks.workunit.client.0.smithi017.stdout: 1 603 1.50 MB/sec warmup 14 sec latency 240.538 ms 2024-09-05T07:31:28.049 INFO:tasks.workunit.client.0.smithi017.stdout: 1 614 1.40 MB/sec warmup 15 sec latency 461.836 ms 2024-09-05T07:31:29.049 INFO:tasks.workunit.client.0.smithi017.stdout: 1 645 1.32 MB/sec warmup 16 sec latency 438.883 ms 2024-09-05T07:31:30.049 INFO:tasks.workunit.client.0.smithi017.stdout: 1 653 1.24 MB/sec warmup 17 sec latency 569.594 ms 2024-09-05T07:31:31.049 INFO:tasks.workunit.client.0.smithi017.stdout: 1 680 1.18 MB/sec warmup 18 sec latency 783.673 ms 2024-09-05T07:31:32.049 INFO:tasks.workunit.client.0.smithi017.stdout: 1 710 1.12 MB/sec warmup 19 sec latency 329.386 ms 2024-09-05T07:31:33.049 INFO:tasks.workunit.client.0.smithi017.stdout: 1 738 1.07 MB/sec warmup 20 sec latency 355.392 ms 2024-09-05T07:31:34.049 INFO:tasks.workunit.client.0.smithi017.stdout: 1 769 1.02 MB/sec warmup 21 sec latency 316.839 ms 2024-09-05T07:31:35.049 INFO:tasks.workunit.client.0.smithi017.stdout: 1 794 0.98 MB/sec warmup 22 sec latency 238.747 ms 2024-09-05T07:31:36.049 INFO:tasks.workunit.client.0.smithi017.stdout: 1 815 0.93 MB/sec warmup 23 sec latency 335.981 ms 2024-09-05T07:31:37.049 INFO:tasks.workunit.client.0.smithi017.stdout: 1 853 0.90 MB/sec warmup 24 sec latency 334.268 ms 2024-09-05T07:31:37.573 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:31:37.576 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:31:38.049 INFO:tasks.workunit.client.0.smithi017.stdout: 1 862 0.86 MB/sec warmup 25 sec latency 425.457 ms 2024-09-05T07:31:39.049 INFO:tasks.workunit.client.0.smithi017.stdout: 1 880 0.83 MB/sec warmup 26 sec latency 347.775 ms 2024-09-05T07:31:40.049 INFO:tasks.workunit.client.0.smithi017.stdout: 1 904 0.80 MB/sec warmup 27 sec latency 321.607 ms 2024-09-05T07:31:41.049 INFO:tasks.workunit.client.0.smithi017.stdout: 1 928 0.78 MB/sec warmup 28 sec latency 324.990 ms 2024-09-05T07:31:42.050 INFO:tasks.workunit.client.0.smithi017.stdout: 1 937 0.75 MB/sec warmup 29 sec latency 317.928 ms 2024-09-05T07:31:43.050 INFO:tasks.workunit.client.0.smithi017.stdout: 1 969 0.73 MB/sec warmup 30 sec latency 345.913 ms 2024-09-05T07:31:44.050 INFO:tasks.workunit.client.0.smithi017.stdout: 1 994 0.71 MB/sec warmup 31 sec latency 292.338 ms 2024-09-05T07:31:45.050 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1028 0.72 MB/sec warmup 32 sec latency 514.525 ms 2024-09-05T07:31:46.050 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1046 0.69 MB/sec warmup 33 sec latency 328.966 ms 2024-09-05T07:31:47.050 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1059 0.67 MB/sec warmup 34 sec latency 319.125 ms 2024-09-05T07:31:48.050 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1088 0.66 MB/sec warmup 35 sec latency 191.674 ms 2024-09-05T07:31:49.050 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1114 0.64 MB/sec warmup 36 sec latency 352.748 ms 2024-09-05T07:31:50.050 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1145 0.62 MB/sec warmup 37 sec latency 320.208 ms 2024-09-05T07:31:51.050 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1168 0.61 MB/sec warmup 38 sec latency 331.653 ms 2024-09-05T07:31:52.050 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1172 0.59 MB/sec warmup 39 sec latency 319.546 ms 2024-09-05T07:31:53.050 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1202 0.58 MB/sec warmup 40 sec latency 157.926 ms 2024-09-05T07:31:54.050 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1225 0.56 MB/sec warmup 41 sec latency 335.089 ms 2024-09-05T07:31:55.050 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1248 0.55 MB/sec warmup 42 sec latency 358.659 ms 2024-09-05T07:31:56.050 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1278 0.54 MB/sec warmup 43 sec latency 553.466 ms 2024-09-05T07:31:57.050 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1284 0.53 MB/sec warmup 44 sec latency 321.168 ms 2024-09-05T07:31:58.050 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1377 0.58 MB/sec warmup 45 sec latency 318.173 ms 2024-09-05T07:31:59.050 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1385 0.57 MB/sec warmup 46 sec latency 332.592 ms 2024-09-05T07:32:00.050 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1405 0.55 MB/sec warmup 47 sec latency 355.234 ms 2024-09-05T07:32:01.050 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1429 0.54 MB/sec warmup 48 sec latency 335.573 ms 2024-09-05T07:32:02.050 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1459 0.53 MB/sec warmup 49 sec latency 370.699 ms 2024-09-05T07:32:03.051 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1485 0.52 MB/sec warmup 50 sec latency 361.132 ms 2024-09-05T07:32:04.051 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1492 0.51 MB/sec warmup 51 sec latency 351.331 ms 2024-09-05T07:32:05.055 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1523 0.50 MB/sec warmup 52 sec latency 184.466 ms 2024-09-05T07:32:06.051 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1538 0.49 MB/sec warmup 53 sec latency 332.813 ms 2024-09-05T07:32:07.051 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1564 0.48 MB/sec warmup 54 sec latency 294.885 ms 2024-09-05T07:32:07.627 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:32:07.630 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:32:08.051 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1589 0.48 MB/sec warmup 55 sec latency 155.838 ms 2024-09-05T07:32:09.051 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1610 0.47 MB/sec warmup 56 sec latency 330.790 ms 2024-09-05T07:32:10.051 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1632 0.46 MB/sec warmup 57 sec latency 353.202 ms 2024-09-05T07:32:11.051 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1651 0.45 MB/sec warmup 58 sec latency 334.074 ms 2024-09-05T07:32:12.051 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1689 0.44 MB/sec warmup 59 sec latency 291.523 ms 2024-09-05T07:32:13.051 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1707 0.44 MB/sec warmup 60 sec latency 321.499 ms 2024-09-05T07:32:14.051 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1770 0.43 MB/sec warmup 61 sec latency 343.602 ms 2024-09-05T07:32:15.051 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1803 0.42 MB/sec warmup 62 sec latency 309.926 ms 2024-09-05T07:32:16.051 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1822 0.42 MB/sec warmup 63 sec latency 316.265 ms 2024-09-05T07:32:17.051 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1840 0.41 MB/sec warmup 64 sec latency 373.470 ms 2024-09-05T07:32:18.051 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1858 0.41 MB/sec warmup 65 sec latency 324.548 ms 2024-09-05T07:32:19.051 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1869 0.40 MB/sec warmup 66 sec latency 343.100 ms 2024-09-05T07:32:20.051 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1903 0.39 MB/sec warmup 67 sec latency 374.505 ms 2024-09-05T07:32:21.051 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1920 0.39 MB/sec warmup 68 sec latency 372.025 ms 2024-09-05T07:32:22.051 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1973 0.38 MB/sec warmup 69 sec latency 313.675 ms 2024-09-05T07:32:23.051 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1997 0.38 MB/sec warmup 70 sec latency 324.207 ms 2024-09-05T07:32:24.052 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2034 0.37 MB/sec warmup 71 sec latency 355.854 ms 2024-09-05T07:32:25.052 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2052 0.37 MB/sec warmup 72 sec latency 424.135 ms 2024-09-05T07:32:26.052 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2061 0.36 MB/sec warmup 73 sec latency 328.203 ms 2024-09-05T07:32:27.052 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2088 0.36 MB/sec warmup 74 sec latency 355.811 ms 2024-09-05T07:32:28.052 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2103 0.36 MB/sec warmup 75 sec latency 393.451 ms 2024-09-05T07:32:29.052 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2146 0.35 MB/sec warmup 76 sec latency 300.890 ms 2024-09-05T07:32:30.052 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2174 0.35 MB/sec warmup 77 sec latency 392.634 ms 2024-09-05T07:32:31.052 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2183 0.34 MB/sec warmup 78 sec latency 334.581 ms 2024-09-05T07:32:32.052 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2221 0.34 MB/sec warmup 79 sec latency 343.164 ms 2024-09-05T07:32:33.052 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2292 0.35 MB/sec warmup 80 sec latency 374.303 ms 2024-09-05T07:32:34.052 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2303 0.34 MB/sec warmup 81 sec latency 348.406 ms 2024-09-05T07:32:35.052 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2307 0.34 MB/sec warmup 82 sec latency 528.357 ms 2024-09-05T07:32:36.052 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2333 0.34 MB/sec warmup 83 sec latency 550.450 ms 2024-09-05T07:32:37.052 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2340 0.33 MB/sec warmup 84 sec latency 350.359 ms 2024-09-05T07:32:37.682 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:32:37.685 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:32:38.052 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2362 0.33 MB/sec warmup 85 sec latency 324.568 ms 2024-09-05T07:32:39.052 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2366 0.32 MB/sec warmup 86 sec latency 600.481 ms 2024-09-05T07:32:40.052 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2383 0.32 MB/sec warmup 87 sec latency 330.926 ms 2024-09-05T07:32:41.052 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2399 0.32 MB/sec warmup 88 sec latency 326.626 ms 2024-09-05T07:32:42.052 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2416 0.32 MB/sec warmup 89 sec latency 313.010 ms 2024-09-05T07:32:43.053 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2432 0.31 MB/sec warmup 90 sec latency 303.530 ms 2024-09-05T07:32:44.053 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2449 0.31 MB/sec warmup 91 sec latency 389.913 ms 2024-09-05T07:32:45.052 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2470 0.31 MB/sec warmup 92 sec latency 339.980 ms 2024-09-05T07:32:46.053 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2494 0.31 MB/sec warmup 93 sec latency 433.594 ms 2024-09-05T07:32:47.052 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2549 0.31 MB/sec warmup 94 sec latency 331.708 ms 2024-09-05T07:32:48.053 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2559 0.30 MB/sec warmup 95 sec latency 340.274 ms 2024-09-05T07:32:49.053 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2580 0.30 MB/sec warmup 96 sec latency 309.981 ms 2024-09-05T07:32:50.053 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2591 0.30 MB/sec warmup 97 sec latency 353.112 ms 2024-09-05T07:32:51.053 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2606 0.30 MB/sec warmup 98 sec latency 314.034 ms 2024-09-05T07:32:52.053 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2617 0.29 MB/sec warmup 99 sec latency 309.268 ms 2024-09-05T07:32:53.053 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2718 0.32 MB/sec warmup 100 sec latency 328.679 ms 2024-09-05T07:32:54.053 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2759 0.32 MB/sec warmup 101 sec latency 333.888 ms 2024-09-05T07:32:55.053 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2770 0.31 MB/sec warmup 102 sec latency 359.859 ms 2024-09-05T07:32:56.053 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2872 0.31 MB/sec warmup 103 sec latency 332.383 ms 2024-09-05T07:32:57.053 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2896 0.32 MB/sec warmup 104 sec latency 351.543 ms 2024-09-05T07:32:58.053 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2926 0.32 MB/sec warmup 105 sec latency 151.477 ms 2024-09-05T07:32:59.053 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2966 0.32 MB/sec warmup 106 sec latency 341.460 ms 2024-09-05T07:33:00.053 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2974 0.31 MB/sec warmup 107 sec latency 452.347 ms 2024-09-05T07:33:01.053 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2994 0.31 MB/sec warmup 108 sec latency 458.712 ms 2024-09-05T07:33:02.054 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3015 0.31 MB/sec warmup 109 sec latency 332.859 ms 2024-09-05T07:33:03.053 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3031 0.31 MB/sec warmup 110 sec latency 305.040 ms 2024-09-05T07:33:04.053 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3176 0.31 MB/sec warmup 111 sec latency 381.824 ms 2024-09-05T07:33:05.054 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3209 0.31 MB/sec warmup 112 sec latency 313.758 ms 2024-09-05T07:33:06.054 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3266 0.31 MB/sec warmup 113 sec latency 291.833 ms 2024-09-05T07:33:07.054 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3280 0.31 MB/sec warmup 114 sec latency 352.341 ms 2024-09-05T07:33:07.750 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:33:07.753 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:33:08.054 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3283 0.31 MB/sec warmup 115 sec latency 335.514 ms 2024-09-05T07:33:09.054 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3287 0.30 MB/sec warmup 116 sec latency 377.086 ms 2024-09-05T07:33:10.054 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3292 0.30 MB/sec warmup 117 sec latency 370.164 ms 2024-09-05T07:33:11.054 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3294 0.30 MB/sec warmup 118 sec latency 437.757 ms 2024-09-05T07:33:12.054 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3299 0.30 MB/sec warmup 119 sec latency 484.463 ms 2024-09-05T07:33:14.054 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3309 0.00 MB/sec execute 1 sec latency 375.457 ms 2024-09-05T07:33:15.054 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3312 0.00 MB/sec execute 2 sec latency 352.052 ms 2024-09-05T07:33:16.054 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3316 0.00 MB/sec execute 3 sec latency 477.726 ms 2024-09-05T07:33:17.054 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3319 0.00 MB/sec execute 4 sec latency 339.263 ms 2024-09-05T07:33:18.054 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3323 0.00 MB/sec execute 5 sec latency 334.912 ms 2024-09-05T07:33:19.054 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3326 0.00 MB/sec execute 6 sec latency 338.408 ms 2024-09-05T07:33:20.054 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3331 0.00 MB/sec execute 7 sec latency 335.569 ms 2024-09-05T07:33:21.054 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3334 0.00 MB/sec execute 8 sec latency 332.565 ms 2024-09-05T07:33:22.066 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3337 0.00 MB/sec execute 9 sec latency 340.963 ms 2024-09-05T07:33:23.054 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3364 0.01 MB/sec execute 10 sec latency 336.666 ms 2024-09-05T07:33:24.054 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3390 0.01 MB/sec execute 11 sec latency 144.133 ms 2024-09-05T07:33:25.055 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3395 0.01 MB/sec execute 12 sec latency 316.626 ms 2024-09-05T07:33:26.055 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3507 0.23 MB/sec execute 13 sec latency 469.463 ms 2024-09-05T07:33:27.055 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3533 0.22 MB/sec execute 14 sec latency 338.979 ms 2024-09-05T07:33:28.055 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3557 0.20 MB/sec execute 15 sec latency 178.885 ms 2024-09-05T07:33:29.055 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3573 0.19 MB/sec execute 16 sec latency 332.680 ms 2024-09-05T07:33:30.055 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3616 0.19 MB/sec execute 17 sec latency 338.067 ms 2024-09-05T07:33:31.056 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3642 0.18 MB/sec execute 18 sec latency 144.657 ms 2024-09-05T07:33:32.055 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3665 0.18 MB/sec execute 19 sec latency 397.954 ms 2024-09-05T07:33:33.055 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3677 0.17 MB/sec execute 20 sec latency 376.721 ms 2024-09-05T07:33:34.055 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3697 0.16 MB/sec execute 21 sec latency 329.393 ms 2024-09-05T07:33:35.055 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3721 0.16 MB/sec execute 22 sec latency 152.954 ms 2024-09-05T07:33:36.055 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3768 0.19 MB/sec execute 23 sec latency 365.108 ms 2024-09-05T07:33:37.055 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3783 0.18 MB/sec execute 24 sec latency 228.343 ms 2024-09-05T07:33:37.809 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:33:37.812 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:33:38.055 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3792 0.18 MB/sec execute 25 sec latency 216.765 ms 2024-09-05T07:33:39.055 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3804 0.17 MB/sec execute 26 sec latency 217.670 ms 2024-09-05T07:33:40.055 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3819 0.16 MB/sec execute 27 sec latency 163.046 ms 2024-09-05T07:33:41.055 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3835 0.16 MB/sec execute 28 sec latency 210.014 ms 2024-09-05T07:33:42.055 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3848 0.15 MB/sec execute 29 sec latency 188.831 ms 2024-09-05T07:33:43.055 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3863 0.15 MB/sec execute 30 sec latency 180.373 ms 2024-09-05T07:33:44.055 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3876 0.14 MB/sec execute 31 sec latency 308.549 ms 2024-09-05T07:33:45.055 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3896 0.15 MB/sec execute 32 sec latency 315.101 ms 2024-09-05T07:33:46.055 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3903 0.14 MB/sec execute 33 sec latency 355.006 ms 2024-09-05T07:33:47.056 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3923 0.14 MB/sec execute 34 sec latency 351.418 ms 2024-09-05T07:33:48.056 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3937 0.13 MB/sec execute 35 sec latency 185.209 ms 2024-09-05T07:33:49.056 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3947 0.13 MB/sec execute 36 sec latency 207.505 ms 2024-09-05T07:33:50.056 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3960 0.13 MB/sec execute 37 sec latency 204.131 ms 2024-09-05T07:33:51.056 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3975 0.12 MB/sec execute 38 sec latency 189.256 ms 2024-09-05T07:33:52.056 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3991 0.12 MB/sec execute 39 sec latency 171.018 ms 2024-09-05T07:33:53.056 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4006 0.12 MB/sec execute 40 sec latency 193.825 ms 2024-09-05T07:33:54.056 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4022 0.11 MB/sec execute 41 sec latency 174.188 ms 2024-09-05T07:33:55.056 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4032 0.11 MB/sec execute 42 sec latency 327.195 ms 2024-09-05T07:33:56.056 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4041 0.11 MB/sec execute 43 sec latency 393.006 ms 2024-09-05T07:33:57.056 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4059 0.11 MB/sec execute 44 sec latency 331.081 ms 2024-09-05T07:33:58.056 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4071 0.10 MB/sec execute 45 sec latency 266.954 ms 2024-09-05T07:33:59.056 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4096 0.10 MB/sec execute 46 sec latency 331.612 ms 2024-09-05T07:34:00.056 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4117 0.10 MB/sec execute 47 sec latency 169.600 ms 2024-09-05T07:34:01.056 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4135 0.10 MB/sec execute 48 sec latency 524.974 ms 2024-09-05T07:34:02.056 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4159 0.10 MB/sec execute 49 sec latency 205.476 ms 2024-09-05T07:34:03.056 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4173 0.09 MB/sec execute 50 sec latency 305.356 ms 2024-09-05T07:34:04.057 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4181 0.09 MB/sec execute 51 sec latency 405.117 ms 2024-09-05T07:34:05.057 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4216 0.09 MB/sec execute 52 sec latency 794.724 ms 2024-09-05T07:34:06.056 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4225 0.09 MB/sec execute 53 sec latency 384.990 ms 2024-09-05T07:34:07.057 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4252 0.09 MB/sec execute 54 sec latency 424.506 ms 2024-09-05T07:34:07.872 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:34:07.875 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:34:08.057 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4281 0.09 MB/sec execute 55 sec latency 319.484 ms 2024-09-05T07:34:09.057 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4315 0.09 MB/sec execute 56 sec latency 245.132 ms 2024-09-05T07:34:10.057 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4344 0.09 MB/sec execute 57 sec latency 336.460 ms 2024-09-05T07:34:11.057 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4374 0.09 MB/sec execute 58 sec latency 233.984 ms 2024-09-05T07:34:12.057 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4387 0.09 MB/sec execute 59 sec latency 323.339 ms 2024-09-05T07:34:13.057 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4423 0.09 MB/sec execute 60 sec latency 344.471 ms 2024-09-05T07:34:14.057 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4432 0.09 MB/sec execute 61 sec latency 341.599 ms 2024-09-05T07:34:15.057 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4455 0.09 MB/sec execute 62 sec latency 360.269 ms 2024-09-05T07:34:16.057 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4489 0.09 MB/sec execute 63 sec latency 232.471 ms 2024-09-05T07:34:17.057 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4500 0.09 MB/sec execute 64 sec latency 330.365 ms 2024-09-05T07:34:18.057 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4506 0.09 MB/sec execute 65 sec latency 334.045 ms 2024-09-05T07:34:19.057 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4538 0.08 MB/sec execute 66 sec latency 370.059 ms 2024-09-05T07:34:20.057 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4563 0.08 MB/sec execute 67 sec latency 324.493 ms 2024-09-05T07:34:21.057 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4602 0.10 MB/sec execute 68 sec latency 454.359 ms 2024-09-05T07:34:22.057 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4615 0.10 MB/sec execute 69 sec latency 333.372 ms 2024-09-05T07:34:23.057 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4629 0.09 MB/sec execute 70 sec latency 327.438 ms 2024-09-05T07:34:24.057 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4663 0.09 MB/sec execute 71 sec latency 300.449 ms 2024-09-05T07:34:25.057 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4681 0.09 MB/sec execute 72 sec latency 334.924 ms 2024-09-05T07:34:26.057 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4715 0.09 MB/sec execute 73 sec latency 348.747 ms 2024-09-05T07:34:27.057 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4734 0.09 MB/sec execute 74 sec latency 333.757 ms 2024-09-05T07:34:28.058 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4741 0.09 MB/sec execute 75 sec latency 325.778 ms 2024-09-05T07:34:29.058 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4770 0.09 MB/sec execute 76 sec latency 160.280 ms 2024-09-05T07:34:30.058 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4797 0.09 MB/sec execute 77 sec latency 331.847 ms 2024-09-05T07:34:31.058 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4817 0.09 MB/sec execute 78 sec latency 358.574 ms 2024-09-05T07:34:32.058 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4846 0.09 MB/sec execute 79 sec latency 339.396 ms 2024-09-05T07:34:33.058 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4851 0.09 MB/sec execute 80 sec latency 354.014 ms 2024-09-05T07:34:34.058 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4944 0.12 MB/sec execute 81 sec latency 328.873 ms 2024-09-05T07:34:35.058 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4955 0.12 MB/sec execute 82 sec latency 350.796 ms 2024-09-05T07:34:36.058 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4975 0.12 MB/sec execute 83 sec latency 400.993 ms 2024-09-05T07:34:37.058 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4995 0.12 MB/sec execute 84 sec latency 331.202 ms 2024-09-05T07:34:37.937 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:34:37.940 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:34:38.058 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5028 0.12 MB/sec execute 85 sec latency 314.805 ms 2024-09-05T07:34:39.058 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5051 0.11 MB/sec execute 86 sec latency 362.590 ms 2024-09-05T07:34:40.058 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5065 0.11 MB/sec execute 87 sec latency 352.439 ms 2024-09-05T07:34:41.058 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5089 0.11 MB/sec execute 88 sec latency 338.277 ms 2024-09-05T07:34:42.058 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5104 0.11 MB/sec execute 89 sec latency 329.716 ms 2024-09-05T07:34:43.058 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5129 0.11 MB/sec execute 90 sec latency 375.972 ms 2024-09-05T07:34:44.058 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5154 0.11 MB/sec execute 91 sec latency 162.490 ms 2024-09-05T07:34:45.058 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5175 0.11 MB/sec execute 92 sec latency 332.662 ms 2024-09-05T07:34:46.058 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5197 0.11 MB/sec execute 93 sec latency 333.286 ms 2024-09-05T07:34:47.058 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5216 0.11 MB/sec execute 94 sec latency 320.773 ms 2024-09-05T07:34:48.058 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5251 0.10 MB/sec execute 95 sec latency 363.749 ms 2024-09-05T07:34:49.059 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5266 0.10 MB/sec execute 96 sec latency 453.318 ms 2024-09-05T07:34:50.059 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5334 0.10 MB/sec execute 97 sec latency 346.184 ms 2024-09-05T07:34:51.059 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5350 0.10 MB/sec execute 98 sec latency 414.451 ms 2024-09-05T07:34:52.059 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5385 0.10 MB/sec execute 99 sec latency 348.139 ms 2024-09-05T07:34:53.059 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5393 0.10 MB/sec execute 100 sec latency 358.492 ms 2024-09-05T07:34:54.059 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5420 0.10 MB/sec execute 101 sec latency 310.252 ms 2024-09-05T07:34:55.059 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5430 0.10 MB/sec execute 102 sec latency 401.344 ms 2024-09-05T07:34:56.059 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5463 0.10 MB/sec execute 103 sec latency 307.012 ms 2024-09-05T07:34:57.059 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5477 0.10 MB/sec execute 104 sec latency 336.579 ms 2024-09-05T07:34:58.059 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5529 0.10 MB/sec execute 105 sec latency 326.772 ms 2024-09-05T07:34:59.061 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5554 0.10 MB/sec execute 106 sec latency 320.090 ms 2024-09-05T07:35:00.059 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5597 0.10 MB/sec execute 107 sec latency 309.724 ms 2024-09-05T07:35:01.059 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5613 0.10 MB/sec execute 108 sec latency 506.072 ms 2024-09-05T07:35:02.059 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5622 0.10 MB/sec execute 109 sec latency 335.737 ms 2024-09-05T07:35:03.059 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5642 0.09 MB/sec execute 110 sec latency 367.654 ms 2024-09-05T07:35:04.059 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5657 0.09 MB/sec execute 111 sec latency 361.236 ms 2024-09-05T07:35:05.059 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5700 0.09 MB/sec execute 112 sec latency 423.126 ms 2024-09-05T07:35:06.059 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5720 0.09 MB/sec execute 113 sec latency 428.691 ms 2024-09-05T07:35:07.059 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5739 0.09 MB/sec execute 114 sec latency 384.238 ms 2024-09-05T07:35:08.001 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:35:08.004 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:35:08.060 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5759 0.09 MB/sec execute 115 sec latency 357.473 ms 2024-09-05T07:35:09.060 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5808 0.09 MB/sec execute 116 sec latency 333.193 ms 2024-09-05T07:35:10.060 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5853 0.10 MB/sec execute 117 sec latency 399.158 ms 2024-09-05T07:35:11.060 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5866 0.10 MB/sec execute 118 sec latency 514.919 ms 2024-09-05T07:35:12.060 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5884 0.10 MB/sec execute 119 sec latency 322.372 ms 2024-09-05T07:35:13.060 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5895 0.10 MB/sec execute 120 sec latency 354.139 ms 2024-09-05T07:35:14.060 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5921 0.10 MB/sec execute 121 sec latency 327.753 ms 2024-09-05T07:35:15.060 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5926 0.10 MB/sec execute 122 sec latency 322.513 ms 2024-09-05T07:35:16.060 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5931 0.09 MB/sec execute 123 sec latency 754.279 ms 2024-09-05T07:35:17.060 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5951 0.09 MB/sec execute 124 sec latency 349.416 ms 2024-09-05T07:35:18.060 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5970 0.09 MB/sec execute 125 sec latency 330.460 ms 2024-09-05T07:35:19.060 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5991 0.09 MB/sec execute 126 sec latency 361.857 ms 2024-09-05T07:35:20.060 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6000 0.09 MB/sec execute 127 sec latency 340.938 ms 2024-09-05T07:35:21.060 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6026 0.10 MB/sec execute 128 sec latency 196.466 ms 2024-09-05T07:35:22.061 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6052 0.10 MB/sec execute 129 sec latency 292.323 ms 2024-09-05T07:35:23.061 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6061 0.10 MB/sec execute 130 sec latency 346.449 ms 2024-09-05T07:35:24.061 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6109 0.10 MB/sec execute 131 sec latency 367.458 ms 2024-09-05T07:35:25.064 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6120 0.10 MB/sec execute 132 sec latency 354.993 ms 2024-09-05T07:35:26.061 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6139 0.10 MB/sec execute 133 sec latency 353.220 ms 2024-09-05T07:35:27.061 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6155 0.10 MB/sec execute 134 sec latency 406.816 ms 2024-09-05T07:35:28.061 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6173 0.10 MB/sec execute 135 sec latency 306.568 ms 2024-09-05T07:35:29.061 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6179 0.09 MB/sec execute 136 sec latency 341.117 ms 2024-09-05T07:35:30.061 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6302 0.11 MB/sec execute 137 sec latency 329.884 ms 2024-09-05T07:35:31.061 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6316 0.11 MB/sec execute 138 sec latency 517.339 ms 2024-09-05T07:35:32.061 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6335 0.11 MB/sec execute 139 sec latency 357.374 ms 2024-09-05T07:35:33.061 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6430 0.11 MB/sec execute 140 sec latency 327.146 ms 2024-09-05T07:35:34.061 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6457 0.12 MB/sec execute 141 sec latency 174.740 ms 2024-09-05T07:35:35.062 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6489 0.12 MB/sec execute 142 sec latency 198.657 ms 2024-09-05T07:35:36.061 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6524 0.12 MB/sec execute 143 sec latency 325.977 ms 2024-09-05T07:35:37.061 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6533 0.12 MB/sec execute 144 sec latency 356.334 ms 2024-09-05T07:35:38.061 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6551 0.12 MB/sec execute 145 sec latency 331.203 ms 2024-09-05T07:35:38.063 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:35:38.066 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:35:39.062 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6579 0.12 MB/sec execute 146 sec latency 221.344 ms 2024-09-05T07:35:40.062 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6724 0.12 MB/sec execute 147 sec latency 333.856 ms 2024-09-05T07:35:41.062 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6743 0.12 MB/sec execute 148 sec latency 238.071 ms 2024-09-05T07:35:42.062 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6787 0.12 MB/sec execute 149 sec latency 307.372 ms 2024-09-05T07:35:43.062 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6829 0.13 MB/sec execute 150 sec latency 330.855 ms 2024-09-05T07:35:44.062 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6836 0.13 MB/sec execute 151 sec latency 321.374 ms 2024-09-05T07:35:45.062 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6840 0.13 MB/sec execute 152 sec latency 317.499 ms 2024-09-05T07:35:46.062 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6845 0.12 MB/sec execute 153 sec latency 424.170 ms 2024-09-05T07:35:47.062 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6848 0.12 MB/sec execute 154 sec latency 376.226 ms 2024-09-05T07:35:48.062 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6853 0.12 MB/sec execute 155 sec latency 434.551 ms 2024-09-05T07:35:49.062 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6861 0.12 MB/sec execute 156 sec latency 440.349 ms 2024-09-05T07:35:50.062 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6863 0.12 MB/sec execute 157 sec latency 404.374 ms 2024-09-05T07:35:51.062 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6866 0.12 MB/sec execute 158 sec latency 451.837 ms 2024-09-05T07:35:52.062 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6869 0.12 MB/sec execute 159 sec latency 314.869 ms 2024-09-05T07:35:53.062 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6873 0.12 MB/sec execute 160 sec latency 325.277 ms 2024-09-05T07:35:54.062 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6877 0.12 MB/sec execute 161 sec latency 320.387 ms 2024-09-05T07:35:55.062 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6881 0.12 MB/sec execute 162 sec latency 342.792 ms 2024-09-05T07:35:56.062 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6885 0.12 MB/sec execute 163 sec latency 353.255 ms 2024-09-05T07:35:57.062 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6888 0.12 MB/sec execute 164 sec latency 339.827 ms 2024-09-05T07:35:58.062 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6892 0.12 MB/sec execute 165 sec latency 323.311 ms 2024-09-05T07:35:59.063 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6914 0.12 MB/sec execute 166 sec latency 345.995 ms 2024-09-05T07:36:00.062 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6933 0.12 MB/sec execute 167 sec latency 142.871 ms 2024-09-05T07:36:01.063 INFO:tasks.workunit.client.0.smithi017.stdout: 1 6949 0.11 MB/sec execute 168 sec latency 329.502 ms 2024-09-05T07:36:02.063 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7054 0.13 MB/sec execute 169 sec latency 323.910 ms 2024-09-05T07:36:03.063 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7082 0.13 MB/sec execute 170 sec latency 216.803 ms 2024-09-05T07:36:04.063 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7108 0.13 MB/sec execute 171 sec latency 317.683 ms 2024-09-05T07:36:05.063 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7123 0.13 MB/sec execute 172 sec latency 388.258 ms 2024-09-05T07:36:06.063 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7135 0.13 MB/sec execute 173 sec latency 431.225 ms 2024-09-05T07:36:07.063 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7185 0.13 MB/sec execute 174 sec latency 323.619 ms 2024-09-05T07:36:08.063 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7209 0.13 MB/sec execute 175 sec latency 450.931 ms 2024-09-05T07:36:08.119 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:36:08.121 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:36:09.063 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7219 0.13 MB/sec execute 176 sec latency 348.758 ms 2024-09-05T07:36:10.063 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7240 0.13 MB/sec execute 177 sec latency 325.315 ms 2024-09-05T07:36:11.063 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7261 0.13 MB/sec execute 178 sec latency 149.378 ms 2024-09-05T07:36:12.063 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7309 0.13 MB/sec execute 179 sec latency 307.813 ms 2024-09-05T07:36:13.063 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7324 0.13 MB/sec execute 180 sec latency 251.010 ms 2024-09-05T07:36:14.063 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7335 0.13 MB/sec execute 181 sec latency 214.761 ms 2024-09-05T07:36:15.063 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7345 0.13 MB/sec execute 182 sec latency 236.563 ms 2024-09-05T07:36:16.063 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7358 0.13 MB/sec execute 183 sec latency 243.117 ms 2024-09-05T07:36:17.063 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7373 0.13 MB/sec execute 184 sec latency 171.695 ms 2024-09-05T07:36:18.063 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7388 0.13 MB/sec execute 185 sec latency 188.120 ms 2024-09-05T07:36:19.063 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7404 0.13 MB/sec execute 186 sec latency 160.349 ms 2024-09-05T07:36:20.063 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7415 0.13 MB/sec execute 187 sec latency 338.873 ms 2024-09-05T07:36:21.063 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7428 0.13 MB/sec execute 188 sec latency 387.334 ms 2024-09-05T07:36:22.063 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7443 0.13 MB/sec execute 189 sec latency 346.306 ms 2024-09-05T07:36:23.063 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7464 0.13 MB/sec execute 190 sec latency 327.254 ms 2024-09-05T07:36:24.063 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7480 0.12 MB/sec execute 191 sec latency 191.103 ms 2024-09-05T07:36:25.064 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7488 0.12 MB/sec execute 192 sec latency 211.404 ms 2024-09-05T07:36:26.064 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7498 0.12 MB/sec execute 193 sec latency 347.537 ms 2024-09-05T07:36:27.064 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7513 0.12 MB/sec execute 194 sec latency 173.095 ms 2024-09-05T07:36:28.064 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7530 0.12 MB/sec execute 195 sec latency 147.286 ms 2024-09-05T07:36:29.064 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7546 0.12 MB/sec execute 196 sec latency 186.751 ms 2024-09-05T07:36:30.064 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7562 0.12 MB/sec execute 197 sec latency 176.102 ms 2024-09-05T07:36:31.064 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7572 0.12 MB/sec execute 198 sec latency 335.131 ms 2024-09-05T07:36:32.066 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7580 0.12 MB/sec execute 199 sec latency 322.666 ms 2024-09-05T07:36:33.064 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7602 0.12 MB/sec execute 200 sec latency 298.911 ms 2024-09-05T07:36:34.064 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7615 0.12 MB/sec execute 201 sec latency 354.784 ms 2024-09-05T07:36:35.064 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7634 0.12 MB/sec execute 202 sec latency 342.776 ms 2024-09-05T07:36:36.064 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7654 0.12 MB/sec execute 203 sec latency 274.875 ms 2024-09-05T07:36:37.064 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7678 0.12 MB/sec execute 204 sec latency 154.124 ms 2024-09-05T07:36:38.064 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7701 0.12 MB/sec execute 205 sec latency 174.421 ms 2024-09-05T07:36:38.178 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:36:38.181 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:36:39.064 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7715 0.12 MB/sec execute 206 sec latency 315.839 ms 2024-09-05T07:36:40.064 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7721 0.12 MB/sec execute 207 sec latency 519.712 ms 2024-09-05T07:36:41.064 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7728 0.11 MB/sec execute 208 sec latency 729.911 ms 2024-09-05T07:36:42.065 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7763 0.11 MB/sec execute 209 sec latency 378.145 ms 2024-09-05T07:36:43.065 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7777 0.11 MB/sec execute 210 sec latency 453.146 ms 2024-09-05T07:36:44.065 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7797 0.11 MB/sec execute 211 sec latency 337.093 ms 2024-09-05T07:36:45.065 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7834 0.11 MB/sec execute 212 sec latency 240.936 ms 2024-09-05T07:36:46.065 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7859 0.11 MB/sec execute 213 sec latency 336.109 ms 2024-09-05T07:36:47.065 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7893 0.11 MB/sec execute 214 sec latency 311.682 ms 2024-09-05T07:36:48.065 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7926 0.11 MB/sec execute 215 sec latency 324.516 ms 2024-09-05T07:36:49.065 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7935 0.11 MB/sec execute 216 sec latency 331.833 ms 2024-09-05T07:36:50.065 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7966 0.11 MB/sec execute 217 sec latency 421.700 ms 2024-09-05T07:36:51.065 INFO:tasks.workunit.client.0.smithi017.stdout: 1 7985 0.11 MB/sec execute 218 sec latency 388.677 ms 2024-09-05T07:36:52.065 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8014 0.11 MB/sec execute 219 sec latency 344.371 ms 2024-09-05T07:36:53.065 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8039 0.11 MB/sec execute 220 sec latency 289.180 ms 2024-09-05T07:36:54.065 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8043 0.11 MB/sec execute 221 sec latency 330.787 ms 2024-09-05T07:36:55.065 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8053 0.11 MB/sec execute 222 sec latency 324.637 ms 2024-09-05T07:36:56.066 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8082 0.11 MB/sec execute 223 sec latency 317.650 ms 2024-09-05T07:36:57.065 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8136 0.11 MB/sec execute 224 sec latency 331.458 ms 2024-09-05T07:36:58.065 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8148 0.11 MB/sec execute 225 sec latency 332.819 ms 2024-09-05T07:36:59.066 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8158 0.11 MB/sec execute 226 sec latency 339.301 ms 2024-09-05T07:37:00.066 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8186 0.11 MB/sec execute 227 sec latency 338.598 ms 2024-09-05T07:37:01.066 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8210 0.11 MB/sec execute 228 sec latency 416.820 ms 2024-09-05T07:37:02.066 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8232 0.11 MB/sec execute 229 sec latency 347.087 ms 2024-09-05T07:37:03.066 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8266 0.11 MB/sec execute 230 sec latency 211.621 ms 2024-09-05T07:37:04.066 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8277 0.11 MB/sec execute 231 sec latency 323.794 ms 2024-09-05T07:37:05.066 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8285 0.11 MB/sec execute 232 sec latency 329.036 ms 2024-09-05T07:37:06.066 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8312 0.11 MB/sec execute 233 sec latency 277.722 ms 2024-09-05T07:37:07.066 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8339 0.11 MB/sec execute 234 sec latency 355.073 ms 2024-09-05T07:37:08.066 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8360 0.11 MB/sec execute 235 sec latency 346.755 ms 2024-09-05T07:37:08.246 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:37:08.249 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:37:09.066 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8388 0.11 MB/sec execute 236 sec latency 362.145 ms 2024-09-05T07:37:10.066 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8405 0.11 MB/sec execute 237 sec latency 367.978 ms 2024-09-05T07:37:11.066 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8489 0.12 MB/sec execute 238 sec latency 323.810 ms 2024-09-05T07:37:12.066 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8502 0.12 MB/sec execute 239 sec latency 348.764 ms 2024-09-05T07:37:13.066 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8526 0.12 MB/sec execute 240 sec latency 360.969 ms 2024-09-05T07:37:14.066 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8550 0.12 MB/sec execute 241 sec latency 329.951 ms 2024-09-05T07:37:15.066 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8572 0.12 MB/sec execute 242 sec latency 345.594 ms 2024-09-05T07:37:16.066 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8594 0.12 MB/sec execute 243 sec latency 518.109 ms 2024-09-05T07:37:17.066 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8606 0.12 MB/sec execute 244 sec latency 348.491 ms 2024-09-05T07:37:18.066 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8633 0.12 MB/sec execute 245 sec latency 179.353 ms 2024-09-05T07:37:19.067 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8661 0.12 MB/sec execute 246 sec latency 312.860 ms 2024-09-05T07:37:20.067 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8678 0.12 MB/sec execute 247 sec latency 328.549 ms 2024-09-05T07:37:21.067 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8697 0.12 MB/sec execute 248 sec latency 308.365 ms 2024-09-05T07:37:22.069 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8718 0.12 MB/sec execute 249 sec latency 316.307 ms 2024-09-05T07:37:23.067 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8749 0.12 MB/sec execute 250 sec latency 327.692 ms 2024-09-05T07:37:24.067 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8761 0.12 MB/sec execute 251 sec latency 333.157 ms 2024-09-05T07:37:25.067 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8797 0.12 MB/sec execute 252 sec latency 300.616 ms 2024-09-05T07:37:26.067 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8815 0.12 MB/sec execute 253 sec latency 321.288 ms 2024-09-05T07:37:27.067 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8879 0.11 MB/sec execute 254 sec latency 332.016 ms 2024-09-05T07:37:28.067 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8913 0.11 MB/sec execute 255 sec latency 357.900 ms 2024-09-05T07:37:29.067 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8930 0.11 MB/sec execute 256 sec latency 365.650 ms 2024-09-05T07:37:30.067 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8949 0.11 MB/sec execute 257 sec latency 321.554 ms 2024-09-05T07:37:31.067 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8971 0.11 MB/sec execute 258 sec latency 353.508 ms 2024-09-05T07:37:32.067 INFO:tasks.workunit.client.0.smithi017.stdout: 1 8978 0.11 MB/sec execute 259 sec latency 351.376 ms 2024-09-05T07:37:33.067 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9012 0.11 MB/sec execute 260 sec latency 377.467 ms 2024-09-05T07:37:34.067 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9029 0.11 MB/sec execute 261 sec latency 331.164 ms 2024-09-05T07:37:35.067 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9084 0.11 MB/sec execute 262 sec latency 325.637 ms 2024-09-05T07:37:36.067 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9106 0.11 MB/sec execute 263 sec latency 469.486 ms 2024-09-05T07:37:37.067 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9141 0.11 MB/sec execute 264 sec latency 337.656 ms 2024-09-05T07:37:38.067 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9159 0.11 MB/sec execute 265 sec latency 331.052 ms 2024-09-05T07:37:38.515 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:37:38.518 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:37:39.068 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9175 0.11 MB/sec execute 266 sec latency 337.582 ms 2024-09-05T07:37:40.068 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9194 0.11 MB/sec execute 267 sec latency 357.484 ms 2024-09-05T07:37:41.068 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9210 0.11 MB/sec execute 268 sec latency 386.439 ms 2024-09-05T07:37:42.068 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9252 0.11 MB/sec execute 269 sec latency 336.875 ms 2024-09-05T07:37:43.068 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9281 0.11 MB/sec execute 270 sec latency 418.107 ms 2024-09-05T07:37:43.185 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:09:00.925 36173== Warning: unimplemented fcntl command: 1036 2024-09-05T07:37:43.243 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:09:00.983 36173== Warning: unimplemented fcntl command: 1036 2024-09-05T07:37:43.276 INFO:tasks.ceph.mon.b.smithi026.stderr:==00:00:09:00.985 36185== Warning: unimplemented fcntl command: 1036 2024-09-05T07:37:43.313 INFO:tasks.ceph.mon.c.smithi026.stderr:==00:00:09:01.022 36186== Warning: unimplemented fcntl command: 1036 2024-09-05T07:37:43.339 INFO:tasks.ceph.mon.b.smithi026.stderr:==00:00:09:01.048 36185== Warning: unimplemented fcntl command: 1036 2024-09-05T07:37:43.392 INFO:tasks.ceph.mon.c.smithi026.stderr:==00:00:09:01.100 36186== Warning: unimplemented fcntl command: 1036 2024-09-05T07:37:43.605 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:09:01.344 36173== Warning: unimplemented fcntl command: 1036 2024-09-05T07:37:43.736 INFO:tasks.ceph.mon.b.smithi026.stderr:==00:00:09:01.445 36185== Warning: unimplemented fcntl command: 1036 2024-09-05T07:37:43.807 INFO:tasks.ceph.mon.c.smithi026.stderr:==00:00:09:01.516 36186== Warning: unimplemented fcntl command: 1036 2024-09-05T07:37:44.068 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9288 0.11 MB/sec execute 271 sec latency 448.867 ms 2024-09-05T07:37:45.068 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9315 0.11 MB/sec execute 272 sec latency 360.107 ms 2024-09-05T07:37:46.068 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9367 0.11 MB/sec execute 273 sec latency 420.854 ms 2024-09-05T07:37:47.068 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9405 0.11 MB/sec execute 274 sec latency 341.667 ms 2024-09-05T07:37:48.068 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9411 0.11 MB/sec execute 275 sec latency 402.218 ms 2024-09-05T07:37:49.068 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9437 0.11 MB/sec execute 276 sec latency 345.027 ms 2024-09-05T07:37:50.068 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9449 0.11 MB/sec execute 277 sec latency 316.830 ms 2024-09-05T07:37:51.068 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9466 0.11 MB/sec execute 278 sec latency 489.262 ms 2024-09-05T07:37:52.068 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9470 0.11 MB/sec execute 279 sec latency 442.508 ms 2024-09-05T07:37:53.068 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9487 0.11 MB/sec execute 280 sec latency 356.672 ms 2024-09-05T07:37:54.068 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9503 0.11 MB/sec execute 281 sec latency 314.261 ms 2024-09-05T07:37:55.068 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9521 0.11 MB/sec execute 282 sec latency 321.905 ms 2024-09-05T07:37:56.069 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9536 0.11 MB/sec execute 283 sec latency 298.421 ms 2024-09-05T07:37:57.068 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9553 0.11 MB/sec execute 284 sec latency 322.016 ms 2024-09-05T07:37:58.069 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9574 0.11 MB/sec execute 285 sec latency 346.976 ms 2024-09-05T07:37:59.069 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9598 0.11 MB/sec execute 286 sec latency 349.409 ms 2024-09-05T07:38:00.069 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9610 0.11 MB/sec execute 287 sec latency 375.248 ms 2024-09-05T07:38:01.069 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9661 0.11 MB/sec execute 288 sec latency 362.676 ms 2024-09-05T07:38:02.069 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9678 0.11 MB/sec execute 289 sec latency 316.367 ms 2024-09-05T07:38:03.069 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9685 0.11 MB/sec execute 290 sec latency 349.020 ms 2024-09-05T07:38:04.069 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9706 0.11 MB/sec execute 291 sec latency 310.963 ms 2024-09-05T07:38:05.069 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9719 0.11 MB/sec execute 292 sec latency 322.605 ms 2024-09-05T07:38:06.069 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9735 0.11 MB/sec execute 293 sec latency 446.162 ms 2024-09-05T07:38:07.069 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9847 0.12 MB/sec execute 294 sec latency 375.934 ms 2024-09-05T07:38:08.069 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9863 0.12 MB/sec execute 295 sec latency 327.677 ms 2024-09-05T07:38:08.573 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:38:08.576 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:38:09.069 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9881 0.12 MB/sec execute 296 sec latency 357.170 ms 2024-09-05T07:38:10.070 INFO:tasks.workunit.client.0.smithi017.stdout: 1 9980 0.12 MB/sec execute 297 sec latency 308.904 ms 2024-09-05T07:38:11.069 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10017 0.12 MB/sec execute 298 sec latency 155.108 ms 2024-09-05T07:38:12.069 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10037 0.12 MB/sec execute 299 sec latency 281.314 ms 2024-09-05T07:38:13.070 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10073 0.12 MB/sec execute 300 sec latency 360.700 ms 2024-09-05T07:38:14.069 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10088 0.12 MB/sec execute 301 sec latency 421.543 ms 2024-09-05T07:38:15.070 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10111 0.12 MB/sec execute 302 sec latency 311.208 ms 2024-09-05T07:38:16.070 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10130 0.12 MB/sec execute 303 sec latency 271.107 ms 2024-09-05T07:38:17.070 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10275 0.12 MB/sec execute 304 sec latency 351.527 ms 2024-09-05T07:38:18.070 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10303 0.12 MB/sec execute 305 sec latency 323.726 ms 2024-09-05T07:38:19.070 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10365 0.12 MB/sec execute 306 sec latency 225.456 ms 2024-09-05T07:38:20.070 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10379 0.12 MB/sec execute 307 sec latency 371.180 ms 2024-09-05T07:38:21.070 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10382 0.12 MB/sec execute 308 sec latency 361.458 ms 2024-09-05T07:38:22.070 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10386 0.12 MB/sec execute 309 sec latency 416.461 ms 2024-09-05T07:38:23.070 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10390 0.12 MB/sec execute 310 sec latency 379.468 ms 2024-09-05T07:38:24.070 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10393 0.12 MB/sec execute 311 sec latency 443.566 ms 2024-09-05T07:38:25.070 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10397 0.12 MB/sec execute 312 sec latency 489.366 ms 2024-09-05T07:38:26.070 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10402 0.12 MB/sec execute 313 sec latency 475.189 ms 2024-09-05T07:38:27.070 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10407 0.12 MB/sec execute 314 sec latency 386.327 ms 2024-09-05T07:38:28.070 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10410 0.12 MB/sec execute 315 sec latency 345.879 ms 2024-09-05T07:38:29.070 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10413 0.12 MB/sec execute 316 sec latency 327.109 ms 2024-09-05T07:38:30.070 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10417 0.12 MB/sec execute 317 sec latency 337.608 ms 2024-09-05T07:38:31.070 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10421 0.12 MB/sec execute 318 sec latency 362.022 ms 2024-09-05T07:38:32.070 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10424 0.12 MB/sec execute 319 sec latency 335.198 ms 2024-09-05T07:38:33.071 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10429 0.12 MB/sec execute 320 sec latency 333.980 ms 2024-09-05T07:38:34.071 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10432 0.12 MB/sec execute 321 sec latency 347.252 ms 2024-09-05T07:38:35.071 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10435 0.12 MB/sec execute 322 sec latency 329.229 ms 2024-09-05T07:38:36.071 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10451 0.12 MB/sec execute 323 sec latency 415.051 ms 2024-09-05T07:38:37.071 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10472 0.12 MB/sec execute 324 sec latency 150.559 ms 2024-09-05T07:38:38.071 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10492 0.12 MB/sec execute 325 sec latency 327.060 ms 2024-09-05T07:38:38.629 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:38:38.632 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:38:39.071 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10508 0.12 MB/sec execute 326 sec latency 344.123 ms 2024-09-05T07:38:40.071 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10621 0.13 MB/sec execute 327 sec latency 137.730 ms 2024-09-05T07:38:41.071 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10644 0.13 MB/sec execute 328 sec latency 345.460 ms 2024-09-05T07:38:42.071 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10658 0.13 MB/sec execute 329 sec latency 318.793 ms 2024-09-05T07:38:43.071 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10680 0.13 MB/sec execute 330 sec latency 321.719 ms 2024-09-05T07:38:44.071 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10719 0.13 MB/sec execute 331 sec latency 441.791 ms 2024-09-05T07:38:45.071 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10735 0.13 MB/sec execute 332 sec latency 346.034 ms 2024-09-05T07:38:46.093 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10763 0.12 MB/sec execute 333 sec latency 253.771 ms 2024-09-05T07:38:47.071 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10776 0.12 MB/sec execute 334 sec latency 321.555 ms 2024-09-05T07:38:48.071 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10795 0.12 MB/sec execute 335 sec latency 350.305 ms 2024-09-05T07:38:49.071 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10848 0.13 MB/sec execute 336 sec latency 146.294 ms 2024-09-05T07:38:50.071 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10863 0.13 MB/sec execute 337 sec latency 395.190 ms 2024-09-05T07:38:51.071 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10879 0.13 MB/sec execute 338 sec latency 222.964 ms 2024-09-05T07:38:52.072 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10886 0.13 MB/sec execute 339 sec latency 236.119 ms 2024-09-05T07:38:53.071 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10901 0.13 MB/sec execute 340 sec latency 230.505 ms 2024-09-05T07:38:54.072 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10914 0.13 MB/sec execute 341 sec latency 208.765 ms 2024-09-05T07:38:55.072 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10930 0.12 MB/sec execute 342 sec latency 198.224 ms 2024-09-05T07:38:56.072 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10943 0.12 MB/sec execute 343 sec latency 309.203 ms 2024-09-05T07:38:57.072 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10958 0.12 MB/sec execute 344 sec latency 158.615 ms 2024-09-05T07:38:58.072 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10968 0.12 MB/sec execute 345 sec latency 343.378 ms 2024-09-05T07:38:59.072 INFO:tasks.workunit.client.0.smithi017.stdout: 1 10987 0.12 MB/sec execute 346 sec latency 321.622 ms 2024-09-05T07:39:00.072 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11004 0.12 MB/sec execute 347 sec latency 342.397 ms 2024-09-05T07:39:01.072 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11018 0.12 MB/sec execute 348 sec latency 307.293 ms 2024-09-05T07:39:02.072 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11029 0.12 MB/sec execute 349 sec latency 194.553 ms 2024-09-05T07:39:03.072 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11042 0.12 MB/sec execute 350 sec latency 209.806 ms 2024-09-05T07:39:04.072 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11057 0.12 MB/sec execute 351 sec latency 174.509 ms 2024-09-05T07:39:05.072 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11073 0.12 MB/sec execute 352 sec latency 175.842 ms 2024-09-05T07:39:06.072 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11087 0.12 MB/sec execute 353 sec latency 188.207 ms 2024-09-05T07:39:07.072 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11103 0.12 MB/sec execute 354 sec latency 162.266 ms 2024-09-05T07:39:08.073 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11117 0.12 MB/sec execute 355 sec latency 191.157 ms 2024-09-05T07:39:08.684 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:39:08.687 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:39:09.073 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11124 0.12 MB/sec execute 356 sec latency 361.602 ms 2024-09-05T07:39:10.073 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11137 0.12 MB/sec execute 357 sec latency 300.782 ms 2024-09-05T07:39:11.073 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11152 0.12 MB/sec execute 358 sec latency 365.834 ms 2024-09-05T07:39:12.073 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11172 0.12 MB/sec execute 359 sec latency 340.088 ms 2024-09-05T07:39:13.073 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11195 0.12 MB/sec execute 360 sec latency 352.941 ms 2024-09-05T07:39:14.073 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11217 0.12 MB/sec execute 361 sec latency 153.142 ms 2024-09-05T07:39:15.073 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11242 0.12 MB/sec execute 362 sec latency 106.789 ms 2024-09-05T07:39:16.073 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11251 0.12 MB/sec execute 363 sec latency 553.603 ms 2024-09-05T07:39:17.073 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11262 0.12 MB/sec execute 364 sec latency 897.950 ms 2024-09-05T07:39:18.073 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11270 0.12 MB/sec execute 365 sec latency 442.357 ms 2024-09-05T07:39:19.073 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11306 0.12 MB/sec execute 366 sec latency 514.582 ms 2024-09-05T07:39:20.073 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11315 0.12 MB/sec execute 367 sec latency 369.499 ms 2024-09-05T07:39:21.073 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11343 0.12 MB/sec execute 368 sec latency 323.005 ms 2024-09-05T07:39:22.073 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11370 0.12 MB/sec execute 369 sec latency 337.627 ms 2024-09-05T07:39:23.073 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11404 0.12 MB/sec execute 370 sec latency 236.804 ms 2024-09-05T07:39:24.073 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11438 0.12 MB/sec execute 371 sec latency 314.028 ms 2024-09-05T07:39:25.073 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11472 0.12 MB/sec execute 372 sec latency 232.872 ms 2024-09-05T07:39:26.073 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11477 0.12 MB/sec execute 373 sec latency 365.895 ms 2024-09-05T07:39:27.074 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11513 0.12 MB/sec execute 374 sec latency 334.150 ms 2024-09-05T07:39:28.074 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11522 0.12 MB/sec execute 375 sec latency 328.047 ms 2024-09-05T07:39:29.074 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11556 0.12 MB/sec execute 376 sec latency 332.609 ms 2024-09-05T07:39:30.074 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11586 0.12 MB/sec execute 377 sec latency 255.070 ms 2024-09-05T07:39:31.074 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11590 0.12 MB/sec execute 378 sec latency 363.203 ms 2024-09-05T07:39:32.074 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11600 0.12 MB/sec execute 379 sec latency 350.324 ms 2024-09-05T07:39:33.074 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11635 0.12 MB/sec execute 380 sec latency 342.450 ms 2024-09-05T07:39:34.074 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11685 0.12 MB/sec execute 381 sec latency 337.200 ms 2024-09-05T07:39:35.074 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11698 0.12 MB/sec execute 382 sec latency 325.432 ms 2024-09-05T07:39:36.074 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11705 0.12 MB/sec execute 383 sec latency 496.741 ms 2024-09-05T07:39:37.074 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11730 0.12 MB/sec execute 384 sec latency 354.695 ms 2024-09-05T07:39:38.074 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11757 0.12 MB/sec execute 385 sec latency 324.968 ms 2024-09-05T07:39:38.757 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:39:38.760 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:39:39.074 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11775 0.12 MB/sec execute 386 sec latency 356.402 ms 2024-09-05T07:39:40.074 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11814 0.12 MB/sec execute 387 sec latency 199.016 ms 2024-09-05T07:39:41.074 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11825 0.12 MB/sec execute 388 sec latency 351.390 ms 2024-09-05T07:39:42.075 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11835 0.12 MB/sec execute 389 sec latency 334.076 ms 2024-09-05T07:39:43.075 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11865 0.12 MB/sec execute 390 sec latency 318.495 ms 2024-09-05T07:39:44.075 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11900 0.12 MB/sec execute 391 sec latency 227.821 ms 2024-09-05T07:39:45.075 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11929 0.12 MB/sec execute 392 sec latency 346.498 ms 2024-09-05T07:39:46.075 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11936 0.11 MB/sec execute 393 sec latency 664.356 ms 2024-09-05T07:39:47.075 INFO:tasks.workunit.client.0.smithi017.stdout: 1 11974 0.12 MB/sec execute 394 sec latency 319.241 ms 2024-09-05T07:39:48.075 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12037 0.12 MB/sec execute 395 sec latency 335.121 ms 2024-09-05T07:39:49.075 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12052 0.12 MB/sec execute 396 sec latency 340.119 ms 2024-09-05T07:39:50.075 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12073 0.12 MB/sec execute 397 sec latency 348.313 ms 2024-09-05T07:39:51.075 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12102 0.12 MB/sec execute 398 sec latency 357.331 ms 2024-09-05T07:39:52.075 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12121 0.12 MB/sec execute 399 sec latency 375.632 ms 2024-09-05T07:39:53.075 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12142 0.12 MB/sec execute 400 sec latency 381.274 ms 2024-09-05T07:39:54.075 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12157 0.12 MB/sec execute 401 sec latency 338.963 ms 2024-09-05T07:39:55.075 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12182 0.12 MB/sec execute 402 sec latency 252.606 ms 2024-09-05T07:39:56.075 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12210 0.12 MB/sec execute 403 sec latency 349.644 ms 2024-09-05T07:39:57.075 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12235 0.12 MB/sec execute 404 sec latency 335.926 ms 2024-09-05T07:39:58.075 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12260 0.12 MB/sec execute 405 sec latency 319.623 ms 2024-09-05T07:39:59.075 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12271 0.12 MB/sec execute 406 sec latency 346.260 ms 2024-09-05T07:40:00.075 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12296 0.12 MB/sec execute 407 sec latency 334.957 ms 2024-09-05T07:40:01.076 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12317 0.12 MB/sec execute 408 sec latency 385.825 ms 2024-09-05T07:40:02.076 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12353 0.12 MB/sec execute 409 sec latency 308.017 ms 2024-09-05T07:40:03.076 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12362 0.12 MB/sec execute 410 sec latency 358.670 ms 2024-09-05T07:40:04.076 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12427 0.12 MB/sec execute 411 sec latency 319.695 ms 2024-09-05T07:40:05.076 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12462 0.12 MB/sec execute 412 sec latency 346.895 ms 2024-09-05T07:40:06.076 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12482 0.12 MB/sec execute 413 sec latency 348.546 ms 2024-09-05T07:40:07.076 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12497 0.12 MB/sec execute 414 sec latency 333.686 ms 2024-09-05T07:40:08.076 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12518 0.12 MB/sec execute 415 sec latency 355.547 ms 2024-09-05T07:40:08.822 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:40:08.825 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:40:09.076 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12540 0.12 MB/sec execute 416 sec latency 376.534 ms 2024-09-05T07:40:10.076 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12567 0.12 MB/sec execute 417 sec latency 314.646 ms 2024-09-05T07:40:11.076 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12582 0.12 MB/sec execute 418 sec latency 318.889 ms 2024-09-05T07:40:12.076 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12633 0.12 MB/sec execute 419 sec latency 271.712 ms 2024-09-05T07:40:13.076 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12666 0.12 MB/sec execute 420 sec latency 364.386 ms 2024-09-05T07:40:14.076 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12698 0.12 MB/sec execute 421 sec latency 325.548 ms 2024-09-05T07:40:15.076 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12711 0.12 MB/sec execute 422 sec latency 362.059 ms 2024-09-05T07:40:16.076 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12734 0.11 MB/sec execute 423 sec latency 413.036 ms 2024-09-05T07:40:17.076 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12748 0.11 MB/sec execute 424 sec latency 353.651 ms 2024-09-05T07:40:18.076 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12793 0.11 MB/sec execute 425 sec latency 391.535 ms 2024-09-05T07:40:19.076 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12803 0.11 MB/sec execute 426 sec latency 387.134 ms 2024-09-05T07:40:20.076 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12830 0.11 MB/sec execute 427 sec latency 359.250 ms 2024-09-05T07:40:21.077 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12852 0.11 MB/sec execute 428 sec latency 428.815 ms 2024-09-05T07:40:21.230 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:11:38.970 36173== Warning: unimplemented fcntl command: 1036 2024-09-05T07:40:21.234 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:11:38.975 36173== Warning: unimplemented fcntl command: 1036 2024-09-05T07:40:21.246 INFO:tasks.ceph.mon.c.smithi026.stderr:==00:00:11:38.955 36186== Warning: unimplemented fcntl command: 1036 2024-09-05T07:40:21.249 INFO:tasks.ceph.mon.c.smithi026.stderr:==00:00:11:38.957 36186== Warning: unimplemented fcntl command: 1036 2024-09-05T07:40:21.249 INFO:tasks.ceph.mon.b.smithi026.stderr:==00:00:11:38.957 36185== Warning: unimplemented fcntl command: 1036 2024-09-05T07:40:21.251 INFO:tasks.ceph.mon.b.smithi026.stderr:==00:00:11:38.960 36185== Warning: unimplemented fcntl command: 1036 2024-09-05T07:40:21.318 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:11:39.058 36173== Warning: unimplemented fcntl command: 1036 2024-09-05T07:40:21.335 INFO:tasks.ceph.mon.b.smithi026.stderr:==00:00:11:39.043 36185== Warning: unimplemented fcntl command: 1036 2024-09-05T07:40:21.339 INFO:tasks.ceph.mon.c.smithi026.stderr:==00:00:11:39.048 36186== Warning: unimplemented fcntl command: 1036 2024-09-05T07:40:22.077 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12878 0.11 MB/sec execute 429 sec latency 337.592 ms 2024-09-05T07:40:23.077 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12947 0.12 MB/sec execute 430 sec latency 227.458 ms 2024-09-05T07:40:24.077 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12960 0.12 MB/sec execute 431 sec latency 517.210 ms 2024-09-05T07:40:25.077 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12975 0.12 MB/sec execute 432 sec latency 368.636 ms 2024-09-05T07:40:26.077 INFO:tasks.workunit.client.0.smithi017.stdout: 1 12988 0.12 MB/sec execute 433 sec latency 399.560 ms 2024-09-05T07:40:27.077 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13007 0.11 MB/sec execute 434 sec latency 325.454 ms 2024-09-05T07:40:28.077 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13016 0.11 MB/sec execute 435 sec latency 367.440 ms 2024-09-05T07:40:29.077 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13021 0.11 MB/sec execute 436 sec latency 632.065 ms 2024-09-05T07:40:30.077 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13042 0.11 MB/sec execute 437 sec latency 333.229 ms 2024-09-05T07:40:31.077 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13055 0.11 MB/sec execute 438 sec latency 307.272 ms 2024-09-05T07:40:32.077 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13082 0.11 MB/sec execute 439 sec latency 295.682 ms 2024-09-05T07:40:33.077 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13089 0.11 MB/sec execute 440 sec latency 329.662 ms 2024-09-05T07:40:34.077 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13107 0.11 MB/sec execute 441 sec latency 163.179 ms 2024-09-05T07:40:35.077 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13141 0.11 MB/sec execute 442 sec latency 357.048 ms 2024-09-05T07:40:36.078 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13148 0.11 MB/sec execute 443 sec latency 423.734 ms 2024-09-05T07:40:37.077 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13201 0.11 MB/sec execute 444 sec latency 341.055 ms 2024-09-05T07:40:38.077 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13212 0.11 MB/sec execute 445 sec latency 388.688 ms 2024-09-05T07:40:38.903 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:40:38.906 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:40:39.077 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13232 0.11 MB/sec execute 446 sec latency 339.736 ms 2024-09-05T07:40:40.077 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13248 0.11 MB/sec execute 447 sec latency 352.862 ms 2024-09-05T07:40:41.078 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13260 0.11 MB/sec execute 448 sec latency 337.481 ms 2024-09-05T07:40:42.078 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13270 0.11 MB/sec execute 449 sec latency 329.150 ms 2024-09-05T07:40:43.078 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13370 0.12 MB/sec execute 450 sec latency 335.313 ms 2024-09-05T07:40:44.078 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13410 0.12 MB/sec execute 451 sec latency 347.826 ms 2024-09-05T07:40:45.078 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13426 0.12 MB/sec execute 452 sec latency 377.844 ms 2024-09-05T07:40:46.078 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13522 0.12 MB/sec execute 453 sec latency 401.044 ms 2024-09-05T07:40:47.078 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13548 0.12 MB/sec execute 454 sec latency 309.346 ms 2024-09-05T07:40:48.078 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13581 0.12 MB/sec execute 455 sec latency 160.671 ms 2024-09-05T07:40:49.078 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13616 0.12 MB/sec execute 456 sec latency 345.151 ms 2024-09-05T07:40:50.078 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13625 0.12 MB/sec execute 457 sec latency 353.525 ms 2024-09-05T07:40:51.078 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13644 0.12 MB/sec execute 458 sec latency 243.254 ms 2024-09-05T07:40:52.078 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13669 0.12 MB/sec execute 459 sec latency 315.122 ms 2024-09-05T07:40:53.078 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13817 0.12 MB/sec execute 460 sec latency 325.917 ms 2024-09-05T07:40:54.079 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13838 0.12 MB/sec execute 461 sec latency 380.950 ms 2024-09-05T07:40:55.079 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13862 0.12 MB/sec execute 462 sec latency 332.746 ms 2024-09-05T07:40:56.079 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13917 0.12 MB/sec execute 463 sec latency 413.268 ms 2024-09-05T07:40:57.079 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13931 0.12 MB/sec execute 464 sec latency 324.857 ms 2024-09-05T07:40:58.079 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13935 0.12 MB/sec execute 465 sec latency 351.147 ms 2024-09-05T07:40:59.079 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13939 0.12 MB/sec execute 466 sec latency 357.823 ms 2024-09-05T07:41:00.079 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13942 0.12 MB/sec execute 467 sec latency 418.271 ms 2024-09-05T07:41:01.079 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13946 0.12 MB/sec execute 468 sec latency 430.122 ms 2024-09-05T07:41:02.079 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13952 0.12 MB/sec execute 469 sec latency 346.162 ms 2024-09-05T07:41:03.079 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13957 0.12 MB/sec execute 470 sec latency 395.180 ms 2024-09-05T07:41:04.079 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13960 0.12 MB/sec execute 471 sec latency 359.021 ms 2024-09-05T07:41:05.079 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13963 0.12 MB/sec execute 472 sec latency 332.590 ms 2024-09-05T07:41:06.079 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13967 0.12 MB/sec execute 473 sec latency 458.269 ms 2024-09-05T07:41:07.079 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13971 0.12 MB/sec execute 474 sec latency 328.771 ms 2024-09-05T07:41:08.079 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13974 0.12 MB/sec execute 475 sec latency 339.052 ms 2024-09-05T07:41:08.963 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:41:08.966 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:41:09.079 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13979 0.12 MB/sec execute 476 sec latency 353.318 ms 2024-09-05T07:41:10.079 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13982 0.12 MB/sec execute 477 sec latency 348.675 ms 2024-09-05T07:41:11.080 INFO:tasks.workunit.client.0.smithi017.stdout: 1 13985 0.12 MB/sec execute 478 sec latency 329.894 ms 2024-09-05T07:41:12.079 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14001 0.12 MB/sec execute 479 sec latency 321.623 ms 2024-09-05T07:41:13.080 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14022 0.12 MB/sec execute 480 sec latency 148.722 ms 2024-09-05T07:41:14.080 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14042 0.12 MB/sec execute 481 sec latency 315.367 ms 2024-09-05T07:41:15.080 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14141 0.13 MB/sec execute 482 sec latency 332.467 ms 2024-09-05T07:41:16.080 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14174 0.12 MB/sec execute 483 sec latency 144.937 ms 2024-09-05T07:41:17.080 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14195 0.12 MB/sec execute 484 sec latency 355.989 ms 2024-09-05T07:41:18.080 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14209 0.12 MB/sec execute 485 sec latency 334.092 ms 2024-09-05T07:41:19.080 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14230 0.12 MB/sec execute 486 sec latency 341.879 ms 2024-09-05T07:41:20.080 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14270 0.12 MB/sec execute 487 sec latency 429.646 ms 2024-09-05T07:41:21.080 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14286 0.12 MB/sec execute 488 sec latency 369.071 ms 2024-09-05T07:41:22.080 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14314 0.12 MB/sec execute 489 sec latency 314.595 ms 2024-09-05T07:41:23.080 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14329 0.12 MB/sec execute 490 sec latency 306.348 ms 2024-09-05T07:41:24.080 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14355 0.12 MB/sec execute 491 sec latency 146.045 ms 2024-09-05T07:41:25.080 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14399 0.13 MB/sec execute 492 sec latency 310.451 ms 2024-09-05T07:41:26.080 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14419 0.13 MB/sec execute 493 sec latency 218.174 ms 2024-09-05T07:41:27.080 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14430 0.13 MB/sec execute 494 sec latency 197.404 ms 2024-09-05T07:41:28.080 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14440 0.12 MB/sec execute 495 sec latency 227.759 ms 2024-09-05T07:41:29.080 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14455 0.12 MB/sec execute 496 sec latency 207.219 ms 2024-09-05T07:41:30.080 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14470 0.12 MB/sec execute 497 sec latency 183.561 ms 2024-09-05T07:41:31.080 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14484 0.12 MB/sec execute 498 sec latency 166.606 ms 2024-09-05T07:41:32.081 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14499 0.12 MB/sec execute 499 sec latency 185.234 ms 2024-09-05T07:41:33.081 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14510 0.12 MB/sec execute 500 sec latency 335.912 ms 2024-09-05T07:41:34.081 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14523 0.12 MB/sec execute 501 sec latency 298.778 ms 2024-09-05T07:41:35.081 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14539 0.12 MB/sec execute 502 sec latency 347.550 ms 2024-09-05T07:41:36.081 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14561 0.12 MB/sec execute 503 sec latency 323.511 ms 2024-09-05T07:41:37.081 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14575 0.12 MB/sec execute 504 sec latency 218.602 ms 2024-09-05T07:41:38.081 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14583 0.12 MB/sec execute 505 sec latency 201.140 ms 2024-09-05T07:41:39.028 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:41:39.031 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:41:39.082 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14598 0.12 MB/sec execute 506 sec latency 217.878 ms 2024-09-05T07:41:40.081 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14614 0.12 MB/sec execute 507 sec latency 168.199 ms 2024-09-05T07:41:41.082 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14629 0.12 MB/sec execute 508 sec latency 172.732 ms 2024-09-05T07:41:42.081 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14645 0.12 MB/sec execute 509 sec latency 166.558 ms 2024-09-05T07:41:43.081 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14661 0.12 MB/sec execute 510 sec latency 172.408 ms 2024-09-05T07:41:44.081 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14671 0.12 MB/sec execute 511 sec latency 299.272 ms 2024-09-05T07:41:45.082 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14679 0.12 MB/sec execute 512 sec latency 368.999 ms 2024-09-05T07:41:46.082 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14697 0.12 MB/sec execute 513 sec latency 299.881 ms 2024-09-05T07:41:47.082 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14710 0.12 MB/sec execute 514 sec latency 300.416 ms 2024-09-05T07:41:48.082 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14733 0.12 MB/sec execute 515 sec latency 328.555 ms 2024-09-05T07:41:49.082 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14754 0.12 MB/sec execute 516 sec latency 154.718 ms 2024-09-05T07:41:50.082 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14783 0.12 MB/sec execute 517 sec latency 96.574 ms 2024-09-05T07:41:51.082 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14797 0.12 MB/sec execute 518 sec latency 317.842 ms 2024-09-05T07:41:52.082 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14808 0.12 MB/sec execute 519 sec latency 577.123 ms 2024-09-05T07:41:53.082 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14817 0.12 MB/sec execute 520 sec latency 378.082 ms 2024-09-05T07:41:54.082 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14852 0.12 MB/sec execute 521 sec latency 553.663 ms 2024-09-05T07:41:55.082 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14860 0.12 MB/sec execute 522 sec latency 405.624 ms 2024-09-05T07:41:56.082 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14888 0.12 MB/sec execute 523 sec latency 348.530 ms 2024-09-05T07:41:57.082 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14912 0.12 MB/sec execute 524 sec latency 334.435 ms 2024-09-05T07:41:58.082 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14949 0.12 MB/sec execute 525 sec latency 255.968 ms 2024-09-05T07:41:59.083 INFO:tasks.workunit.client.0.smithi017.stdout: 1 14976 0.12 MB/sec execute 526 sec latency 344.494 ms 2024-09-05T07:42:00.082 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15013 0.12 MB/sec execute 527 sec latency 236.759 ms 2024-09-05T07:42:01.082 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15020 0.12 MB/sec execute 528 sec latency 512.334 ms 2024-09-05T07:42:02.082 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15059 0.12 MB/sec execute 529 sec latency 526.299 ms 2024-09-05T07:42:03.083 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15067 0.12 MB/sec execute 530 sec latency 424.251 ms 2024-09-05T07:42:04.083 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15086 0.12 MB/sec execute 531 sec latency 351.663 ms 2024-09-05T07:42:05.083 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15109 0.12 MB/sec execute 532 sec latency 342.032 ms 2024-09-05T07:42:06.083 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15134 0.12 MB/sec execute 533 sec latency 377.481 ms 2024-09-05T07:42:07.083 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15141 0.12 MB/sec execute 534 sec latency 332.089 ms 2024-09-05T07:42:08.083 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15169 0.12 MB/sec execute 535 sec latency 349.023 ms 2024-09-05T07:42:09.083 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15199 0.12 MB/sec execute 536 sec latency 256.528 ms 2024-09-05T07:42:09.097 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:42:09.100 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:42:10.083 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15234 0.12 MB/sec execute 537 sec latency 356.889 ms 2024-09-05T07:42:11.083 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15250 0.12 MB/sec execute 538 sec latency 362.022 ms 2024-09-05T07:42:12.083 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15255 0.12 MB/sec execute 539 sec latency 496.586 ms 2024-09-05T07:42:13.083 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15292 0.12 MB/sec execute 540 sec latency 161.672 ms 2024-09-05T07:42:14.083 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15316 0.12 MB/sec execute 541 sec latency 320.748 ms 2024-09-05T07:42:15.083 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15339 0.12 MB/sec execute 542 sec latency 365.922 ms 2024-09-05T07:42:16.083 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15365 0.12 MB/sec execute 543 sec latency 348.730 ms 2024-09-05T07:42:17.083 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15372 0.12 MB/sec execute 544 sec latency 333.536 ms 2024-09-05T07:42:18.083 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15392 0.12 MB/sec execute 545 sec latency 331.591 ms 2024-09-05T07:42:19.083 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15417 0.12 MB/sec execute 546 sec latency 333.302 ms 2024-09-05T07:42:20.084 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15451 0.12 MB/sec execute 547 sec latency 234.594 ms 2024-09-05T07:42:21.084 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15480 0.12 MB/sec execute 548 sec latency 341.848 ms 2024-09-05T07:42:22.084 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15483 0.12 MB/sec execute 549 sec latency 602.760 ms 2024-09-05T07:42:23.084 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15579 0.12 MB/sec execute 550 sec latency 333.887 ms 2024-09-05T07:42:24.084 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15587 0.12 MB/sec execute 551 sec latency 335.895 ms 2024-09-05T07:42:25.084 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15601 0.12 MB/sec execute 552 sec latency 329.964 ms 2024-09-05T07:42:26.084 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15628 0.12 MB/sec execute 553 sec latency 346.480 ms 2024-09-05T07:42:27.084 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15650 0.12 MB/sec execute 554 sec latency 266.711 ms 2024-09-05T07:42:28.084 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15678 0.12 MB/sec execute 555 sec latency 334.488 ms 2024-09-05T07:42:29.084 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15692 0.12 MB/sec execute 556 sec latency 375.435 ms 2024-09-05T07:42:30.084 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15719 0.12 MB/sec execute 557 sec latency 357.424 ms 2024-09-05T07:42:31.084 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15732 0.12 MB/sec execute 558 sec latency 328.869 ms 2024-09-05T07:42:32.084 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15759 0.12 MB/sec execute 559 sec latency 429.930 ms 2024-09-05T07:42:33.084 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15789 0.12 MB/sec execute 560 sec latency 77.023 ms 2024-09-05T07:42:34.084 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15810 0.12 MB/sec execute 561 sec latency 320.914 ms 2024-09-05T07:42:35.084 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15818 0.12 MB/sec execute 562 sec latency 365.967 ms 2024-09-05T07:42:36.084 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15845 0.12 MB/sec execute 563 sec latency 324.448 ms 2024-09-05T07:42:37.084 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15885 0.12 MB/sec execute 564 sec latency 351.567 ms 2024-09-05T07:42:38.085 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15902 0.12 MB/sec execute 565 sec latency 272.888 ms 2024-09-05T07:42:39.085 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15963 0.12 MB/sec execute 566 sec latency 306.377 ms 2024-09-05T07:42:39.154 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:42:39.157 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:42:40.085 INFO:tasks.workunit.client.0.smithi017.stdout: 1 15996 0.12 MB/sec execute 567 sec latency 318.246 ms 2024-09-05T07:42:41.085 INFO:tasks.workunit.client.0.smithi017.stdout: 1 16022 0.12 MB/sec execute 568 sec latency 320.904 ms 2024-09-05T07:42:42.085 INFO:tasks.workunit.client.0.smithi017.stdout: 1 16035 0.12 MB/sec execute 569 sec latency 349.493 ms 2024-09-05T07:42:43.085 INFO:tasks.workunit.client.0.smithi017.stdout: 1 16059 0.12 MB/sec execute 570 sec latency 322.982 ms 2024-09-05T07:42:44.085 INFO:tasks.workunit.client.0.smithi017.stdout: 1 16069 0.12 MB/sec execute 571 sec latency 306.140 ms 2024-09-05T07:42:45.085 INFO:tasks.workunit.client.0.smithi017.stdout: 1 16099 0.12 MB/sec execute 572 sec latency 346.327 ms 2024-09-05T07:42:46.085 INFO:tasks.workunit.client.0.smithi017.stdout: 1 16113 0.12 MB/sec execute 573 sec latency 333.306 ms 2024-09-05T07:42:47.085 INFO:tasks.workunit.client.0.smithi017.stdout: 1 16173 0.12 MB/sec execute 574 sec latency 312.096 ms 2024-09-05T07:42:48.085 INFO:tasks.workunit.client.0.smithi017.stdout: 1 16196 0.12 MB/sec execute 575 sec latency 321.238 ms 2024-09-05T07:42:49.086 INFO:tasks.workunit.client.0.smithi017.stdout: 1 16233 0.12 MB/sec execute 576 sec latency 341.740 ms 2024-09-05T07:42:50.085 INFO:tasks.workunit.client.0.smithi017.stdout: 1 16249 0.12 MB/sec execute 577 sec latency 323.715 ms 2024-09-05T07:42:51.085 INFO:tasks.workunit.client.0.smithi017.stdout: 1 16259 0.12 MB/sec execute 578 sec latency 330.135 ms 2024-09-05T07:42:52.085 INFO:tasks.workunit.client.0.smithi017.stdout: 1 16279 0.12 MB/sec execute 579 sec latency 443.001 ms 2024-09-05T07:42:53.085 INFO:tasks.workunit.client.0.smithi017.stdout: 1 16294 0.12 MB/sec execute 580 sec latency 356.530 ms 2024-09-05T07:42:54.085 INFO:tasks.workunit.client.0.smithi017.stdout: 1 16338 0.12 MB/sec execute 581 sec latency 388.569 ms 2024-09-05T07:42:55.085 INFO:tasks.workunit.client.0.smithi017.stdout: 1 16371 0.12 MB/sec execute 582 sec latency 419.231 ms 2024-09-05T07:42:56.085 INFO:tasks.workunit.client.0.smithi017.stdout: 1 16379 0.12 MB/sec execute 583 sec latency 390.597 ms 2024-09-05T07:42:57.086 INFO:tasks.workunit.client.0.smithi017.stdout: 1 16399 0.12 MB/sec execute 584 sec latency 370.537 ms 2024-09-05T07:42:58.086 INFO:tasks.workunit.client.0.smithi017.stdout: 1 16459 0.12 MB/sec execute 585 sec latency 333.908 ms 2024-09-05T07:42:59.088 INFO:tasks.workunit.client.0.smithi017.stdout: 1 16496 0.12 MB/sec execute 586 sec latency 432.562 ms 2024-09-05T07:43:00.086 INFO:tasks.workunit.client.0.smithi017.stdout: 1 16503 0.12 MB/sec execute 587 sec latency 388.123 ms 2024-09-05T07:43:01.086 INFO:tasks.workunit.client.0.smithi017.stdout: 1 16520 0.12 MB/sec execute 588 sec latency 486.549 ms 2024-09-05T07:43:02.086 INFO:tasks.workunit.client.0.smithi017.stdout: 1 16536 0.12 MB/sec execute 589 sec latency 506.937 ms 2024-09-05T07:43:03.086 INFO:tasks.workunit.client.0.smithi017.stdout: 1 16557 0.12 MB/sec execute 590 sec latency 329.469 ms 2024-09-05T07:43:04.086 INFO:tasks.workunit.client.0.smithi017.stdout: 1 16561 0.12 MB/sec execute 591 sec latency 589.042 ms 2024-09-05T07:43:05.086 INFO:tasks.workunit.client.0.smithi017.stdout: 1 16567 0.12 MB/sec execute 592 sec latency 343.126 ms 2024-09-05T07:43:06.086 INFO:tasks.workunit.client.0.smithi017.stdout: 1 16590 0.12 MB/sec execute 593 sec latency 358.463 ms 2024-09-05T07:43:07.086 INFO:tasks.workunit.client.0.smithi017.stdout: 1 16606 0.12 MB/sec execute 594 sec latency 194.462 ms 2024-09-05T07:43:08.086 INFO:tasks.workunit.client.0.smithi017.stdout: 1 16627 0.12 MB/sec execute 595 sec latency 324.780 ms 2024-09-05T07:43:09.086 INFO:tasks.workunit.client.0.smithi017.stdout: 1 16637 0.12 MB/sec execute 596 sec latency 329.484 ms 2024-09-05T07:43:09.227 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:43:09.230 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:43:10.086 INFO:tasks.workunit.client.0.smithi017.stdout: 1 16666 0.12 MB/sec execute 597 sec latency 148.484 ms 2024-09-05T07:43:11.087 INFO:tasks.workunit.client.0.smithi017.stdout: 1 16688 0.12 MB/sec execute 598 sec latency 318.354 ms 2024-09-05T07:43:12.087 INFO:tasks.workunit.client.0.smithi017.stdout: 1 16698 0.12 MB/sec execute 599 sec latency 465.217 ms 2024-09-05T07:43:13.086 INFO:tasks.workunit.client.0.smithi017.stdout: 1 cleanup 600 sec 2024-09-05T07:43:14.087 INFO:tasks.workunit.client.0.smithi017.stdout: 1 cleanup 601 sec 2024-09-05T07:43:15.087 INFO:tasks.workunit.client.0.smithi017.stdout: 1 cleanup 602 sec 2024-09-05T07:43:16.087 INFO:tasks.workunit.client.0.smithi017.stdout: 1 cleanup 603 sec 2024-09-05T07:43:17.088 INFO:tasks.workunit.client.0.smithi017.stdout: 1 cleanup 604 sec 2024-09-05T07:43:18.087 INFO:tasks.workunit.client.0.smithi017.stdout: 1 cleanup 605 sec 2024-09-05T07:43:19.087 INFO:tasks.workunit.client.0.smithi017.stdout: 1 cleanup 606 sec 2024-09-05T07:43:20.087 INFO:tasks.workunit.client.0.smithi017.stdout: 1 cleanup 607 sec 2024-09-05T07:43:21.087 INFO:tasks.workunit.client.0.smithi017.stdout: 1 cleanup 608 sec 2024-09-05T07:43:21.963 INFO:tasks.workunit.client.0.smithi017.stdout: 0 cleanup 609 sec 2024-09-05T07:43:21.964 INFO:tasks.workunit.client.0.smithi017.stdout: 2024-09-05T07:43:21.964 INFO:tasks.workunit.client.0.smithi017.stdout: Operation Count AvgLat MaxLat 2024-09-05T07:43:21.964 INFO:tasks.workunit.client.0.smithi017.stdout: ---------------------------------------- 2024-09-05T07:43:21.964 INFO:tasks.workunit.client.0.smithi017.stdout: NTCreateX 2384 68.429 347.532 2024-09-05T07:43:21.964 INFO:tasks.workunit.client.0.smithi017.stdout: Close 1754 1.252 30.379 2024-09-05T07:43:21.964 INFO:tasks.workunit.client.0.smithi017.stdout: Rename 97 195.016 453.306 2024-09-05T07:43:21.964 INFO:tasks.workunit.client.0.smithi017.stdout: Unlink 484 80.521 577.113 2024-09-05T07:43:21.964 INFO:tasks.workunit.client.0.smithi017.stdout: Qpathinfo 2162 36.797 729.902 2024-09-05T07:43:21.964 INFO:tasks.workunit.client.0.smithi017.stdout: Qfileinfo 362 1.011 6.230 2024-09-05T07:43:21.964 INFO:tasks.workunit.client.0.smithi017.stdout: Qfsinfo 381 6.011 56.053 2024-09-05T07:43:21.965 INFO:tasks.workunit.client.0.smithi017.stdout: Sfileinfo 198 12.230 18.235 2024-09-05T07:43:21.965 INFO:tasks.workunit.client.0.smithi017.stdout: Find 822 338.368 897.942 2024-09-05T07:43:21.965 INFO:tasks.workunit.client.0.smithi017.stdout: WriteX 1150 4.367 134.388 2024-09-05T07:43:21.965 INFO:tasks.workunit.client.0.smithi017.stdout: ReadX 3470 0.029 10.223 2024-09-05T07:43:21.965 INFO:tasks.workunit.client.0.smithi017.stdout: LockX 6 19.038 20.029 2024-09-05T07:43:21.965 INFO:tasks.workunit.client.0.smithi017.stdout: UnlockX 6 16.256 19.171 2024-09-05T07:43:21.965 INFO:tasks.workunit.client.0.smithi017.stdout: Flush 165 54.479 164.900 2024-09-05T07:43:21.965 INFO:tasks.workunit.client.0.smithi017.stdout: 2024-09-05T07:43:21.965 INFO:tasks.workunit.client.0.smithi017.stdout:Throughput 0.116596 MB/sec 1 clients 1 procs max_latency=897.950 ms 2024-09-05T07:43:21.965 INFO:tasks.workunit.client.0.smithi017.stderr:+ dbench 10 2024-09-05T07:43:21.966 INFO:tasks.workunit.client.0.smithi017.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-09-05T07:43:21.966 INFO:tasks.workunit.client.0.smithi017.stdout: 2024-09-05T07:43:21.966 INFO:tasks.workunit.client.0.smithi017.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-09-05T07:43:21.966 INFO:tasks.workunit.client.0.smithi017.stdout:8 of 10 processes prepared for launch 0 sec 2024-09-05T07:43:22.065 INFO:tasks.workunit.client.0.smithi017.stdout:10 of 10 processes prepared for launch 0 sec 2024-09-05T07:43:22.065 INFO:tasks.workunit.client.0.smithi017.stdout:releasing clients 2024-09-05T07:43:23.065 INFO:tasks.workunit.client.0.smithi017.stdout: 0 2 0.00 MB/sec warmup 1 sec latency 999.847 ms 2024-09-05T07:43:24.065 INFO:tasks.workunit.client.0.smithi017.stdout: 0 6 0.00 MB/sec warmup 2 sec latency 1999.876 ms 2024-09-05T07:43:25.068 INFO:tasks.workunit.client.0.smithi017.stdout: 0 8 0.00 MB/sec warmup 3 sec latency 557.904 ms 2024-09-05T07:43:26.065 INFO:tasks.workunit.client.0.smithi017.stdout: 6 17 0.82 MB/sec warmup 4 sec latency 530.695 ms 2024-09-05T07:43:27.065 INFO:tasks.workunit.client.0.smithi017.stdout: 9 32 2.16 MB/sec warmup 5 sec latency 700.228 ms 2024-09-05T07:43:28.065 INFO:tasks.workunit.client.0.smithi017.stdout: 10 49 3.29 MB/sec warmup 6 sec latency 750.596 ms 2024-09-05T07:43:29.065 INFO:tasks.workunit.client.0.smithi017.stdout: 10 64 3.92 MB/sec warmup 7 sec latency 786.478 ms 2024-09-05T07:43:30.065 INFO:tasks.workunit.client.0.smithi017.stdout: 10 81 4.60 MB/sec warmup 8 sec latency 823.301 ms 2024-09-05T07:43:31.065 INFO:tasks.workunit.client.0.smithi017.stdout: 10 96 4.89 MB/sec warmup 9 sec latency 790.052 ms 2024-09-05T07:43:32.065 INFO:tasks.workunit.client.0.smithi017.stdout: 10 109 5.11 MB/sec warmup 10 sec latency 928.557 ms 2024-09-05T07:43:33.065 INFO:tasks.workunit.client.0.smithi017.stdout: 10 114 4.81 MB/sec warmup 11 sec latency 1195.090 ms 2024-09-05T07:43:34.069 INFO:tasks.workunit.client.0.smithi017.stdout: 10 121 4.59 MB/sec warmup 12 sec latency 1465.654 ms 2024-09-05T07:43:35.066 INFO:tasks.workunit.client.0.smithi017.stdout: 10 125 4.33 MB/sec warmup 13 sec latency 1436.468 ms 2024-09-05T07:43:36.066 INFO:tasks.workunit.client.0.smithi017.stdout: 10 131 4.17 MB/sec warmup 14 sec latency 1222.937 ms 2024-09-05T07:43:37.066 INFO:tasks.workunit.client.0.smithi017.stdout: 10 138 4.03 MB/sec warmup 15 sec latency 1455.226 ms 2024-09-05T07:43:38.066 INFO:tasks.workunit.client.0.smithi017.stdout: 10 142 3.83 MB/sec warmup 16 sec latency 1480.247 ms 2024-09-05T07:43:39.066 INFO:tasks.workunit.client.0.smithi017.stdout: 10 149 3.74 MB/sec warmup 17 sec latency 1403.128 ms 2024-09-05T07:43:39.293 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:43:39.296 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:43:40.066 INFO:tasks.workunit.client.0.smithi017.stdout: 10 156 3.65 MB/sec warmup 18 sec latency 1331.019 ms 2024-09-05T07:43:41.066 INFO:tasks.workunit.client.0.smithi017.stdout: 10 158 3.48 MB/sec warmup 19 sec latency 1419.520 ms 2024-09-05T07:43:42.066 INFO:tasks.workunit.client.0.smithi017.stdout: 10 162 3.36 MB/sec warmup 20 sec latency 2220.528 ms 2024-09-05T07:43:43.066 INFO:tasks.workunit.client.0.smithi017.stdout: 10 166 3.26 MB/sec warmup 21 sec latency 1882.463 ms 2024-09-05T07:43:44.066 INFO:tasks.workunit.client.0.smithi017.stdout: 10 171 3.18 MB/sec warmup 22 sec latency 1981.684 ms 2024-09-05T07:43:45.066 INFO:tasks.workunit.client.0.smithi017.stdout: 10 178 3.15 MB/sec warmup 23 sec latency 1357.120 ms 2024-09-05T07:43:46.066 INFO:tasks.workunit.client.0.smithi017.stdout: 10 183 3.08 MB/sec warmup 24 sec latency 1728.478 ms 2024-09-05T07:43:47.066 INFO:tasks.workunit.client.0.smithi017.stdout: 10 186 3.00 MB/sec warmup 25 sec latency 1484.215 ms 2024-09-05T07:43:48.066 INFO:tasks.workunit.client.0.smithi017.stdout: 10 192 2.95 MB/sec warmup 26 sec latency 1797.535 ms 2024-09-05T07:43:49.066 INFO:tasks.workunit.client.0.smithi017.stdout: 10 197 2.90 MB/sec warmup 27 sec latency 1748.673 ms 2024-09-05T07:43:50.066 INFO:tasks.workunit.client.0.smithi017.stdout: 10 200 2.83 MB/sec warmup 28 sec latency 1992.392 ms 2024-09-05T07:43:51.066 INFO:tasks.workunit.client.0.smithi017.stdout: 10 207 2.80 MB/sec warmup 29 sec latency 2047.654 ms 2024-09-05T07:43:52.066 INFO:tasks.workunit.client.0.smithi017.stdout: 10 209 2.73 MB/sec warmup 30 sec latency 2286.886 ms 2024-09-05T07:43:53.066 INFO:tasks.workunit.client.0.smithi017.stdout: 10 215 2.70 MB/sec warmup 31 sec latency 1918.914 ms 2024-09-05T07:43:54.066 INFO:tasks.workunit.client.0.smithi017.stdout: 10 219 2.65 MB/sec warmup 32 sec latency 1533.049 ms 2024-09-05T07:43:55.066 INFO:tasks.workunit.client.0.smithi017.stdout: 10 227 2.65 MB/sec warmup 33 sec latency 1596.533 ms 2024-09-05T07:43:56.066 INFO:tasks.workunit.client.0.smithi017.stdout: 10 231 2.62 MB/sec warmup 34 sec latency 1547.172 ms 2024-09-05T07:43:57.066 INFO:tasks.workunit.client.0.smithi017.stdout: 10 237 2.60 MB/sec warmup 35 sec latency 1468.698 ms 2024-09-05T07:43:58.066 INFO:tasks.workunit.client.0.smithi017.stdout: 10 239 2.54 MB/sec warmup 36 sec latency 2224.939 ms 2024-09-05T07:43:59.067 INFO:tasks.workunit.client.0.smithi017.stdout: 10 245 2.53 MB/sec warmup 37 sec latency 2391.708 ms 2024-09-05T07:44:00.067 INFO:tasks.workunit.client.0.smithi017.stdout: 10 251 2.52 MB/sec warmup 38 sec latency 1632.734 ms 2024-09-05T07:44:01.067 INFO:tasks.workunit.client.0.smithi017.stdout: 10 253 2.46 MB/sec warmup 39 sec latency 2069.731 ms 2024-09-05T07:44:02.067 INFO:tasks.workunit.client.0.smithi017.stdout: 10 260 2.46 MB/sec warmup 40 sec latency 2031.999 ms 2024-09-05T07:44:03.067 INFO:tasks.workunit.client.0.smithi017.stdout: 10 260 2.40 MB/sec warmup 41 sec latency 2099.020 ms 2024-09-05T07:44:04.067 INFO:tasks.workunit.client.0.smithi017.stdout: 10 268 2.40 MB/sec warmup 42 sec latency 2638.396 ms 2024-09-05T07:44:05.067 INFO:tasks.workunit.client.0.smithi017.stdout: 10 273 2.39 MB/sec warmup 43 sec latency 1485.641 ms 2024-09-05T07:44:06.067 INFO:tasks.workunit.client.0.smithi017.stdout: 10 277 2.36 MB/sec warmup 44 sec latency 2042.917 ms 2024-09-05T07:44:07.067 INFO:tasks.workunit.client.0.smithi017.stdout: 10 281 2.33 MB/sec warmup 45 sec latency 2164.112 ms 2024-09-05T07:44:08.067 INFO:tasks.workunit.client.0.smithi017.stdout: 10 284 2.30 MB/sec warmup 46 sec latency 2519.935 ms 2024-09-05T07:44:09.067 INFO:tasks.workunit.client.0.smithi017.stdout: 10 289 2.28 MB/sec warmup 47 sec latency 2493.748 ms 2024-09-05T07:44:09.373 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:44:09.375 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:44:10.067 INFO:tasks.workunit.client.0.smithi017.stdout: 10 293 2.26 MB/sec warmup 48 sec latency 1567.526 ms 2024-09-05T07:44:11.067 INFO:tasks.workunit.client.0.smithi017.stdout: 10 299 2.26 MB/sec warmup 49 sec latency 1801.335 ms 2024-09-05T07:44:12.067 INFO:tasks.workunit.client.0.smithi017.stdout: 10 306 2.25 MB/sec warmup 50 sec latency 1716.280 ms 2024-09-05T07:44:13.067 INFO:tasks.workunit.client.0.smithi017.stdout: 10 307 2.22 MB/sec warmup 51 sec latency 1603.827 ms 2024-09-05T07:44:14.067 INFO:tasks.workunit.client.0.smithi017.stdout: 10 313 2.20 MB/sec warmup 52 sec latency 2294.929 ms 2024-09-05T07:44:15.067 INFO:tasks.workunit.client.0.smithi017.stdout: 10 319 2.20 MB/sec warmup 53 sec latency 1155.887 ms 2024-09-05T07:44:16.067 INFO:tasks.workunit.client.0.smithi017.stdout: 10 325 2.19 MB/sec warmup 54 sec latency 1163.881 ms 2024-09-05T07:44:17.067 INFO:tasks.workunit.client.0.smithi017.stdout: 10 328 2.17 MB/sec warmup 55 sec latency 1727.560 ms 2024-09-05T07:44:18.068 INFO:tasks.workunit.client.0.smithi017.stdout: 10 332 2.15 MB/sec warmup 56 sec latency 1968.266 ms 2024-09-05T07:44:19.068 INFO:tasks.workunit.client.0.smithi017.stdout: 10 338 2.15 MB/sec warmup 57 sec latency 2144.318 ms 2024-09-05T07:44:20.068 INFO:tasks.workunit.client.0.smithi017.stdout: 10 342 2.13 MB/sec warmup 58 sec latency 1520.605 ms 2024-09-05T07:44:21.068 INFO:tasks.workunit.client.0.smithi017.stdout: 10 346 2.11 MB/sec warmup 59 sec latency 1896.674 ms 2024-09-05T07:44:22.068 INFO:tasks.workunit.client.0.smithi017.stdout: 10 352 2.11 MB/sec warmup 60 sec latency 1490.720 ms 2024-09-05T07:44:23.068 INFO:tasks.workunit.client.0.smithi017.stdout: 10 353 2.08 MB/sec warmup 61 sec latency 1522.638 ms 2024-09-05T07:44:24.068 INFO:tasks.workunit.client.0.smithi017.stdout: 10 360 2.08 MB/sec warmup 62 sec latency 2314.326 ms 2024-09-05T07:44:25.068 INFO:tasks.workunit.client.0.smithi017.stdout: 10 368 2.09 MB/sec warmup 63 sec latency 1527.989 ms 2024-09-05T07:44:26.068 INFO:tasks.workunit.client.0.smithi017.stdout: 10 373 2.08 MB/sec warmup 64 sec latency 1422.705 ms 2024-09-05T07:44:27.068 INFO:tasks.workunit.client.0.smithi017.stdout: 10 377 2.07 MB/sec warmup 65 sec latency 1882.278 ms 2024-09-05T07:44:28.068 INFO:tasks.workunit.client.0.smithi017.stdout: 10 379 2.04 MB/sec warmup 66 sec latency 1956.123 ms 2024-09-05T07:44:29.068 INFO:tasks.workunit.client.0.smithi017.stdout: 10 385 2.05 MB/sec warmup 67 sec latency 2310.859 ms 2024-09-05T07:44:30.068 INFO:tasks.workunit.client.0.smithi017.stdout: 10 392 2.05 MB/sec warmup 68 sec latency 1400.223 ms 2024-09-05T07:44:30.343 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:15:48.083 36173== Warning: unimplemented fcntl command: 1036 2024-09-05T07:44:30.401 INFO:tasks.ceph.mon.b.smithi026.stderr:==00:00:15:48.109 36185== Warning: unimplemented fcntl command: 1036 2024-09-05T07:44:30.402 INFO:tasks.ceph.mon.b.smithi026.stderr:==00:00:15:48.111 36185== Warning: unimplemented fcntl command: 1036 2024-09-05T07:44:30.408 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:15:48.148 36173== Warning: unimplemented fcntl command: 1036 2024-09-05T07:44:30.464 INFO:tasks.ceph.mon.c.smithi026.stderr:==00:00:15:48.172 36186== Warning: unimplemented fcntl command: 1036 2024-09-05T07:44:30.464 INFO:tasks.ceph.mon.c.smithi026.stderr:==00:00:15:48.173 36186== Warning: unimplemented fcntl command: 1036 2024-09-05T07:44:30.500 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:15:48.240 36173== Warning: unimplemented fcntl command: 1036 2024-09-05T07:44:30.529 INFO:tasks.ceph.mon.b.smithi026.stderr:==00:00:15:48.238 36185== Warning: unimplemented fcntl command: 1036 2024-09-05T07:44:30.551 INFO:tasks.ceph.mon.c.smithi026.stderr:==00:00:15:48.259 36186== Warning: unimplemented fcntl command: 1036 2024-09-05T07:44:31.068 INFO:tasks.workunit.client.0.smithi017.stdout: 10 397 2.04 MB/sec warmup 69 sec latency 1698.843 ms 2024-09-05T07:44:32.068 INFO:tasks.workunit.client.0.smithi017.stdout: 10 400 2.03 MB/sec warmup 70 sec latency 1967.134 ms 2024-09-05T07:44:33.068 INFO:tasks.workunit.client.0.smithi017.stdout: 10 405 2.02 MB/sec warmup 71 sec latency 2255.181 ms 2024-09-05T07:44:34.068 INFO:tasks.workunit.client.0.smithi017.stdout: 10 408 2.01 MB/sec warmup 72 sec latency 1852.935 ms 2024-09-05T07:44:35.068 INFO:tasks.workunit.client.0.smithi017.stdout: 10 416 2.02 MB/sec warmup 73 sec latency 1975.648 ms 2024-09-05T07:44:36.068 INFO:tasks.workunit.client.0.smithi017.stdout: 10 417 1.99 MB/sec warmup 74 sec latency 1739.007 ms 2024-09-05T07:44:37.068 INFO:tasks.workunit.client.0.smithi017.stdout: 10 425 2.00 MB/sec warmup 75 sec latency 2152.453 ms 2024-09-05T07:44:38.068 INFO:tasks.workunit.client.0.smithi017.stdout: 10 425 1.98 MB/sec warmup 76 sec latency 1718.220 ms 2024-09-05T07:44:39.069 INFO:tasks.workunit.client.0.smithi017.stdout: 10 433 1.98 MB/sec warmup 77 sec latency 2122.482 ms 2024-09-05T07:44:39.429 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:44:39.432 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:44:40.069 INFO:tasks.workunit.client.0.smithi017.stdout: 10 438 1.97 MB/sec warmup 78 sec latency 1595.673 ms 2024-09-05T07:44:41.069 INFO:tasks.workunit.client.0.smithi017.stdout: 10 444 1.98 MB/sec warmup 79 sec latency 1671.960 ms 2024-09-05T07:44:42.069 INFO:tasks.workunit.client.0.smithi017.stdout: 10 448 1.97 MB/sec warmup 80 sec latency 1786.188 ms 2024-09-05T07:44:43.069 INFO:tasks.workunit.client.0.smithi017.stdout: 10 453 1.96 MB/sec warmup 81 sec latency 1971.641 ms 2024-09-05T07:44:44.069 INFO:tasks.workunit.client.0.smithi017.stdout: 10 454 1.95 MB/sec warmup 82 sec latency 2099.344 ms 2024-09-05T07:44:45.069 INFO:tasks.workunit.client.0.smithi017.stdout: 10 462 1.95 MB/sec warmup 83 sec latency 2276.417 ms 2024-09-05T07:44:46.069 INFO:tasks.workunit.client.0.smithi017.stdout: 10 466 1.94 MB/sec warmup 84 sec latency 1840.730 ms 2024-09-05T07:44:47.069 INFO:tasks.workunit.client.0.smithi017.stdout: 10 470 1.94 MB/sec warmup 85 sec latency 1789.760 ms 2024-09-05T07:44:48.069 INFO:tasks.workunit.client.0.smithi017.stdout: 10 475 1.93 MB/sec warmup 86 sec latency 2267.848 ms 2024-09-05T07:44:49.069 INFO:tasks.workunit.client.0.smithi017.stdout: 10 479 1.92 MB/sec warmup 87 sec latency 2535.099 ms 2024-09-05T07:44:50.069 INFO:tasks.workunit.client.0.smithi017.stdout: 10 485 1.93 MB/sec warmup 88 sec latency 1906.984 ms 2024-09-05T07:44:51.069 INFO:tasks.workunit.client.0.smithi017.stdout: 10 495 1.94 MB/sec warmup 89 sec latency 2026.156 ms 2024-09-05T07:44:52.069 INFO:tasks.workunit.client.0.smithi017.stdout: 10 499 1.93 MB/sec warmup 90 sec latency 2118.987 ms 2024-09-05T07:44:53.069 INFO:tasks.workunit.client.0.smithi017.stdout: 10 502 1.92 MB/sec warmup 91 sec latency 2497.120 ms 2024-09-05T07:44:54.069 INFO:tasks.workunit.client.0.smithi017.stdout: 10 505 1.91 MB/sec warmup 92 sec latency 3497.163 ms 2024-09-05T07:44:55.069 INFO:tasks.workunit.client.0.smithi017.stdout: 10 509 1.90 MB/sec warmup 93 sec latency 4236.106 ms 2024-09-05T07:44:56.070 INFO:tasks.workunit.client.0.smithi017.stdout: 10 515 1.91 MB/sec warmup 94 sec latency 1985.543 ms 2024-09-05T07:44:57.070 INFO:tasks.workunit.client.0.smithi017.stdout: 10 520 1.90 MB/sec warmup 95 sec latency 1765.931 ms 2024-09-05T07:44:58.070 INFO:tasks.workunit.client.0.smithi017.stdout: 10 524 1.90 MB/sec warmup 96 sec latency 1938.205 ms 2024-09-05T07:44:59.070 INFO:tasks.workunit.client.0.smithi017.stdout: 10 536 1.91 MB/sec warmup 97 sec latency 2938.254 ms 2024-09-05T07:45:00.070 INFO:tasks.workunit.client.0.smithi017.stdout: 10 546 1.94 MB/sec warmup 98 sec latency 3938.285 ms 2024-09-05T07:45:01.070 INFO:tasks.workunit.client.0.smithi017.stdout: 10 561 1.97 MB/sec warmup 99 sec latency 4009.493 ms 2024-09-05T07:45:02.070 INFO:tasks.workunit.client.0.smithi017.stdout: 10 573 1.99 MB/sec warmup 100 sec latency 2581.315 ms 2024-09-05T07:45:03.070 INFO:tasks.workunit.client.0.smithi017.stdout: 10 580 1.99 MB/sec warmup 101 sec latency 2855.380 ms 2024-09-05T07:45:04.070 INFO:tasks.workunit.client.0.smithi017.stdout: 10 596 2.01 MB/sec warmup 102 sec latency 3389.998 ms 2024-09-05T07:45:05.070 INFO:tasks.workunit.client.0.smithi017.stdout: 10 603 2.02 MB/sec warmup 103 sec latency 1638.173 ms 2024-09-05T07:45:06.070 INFO:tasks.workunit.client.0.smithi017.stdout: 10 610 2.02 MB/sec warmup 104 sec latency 2638.218 ms 2024-09-05T07:45:07.070 INFO:tasks.workunit.client.0.smithi017.stdout: 10 612 2.00 MB/sec warmup 105 sec latency 3054.743 ms 2024-09-05T07:45:08.070 INFO:tasks.workunit.client.0.smithi017.stdout: 10 613 1.98 MB/sec warmup 106 sec latency 3236.151 ms 2024-09-05T07:45:09.070 INFO:tasks.workunit.client.0.smithi017.stdout: 10 615 1.96 MB/sec warmup 107 sec latency 3615.743 ms 2024-09-05T07:45:09.502 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:45:09.504 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:45:10.070 INFO:tasks.workunit.client.0.smithi017.stdout: 10 615 1.94 MB/sec warmup 108 sec latency 3475.905 ms 2024-09-05T07:45:11.070 INFO:tasks.workunit.client.0.smithi017.stdout: 10 623 1.93 MB/sec warmup 109 sec latency 3576.311 ms 2024-09-05T07:45:12.070 INFO:tasks.workunit.client.0.smithi017.stdout: 10 632 1.91 MB/sec warmup 110 sec latency 3010.074 ms 2024-09-05T07:45:13.071 INFO:tasks.workunit.client.0.smithi017.stdout: 10 632 1.89 MB/sec warmup 111 sec latency 2593.330 ms 2024-09-05T07:45:14.070 INFO:tasks.workunit.client.0.smithi017.stdout: 10 640 1.88 MB/sec warmup 112 sec latency 3335.244 ms 2024-09-05T07:45:15.070 INFO:tasks.workunit.client.0.smithi017.stdout: 10 642 1.86 MB/sec warmup 113 sec latency 3149.398 ms 2024-09-05T07:45:16.070 INFO:tasks.workunit.client.0.smithi017.stdout: 10 647 1.85 MB/sec warmup 114 sec latency 3350.369 ms 2024-09-05T07:45:17.071 INFO:tasks.workunit.client.0.smithi017.stdout: 10 649 1.83 MB/sec warmup 115 sec latency 2703.091 ms 2024-09-05T07:45:18.071 INFO:tasks.workunit.client.0.smithi017.stdout: 10 650 1.82 MB/sec warmup 116 sec latency 3086.804 ms 2024-09-05T07:45:19.071 INFO:tasks.workunit.client.0.smithi017.stdout: 10 651 1.80 MB/sec warmup 117 sec latency 3086.747 ms 2024-09-05T07:45:20.071 INFO:tasks.workunit.client.0.smithi017.stdout: 10 653 1.79 MB/sec warmup 118 sec latency 2827.524 ms 2024-09-05T07:45:21.071 INFO:tasks.workunit.client.0.smithi017.stdout: 10 656 1.77 MB/sec warmup 119 sec latency 2662.467 ms 2024-09-05T07:45:23.071 INFO:tasks.workunit.client.0.smithi017.stdout: 10 660 0.03 MB/sec execute 1 sec latency 3711.236 ms 2024-09-05T07:45:24.071 INFO:tasks.workunit.client.0.smithi017.stdout: 10 663 0.03 MB/sec execute 2 sec latency 3832.361 ms 2024-09-05T07:45:25.071 INFO:tasks.workunit.client.0.smithi017.stdout: 10 668 0.12 MB/sec execute 3 sec latency 3498.281 ms 2024-09-05T07:45:26.071 INFO:tasks.workunit.client.0.smithi017.stdout: 10 672 0.14 MB/sec execute 4 sec latency 3068.799 ms 2024-09-05T07:45:27.071 INFO:tasks.workunit.client.0.smithi017.stdout: 10 679 0.15 MB/sec execute 5 sec latency 3254.084 ms 2024-09-05T07:45:28.071 INFO:tasks.workunit.client.0.smithi017.stdout: 10 683 0.16 MB/sec execute 6 sec latency 1942.812 ms 2024-09-05T07:45:29.071 INFO:tasks.workunit.client.0.smithi017.stdout: 10 687 0.14 MB/sec execute 7 sec latency 2806.697 ms 2024-09-05T07:45:30.071 INFO:tasks.workunit.client.0.smithi017.stdout: 10 689 0.13 MB/sec execute 8 sec latency 3007.697 ms 2024-09-05T07:45:31.071 INFO:tasks.workunit.client.0.smithi017.stdout: 10 692 0.12 MB/sec execute 9 sec latency 2649.932 ms 2024-09-05T07:45:32.071 INFO:tasks.workunit.client.0.smithi017.stdout: 10 693 0.11 MB/sec execute 10 sec latency 2843.396 ms 2024-09-05T07:45:33.071 INFO:tasks.workunit.client.0.smithi017.stdout: 10 698 0.11 MB/sec execute 11 sec latency 3015.708 ms 2024-09-05T07:45:34.071 INFO:tasks.workunit.client.0.smithi017.stdout: 10 704 0.11 MB/sec execute 12 sec latency 3492.206 ms 2024-09-05T07:45:35.071 INFO:tasks.workunit.client.0.smithi017.stdout: 10 712 0.11 MB/sec execute 13 sec latency 3315.483 ms 2024-09-05T07:45:36.071 INFO:tasks.workunit.client.0.smithi017.stdout: 10 717 0.10 MB/sec execute 14 sec latency 3886.393 ms 2024-09-05T07:45:37.072 INFO:tasks.workunit.client.0.smithi017.stdout: 10 721 0.10 MB/sec execute 15 sec latency 4455.347 ms 2024-09-05T07:45:38.071 INFO:tasks.workunit.client.0.smithi017.stdout: 10 724 0.10 MB/sec execute 16 sec latency 2839.720 ms 2024-09-05T07:45:39.072 INFO:tasks.workunit.client.0.smithi017.stdout: 10 728 0.10 MB/sec execute 17 sec latency 3839.810 ms 2024-09-05T07:45:39.575 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:45:39.577 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:45:40.072 INFO:tasks.workunit.client.0.smithi017.stdout: 10 732 0.11 MB/sec execute 18 sec latency 4839.891 ms 2024-09-05T07:45:41.072 INFO:tasks.workunit.client.0.smithi017.stdout: 10 738 0.12 MB/sec execute 19 sec latency 4985.270 ms 2024-09-05T07:45:42.072 INFO:tasks.workunit.client.0.smithi017.stdout: 10 744 0.11 MB/sec execute 20 sec latency 4353.393 ms 2024-09-05T07:45:43.072 INFO:tasks.workunit.client.0.smithi017.stdout: 10 746 0.11 MB/sec execute 21 sec latency 2824.112 ms 2024-09-05T07:45:44.072 INFO:tasks.workunit.client.0.smithi017.stdout: 10 749 0.11 MB/sec execute 22 sec latency 3824.184 ms 2024-09-05T07:45:45.072 INFO:tasks.workunit.client.0.smithi017.stdout: 10 753 0.11 MB/sec execute 23 sec latency 4197.178 ms 2024-09-05T07:45:46.072 INFO:tasks.workunit.client.0.smithi017.stdout: 10 757 0.10 MB/sec execute 24 sec latency 3926.381 ms 2024-09-05T07:45:47.072 INFO:tasks.workunit.client.0.smithi017.stdout: 10 758 0.10 MB/sec execute 25 sec latency 3089.181 ms 2024-09-05T07:45:48.072 INFO:tasks.workunit.client.0.smithi017.stdout: 10 760 0.10 MB/sec execute 26 sec latency 3203.999 ms 2024-09-05T07:45:49.072 INFO:tasks.workunit.client.0.smithi017.stdout: 10 765 0.10 MB/sec execute 27 sec latency 3261.463 ms 2024-09-05T07:45:50.072 INFO:tasks.workunit.client.0.smithi017.stdout: 10 777 0.11 MB/sec execute 28 sec latency 3074.944 ms 2024-09-05T07:45:51.072 INFO:tasks.workunit.client.0.smithi017.stdout: 10 784 0.10 MB/sec execute 29 sec latency 2555.431 ms 2024-09-05T07:45:52.072 INFO:tasks.workunit.client.0.smithi017.stdout: 10 786 0.10 MB/sec execute 30 sec latency 1656.683 ms 2024-09-05T07:45:53.072 INFO:tasks.workunit.client.0.smithi017.stdout: 10 789 0.10 MB/sec execute 31 sec latency 2402.314 ms 2024-09-05T07:45:54.073 INFO:tasks.workunit.client.0.smithi017.stdout: 10 789 0.10 MB/sec execute 32 sec latency 3402.354 ms 2024-09-05T07:45:55.073 INFO:tasks.workunit.client.0.smithi017.stdout: 10 795 0.10 MB/sec execute 33 sec latency 4402.395 ms 2024-09-05T07:45:56.073 INFO:tasks.workunit.client.0.smithi017.stdout: 10 801 0.11 MB/sec execute 34 sec latency 4677.112 ms 2024-09-05T07:45:57.073 INFO:tasks.workunit.client.0.smithi017.stdout: 10 807 0.11 MB/sec execute 35 sec latency 4340.760 ms 2024-09-05T07:45:58.073 INFO:tasks.workunit.client.0.smithi017.stdout: 10 811 0.11 MB/sec execute 36 sec latency 2725.534 ms 2024-09-05T07:45:59.073 INFO:tasks.workunit.client.0.smithi017.stdout: 10 813 0.10 MB/sec execute 37 sec latency 3128.240 ms 2024-09-05T07:46:00.073 INFO:tasks.workunit.client.0.smithi017.stdout: 10 816 0.10 MB/sec execute 38 sec latency 3191.680 ms 2024-09-05T07:46:01.073 INFO:tasks.workunit.client.0.smithi017.stdout: 10 817 0.10 MB/sec execute 39 sec latency 3271.230 ms 2024-09-05T07:46:02.073 INFO:tasks.workunit.client.0.smithi017.stdout: 10 818 0.10 MB/sec execute 40 sec latency 2946.526 ms 2024-09-05T07:46:03.073 INFO:tasks.workunit.client.0.smithi017.stdout: 10 819 0.10 MB/sec execute 41 sec latency 2853.697 ms 2024-09-05T07:46:04.073 INFO:tasks.workunit.client.0.smithi017.stdout: 10 821 0.09 MB/sec execute 42 sec latency 2896.323 ms 2024-09-05T07:46:04.588 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:17:22.329 36173== Warning: unimplemented fcntl command: 1036 2024-09-05T07:46:04.591 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:17:22.331 36173== Warning: unimplemented fcntl command: 1036 2024-09-05T07:46:04.631 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:17:22.371 36173== Warning: unimplemented fcntl command: 1036 2024-09-05T07:46:04.648 INFO:tasks.ceph.mon.b.smithi026.stderr:==00:00:17:22.356 36185== Warning: unimplemented fcntl command: 1036 2024-09-05T07:46:04.652 INFO:tasks.ceph.mon.b.smithi026.stderr:==00:00:17:22.361 36185== Warning: unimplemented fcntl command: 1036 2024-09-05T07:46:04.652 INFO:tasks.ceph.mon.c.smithi026.stderr:==00:00:17:22.361 36186== Warning: unimplemented fcntl command: 1036 2024-09-05T07:46:04.653 INFO:tasks.ceph.mon.c.smithi026.stderr:==00:00:17:22.362 36186== Warning: unimplemented fcntl command: 1036 2024-09-05T07:46:04.690 INFO:tasks.ceph.mon.b.smithi026.stderr:==00:00:17:22.398 36185== Warning: unimplemented fcntl command: 1036 2024-09-05T07:46:04.691 INFO:tasks.ceph.mon.c.smithi026.stderr:==00:00:17:22.400 36186== Warning: unimplemented fcntl command: 1036 2024-09-05T07:46:05.073 INFO:tasks.workunit.client.0.smithi017.stdout: 10 824 0.09 MB/sec execute 43 sec latency 2924.837 ms 2024-09-05T07:46:06.073 INFO:tasks.workunit.client.0.smithi017.stdout: 10 826 0.09 MB/sec execute 44 sec latency 3031.714 ms 2024-09-05T07:46:07.073 INFO:tasks.workunit.client.0.smithi017.stdout: 10 831 0.09 MB/sec execute 45 sec latency 2927.144 ms 2024-09-05T07:46:08.073 INFO:tasks.workunit.client.0.smithi017.stdout: 10 832 0.09 MB/sec execute 46 sec latency 2842.556 ms 2024-09-05T07:46:09.073 INFO:tasks.workunit.client.0.smithi017.stdout: 10 836 0.09 MB/sec execute 47 sec latency 2884.242 ms 2024-09-05T07:46:09.631 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:46:09.634 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:46:10.073 INFO:tasks.workunit.client.0.smithi017.stdout: 10 844 0.09 MB/sec execute 48 sec latency 2771.614 ms 2024-09-05T07:46:11.073 INFO:tasks.workunit.client.0.smithi017.stdout: 10 849 0.10 MB/sec execute 49 sec latency 2780.910 ms 2024-09-05T07:46:12.073 INFO:tasks.workunit.client.0.smithi017.stdout: 10 857 0.10 MB/sec execute 50 sec latency 3045.906 ms 2024-09-05T07:46:13.074 INFO:tasks.workunit.client.0.smithi017.stdout: 10 857 0.10 MB/sec execute 51 sec latency 3324.425 ms 2024-09-05T07:46:14.074 INFO:tasks.workunit.client.0.smithi017.stdout: 10 859 0.09 MB/sec execute 52 sec latency 3373.149 ms 2024-09-05T07:46:15.074 INFO:tasks.workunit.client.0.smithi017.stdout: 10 860 0.09 MB/sec execute 53 sec latency 2827.042 ms 2024-09-05T07:46:16.074 INFO:tasks.workunit.client.0.smithi017.stdout: 10 862 0.09 MB/sec execute 54 sec latency 2822.804 ms 2024-09-05T07:46:17.077 INFO:tasks.workunit.client.0.smithi017.stdout: 10 865 0.09 MB/sec execute 55 sec latency 2944.780 ms 2024-09-05T07:46:18.074 INFO:tasks.workunit.client.0.smithi017.stdout: 10 868 0.09 MB/sec execute 56 sec latency 3567.810 ms 2024-09-05T07:46:19.074 INFO:tasks.workunit.client.0.smithi017.stdout: 10 871 0.09 MB/sec execute 57 sec latency 4160.051 ms 2024-09-05T07:46:20.074 INFO:tasks.workunit.client.0.smithi017.stdout: 10 872 0.09 MB/sec execute 58 sec latency 3631.878 ms 2024-09-05T07:46:21.074 INFO:tasks.workunit.client.0.smithi017.stdout: 10 874 0.09 MB/sec execute 59 sec latency 3888.373 ms 2024-09-05T07:46:22.074 INFO:tasks.workunit.client.0.smithi017.stdout: 10 877 0.09 MB/sec execute 60 sec latency 3956.756 ms 2024-09-05T07:46:23.074 INFO:tasks.workunit.client.0.smithi017.stdout: 10 882 0.09 MB/sec execute 61 sec latency 3306.711 ms 2024-09-05T07:46:24.074 INFO:tasks.workunit.client.0.smithi017.stdout: 10 885 0.09 MB/sec execute 62 sec latency 3444.304 ms 2024-09-05T07:46:25.074 INFO:tasks.workunit.client.0.smithi017.stdout: 10 889 0.09 MB/sec execute 63 sec latency 3661.441 ms 2024-09-05T07:46:26.075 INFO:tasks.workunit.client.0.smithi017.stdout: 10 893 0.09 MB/sec execute 64 sec latency 3796.059 ms 2024-09-05T07:46:27.074 INFO:tasks.workunit.client.0.smithi017.stdout: 10 897 0.09 MB/sec execute 65 sec latency 3204.605 ms 2024-09-05T07:46:28.074 INFO:tasks.workunit.client.0.smithi017.stdout: 10 903 0.09 MB/sec execute 66 sec latency 2775.577 ms 2024-09-05T07:46:29.074 INFO:tasks.workunit.client.0.smithi017.stdout: 10 906 0.09 MB/sec execute 67 sec latency 3022.789 ms 2024-09-05T07:46:30.074 INFO:tasks.workunit.client.0.smithi017.stdout: 10 911 0.09 MB/sec execute 68 sec latency 3264.135 ms 2024-09-05T07:46:31.074 INFO:tasks.workunit.client.0.smithi017.stdout: 10 913 0.09 MB/sec execute 69 sec latency 2979.704 ms 2024-09-05T07:46:32.074 INFO:tasks.workunit.client.0.smithi017.stdout: 10 914 0.09 MB/sec execute 70 sec latency 3802.824 ms 2024-09-05T07:46:33.074 INFO:tasks.workunit.client.0.smithi017.stdout: 10 919 0.09 MB/sec execute 71 sec latency 3758.861 ms 2024-09-05T07:46:34.074 INFO:tasks.workunit.client.0.smithi017.stdout: 10 923 0.09 MB/sec execute 72 sec latency 4035.891 ms 2024-09-05T07:46:35.074 INFO:tasks.workunit.client.0.smithi017.stdout: 10 928 0.09 MB/sec execute 73 sec latency 2995.538 ms 2024-09-05T07:46:36.075 INFO:tasks.workunit.client.0.smithi017.stdout: 10 928 0.09 MB/sec execute 74 sec latency 2921.105 ms 2024-09-05T07:46:37.075 INFO:tasks.workunit.client.0.smithi017.stdout: 10 928 0.09 MB/sec execute 75 sec latency 3001.936 ms 2024-09-05T07:46:38.075 INFO:tasks.workunit.client.0.smithi017.stdout: 10 930 0.09 MB/sec execute 76 sec latency 2917.131 ms 2024-09-05T07:46:39.075 INFO:tasks.workunit.client.0.smithi017.stdout: 10 930 0.09 MB/sec execute 77 sec latency 2756.769 ms 2024-09-05T07:46:39.699 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:46:39.702 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:46:40.075 INFO:tasks.workunit.client.0.smithi017.stdout: 10 930 0.09 MB/sec execute 78 sec latency 2449.410 ms 2024-09-05T07:46:41.075 INFO:tasks.workunit.client.0.smithi017.stdout: 10 933 0.09 MB/sec execute 79 sec latency 2865.687 ms 2024-09-05T07:46:42.075 INFO:tasks.workunit.client.0.smithi017.stdout: 10 935 0.09 MB/sec execute 80 sec latency 2414.152 ms 2024-09-05T07:46:43.075 INFO:tasks.workunit.client.0.smithi017.stdout: 10 936 0.08 MB/sec execute 81 sec latency 2730.055 ms 2024-09-05T07:46:44.075 INFO:tasks.workunit.client.0.smithi017.stdout: 10 938 0.08 MB/sec execute 82 sec latency 2882.018 ms 2024-09-05T07:46:45.075 INFO:tasks.workunit.client.0.smithi017.stdout: 10 941 0.08 MB/sec execute 83 sec latency 3139.912 ms 2024-09-05T07:46:46.075 INFO:tasks.workunit.client.0.smithi017.stdout: 10 943 0.08 MB/sec execute 84 sec latency 2660.783 ms 2024-09-05T07:46:47.075 INFO:tasks.workunit.client.0.smithi017.stdout: 10 945 0.08 MB/sec execute 85 sec latency 2905.887 ms 2024-09-05T07:46:48.075 INFO:tasks.workunit.client.0.smithi017.stdout: 10 949 0.08 MB/sec execute 86 sec latency 2837.218 ms 2024-09-05T07:46:49.075 INFO:tasks.workunit.client.0.smithi017.stdout: 10 955 0.09 MB/sec execute 87 sec latency 2055.062 ms 2024-09-05T07:46:50.075 INFO:tasks.workunit.client.0.smithi017.stdout: 10 956 0.09 MB/sec execute 88 sec latency 3055.108 ms 2024-09-05T07:46:51.075 INFO:tasks.workunit.client.0.smithi017.stdout: 10 961 0.09 MB/sec execute 89 sec latency 3198.419 ms 2024-09-05T07:46:52.075 INFO:tasks.workunit.client.0.smithi017.stdout: 10 966 0.09 MB/sec execute 90 sec latency 3230.158 ms 2024-09-05T07:46:53.075 INFO:tasks.workunit.client.0.smithi017.stdout: 10 968 0.10 MB/sec execute 91 sec latency 2814.916 ms 2024-09-05T07:46:54.075 INFO:tasks.workunit.client.0.smithi017.stdout: 10 974 0.10 MB/sec execute 92 sec latency 3181.644 ms 2024-09-05T07:46:55.076 INFO:tasks.workunit.client.0.smithi017.stdout: 10 983 0.10 MB/sec execute 93 sec latency 3526.630 ms 2024-09-05T07:46:56.076 INFO:tasks.workunit.client.0.smithi017.stdout: 10 988 0.10 MB/sec execute 94 sec latency 3056.528 ms 2024-09-05T07:46:57.076 INFO:tasks.workunit.client.0.smithi017.stdout: 10 990 0.10 MB/sec execute 95 sec latency 3282.317 ms 2024-09-05T07:46:58.076 INFO:tasks.workunit.client.0.smithi017.stdout: 10 995 0.11 MB/sec execute 96 sec latency 2343.425 ms 2024-09-05T07:46:59.076 INFO:tasks.workunit.client.0.smithi017.stdout: 10 998 0.11 MB/sec execute 97 sec latency 3343.465 ms 2024-09-05T07:47:00.076 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1003 0.11 MB/sec execute 98 sec latency 4343.492 ms 2024-09-05T07:47:01.076 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1007 0.12 MB/sec execute 99 sec latency 4449.297 ms 2024-09-05T07:47:02.076 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1013 0.13 MB/sec execute 100 sec latency 3970.889 ms 2024-09-05T07:47:03.076 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1014 0.13 MB/sec execute 101 sec latency 3510.357 ms 2024-09-05T07:47:04.076 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1015 0.13 MB/sec execute 102 sec latency 3923.437 ms 2024-09-05T07:47:05.076 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1024 0.15 MB/sec execute 103 sec latency 3495.001 ms 2024-09-05T07:47:06.076 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1032 0.17 MB/sec execute 104 sec latency 2789.704 ms 2024-09-05T07:47:07.076 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1033 0.17 MB/sec execute 105 sec latency 2863.806 ms 2024-09-05T07:47:08.076 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1034 0.17 MB/sec execute 106 sec latency 2726.903 ms 2024-09-05T07:47:09.076 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1037 0.17 MB/sec execute 107 sec latency 2773.234 ms 2024-09-05T07:47:09.780 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:47:09.783 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:47:10.077 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1041 0.17 MB/sec execute 108 sec latency 2691.325 ms 2024-09-05T07:47:11.077 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1041 0.16 MB/sec execute 109 sec latency 2356.537 ms 2024-09-05T07:47:12.077 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1044 0.16 MB/sec execute 110 sec latency 3352.483 ms 2024-09-05T07:47:13.077 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1047 0.16 MB/sec execute 111 sec latency 3261.553 ms 2024-09-05T07:47:14.077 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1049 0.16 MB/sec execute 112 sec latency 3402.551 ms 2024-09-05T07:47:15.077 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1052 0.16 MB/sec execute 113 sec latency 2594.623 ms 2024-09-05T07:47:16.077 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1052 0.16 MB/sec execute 114 sec latency 3594.669 ms 2024-09-05T07:47:17.077 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1055 0.16 MB/sec execute 115 sec latency 3793.515 ms 2024-09-05T07:47:18.077 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1057 0.16 MB/sec execute 116 sec latency 2945.039 ms 2024-09-05T07:47:19.077 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1058 0.15 MB/sec execute 117 sec latency 2294.658 ms 2024-09-05T07:47:20.077 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1059 0.15 MB/sec execute 118 sec latency 2972.568 ms 2024-09-05T07:47:21.077 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1063 0.15 MB/sec execute 119 sec latency 3246.100 ms 2024-09-05T07:47:22.077 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1065 0.15 MB/sec execute 120 sec latency 2235.022 ms 2024-09-05T07:47:23.077 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1066 0.15 MB/sec execute 121 sec latency 3235.116 ms 2024-09-05T07:47:24.077 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1067 0.15 MB/sec execute 122 sec latency 3467.141 ms 2024-09-05T07:47:25.077 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1073 0.15 MB/sec execute 123 sec latency 3788.911 ms 2024-09-05T07:47:26.077 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1077 0.15 MB/sec execute 124 sec latency 3708.362 ms 2024-09-05T07:47:27.077 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1081 0.15 MB/sec execute 125 sec latency 3721.533 ms 2024-09-05T07:47:28.077 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1084 0.15 MB/sec execute 126 sec latency 2003.572 ms 2024-09-05T07:47:29.077 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1088 0.14 MB/sec execute 127 sec latency 3003.614 ms 2024-09-05T07:47:30.077 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1097 0.14 MB/sec execute 128 sec latency 3815.947 ms 2024-09-05T07:47:31.077 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1099 0.14 MB/sec execute 129 sec latency 3763.987 ms 2024-09-05T07:47:32.078 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1101 0.14 MB/sec execute 130 sec latency 4049.606 ms 2024-09-05T07:47:33.078 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1103 0.14 MB/sec execute 131 sec latency 2684.449 ms 2024-09-05T07:47:34.078 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1104 0.14 MB/sec execute 132 sec latency 3684.495 ms 2024-09-05T07:47:35.078 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1109 0.14 MB/sec execute 133 sec latency 4193.847 ms 2024-09-05T07:47:36.078 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1113 0.14 MB/sec execute 134 sec latency 3474.326 ms 2024-09-05T07:47:37.078 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1117 0.14 MB/sec execute 135 sec latency 3390.881 ms 2024-09-05T07:47:38.078 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1118 0.14 MB/sec execute 136 sec latency 2246.189 ms 2024-09-05T07:47:39.078 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1119 0.14 MB/sec execute 137 sec latency 3189.311 ms 2024-09-05T07:47:39.834 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:47:39.837 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:47:40.078 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1126 0.14 MB/sec execute 138 sec latency 2947.771 ms 2024-09-05T07:47:41.078 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1130 0.14 MB/sec execute 139 sec latency 2057.100 ms 2024-09-05T07:47:42.078 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1133 0.14 MB/sec execute 140 sec latency 2804.042 ms 2024-09-05T07:47:43.078 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1136 0.13 MB/sec execute 141 sec latency 2758.646 ms 2024-09-05T07:47:44.078 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1138 0.13 MB/sec execute 142 sec latency 3209.341 ms 2024-09-05T07:47:45.078 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1145 0.13 MB/sec execute 143 sec latency 3234.669 ms 2024-09-05T07:47:46.078 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1149 0.13 MB/sec execute 144 sec latency 1882.987 ms 2024-09-05T07:47:47.078 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1153 0.13 MB/sec execute 145 sec latency 2883.018 ms 2024-09-05T07:47:48.083 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1156 0.13 MB/sec execute 146 sec latency 3496.130 ms 2024-09-05T07:47:49.078 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1161 0.13 MB/sec execute 147 sec latency 3539.209 ms 2024-09-05T07:47:50.079 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1164 0.13 MB/sec execute 148 sec latency 3560.632 ms 2024-09-05T07:47:51.078 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1166 0.13 MB/sec execute 149 sec latency 3363.538 ms 2024-09-05T07:47:52.079 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1167 0.13 MB/sec execute 150 sec latency 2981.307 ms 2024-09-05T07:47:53.079 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1168 0.13 MB/sec execute 151 sec latency 3269.398 ms 2024-09-05T07:47:54.079 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1170 0.13 MB/sec execute 152 sec latency 3446.002 ms 2024-09-05T07:47:55.079 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1173 0.13 MB/sec execute 153 sec latency 3919.917 ms 2024-09-05T07:47:56.079 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1176 0.13 MB/sec execute 154 sec latency 3967.755 ms 2024-09-05T07:47:57.079 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1178 0.12 MB/sec execute 155 sec latency 4208.591 ms 2024-09-05T07:47:58.079 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1179 0.12 MB/sec execute 156 sec latency 3815.332 ms 2024-09-05T07:47:59.079 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1181 0.12 MB/sec execute 157 sec latency 2969.990 ms 2024-09-05T07:48:00.079 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1183 0.12 MB/sec execute 158 sec latency 3116.357 ms 2024-09-05T07:48:01.079 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1186 0.12 MB/sec execute 159 sec latency 3251.982 ms 2024-09-05T07:48:02.079 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1188 0.12 MB/sec execute 160 sec latency 3742.589 ms 2024-09-05T07:48:03.079 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1190 0.12 MB/sec execute 161 sec latency 3183.582 ms 2024-09-05T07:48:04.079 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1191 0.12 MB/sec execute 162 sec latency 3294.289 ms 2024-09-05T07:48:05.079 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1197 0.12 MB/sec execute 163 sec latency 3830.696 ms 2024-09-05T07:48:06.079 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1201 0.12 MB/sec execute 164 sec latency 3336.158 ms 2024-09-05T07:48:07.079 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1203 0.12 MB/sec execute 165 sec latency 2418.126 ms 2024-09-05T07:48:08.079 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1205 0.12 MB/sec execute 166 sec latency 3418.151 ms 2024-09-05T07:48:09.079 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1206 0.12 MB/sec execute 167 sec latency 3636.316 ms 2024-09-05T07:48:09.890 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:48:09.893 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:48:10.079 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1216 0.12 MB/sec execute 168 sec latency 3538.180 ms 2024-09-05T07:48:11.079 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1222 0.12 MB/sec execute 169 sec latency 1713.090 ms 2024-09-05T07:48:12.080 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1226 0.12 MB/sec execute 170 sec latency 2713.143 ms 2024-09-05T07:48:13.079 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1227 0.12 MB/sec execute 171 sec latency 3624.928 ms 2024-09-05T07:48:14.080 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1229 0.12 MB/sec execute 172 sec latency 3087.799 ms 2024-09-05T07:48:15.080 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1230 0.11 MB/sec execute 173 sec latency 4087.827 ms 2024-09-05T07:48:16.080 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1236 0.11 MB/sec execute 174 sec latency 4202.731 ms 2024-09-05T07:48:17.080 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1238 0.11 MB/sec execute 175 sec latency 4009.706 ms 2024-09-05T07:48:18.080 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1243 0.11 MB/sec execute 176 sec latency 2973.220 ms 2024-09-05T07:48:19.080 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1248 0.11 MB/sec execute 177 sec latency 3807.905 ms 2024-09-05T07:48:20.080 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1249 0.11 MB/sec execute 178 sec latency 3073.055 ms 2024-09-05T07:48:21.080 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1257 0.11 MB/sec execute 179 sec latency 3347.369 ms 2024-09-05T07:48:22.080 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1268 0.13 MB/sec execute 180 sec latency 3065.220 ms 2024-09-05T07:48:23.080 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1272 0.13 MB/sec execute 181 sec latency 3301.220 ms 2024-09-05T07:48:24.080 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1273 0.13 MB/sec execute 182 sec latency 3595.632 ms 2024-09-05T07:48:25.080 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1273 0.13 MB/sec execute 183 sec latency 4548.444 ms 2024-09-05T07:48:26.080 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1274 0.13 MB/sec execute 184 sec latency 3896.882 ms 2024-09-05T07:48:27.080 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1284 0.14 MB/sec execute 185 sec latency 4185.477 ms 2024-09-05T07:48:28.080 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1288 0.14 MB/sec execute 186 sec latency 3942.903 ms 2024-09-05T07:48:29.080 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1295 0.14 MB/sec execute 187 sec latency 3569.033 ms 2024-09-05T07:48:30.081 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1298 0.14 MB/sec execute 188 sec latency 4569.072 ms 2024-09-05T07:48:31.081 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1299 0.14 MB/sec execute 189 sec latency 4653.603 ms 2024-09-05T07:48:32.081 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1299 0.14 MB/sec execute 190 sec latency 4420.644 ms 2024-09-05T07:48:33.081 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1303 0.14 MB/sec execute 191 sec latency 3959.768 ms 2024-09-05T07:48:34.081 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1309 0.15 MB/sec execute 192 sec latency 2896.241 ms 2024-09-05T07:48:35.081 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1310 0.15 MB/sec execute 193 sec latency 3292.556 ms 2024-09-05T07:48:36.081 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1311 0.15 MB/sec execute 194 sec latency 3421.871 ms 2024-09-05T07:48:37.081 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1320 0.16 MB/sec execute 195 sec latency 3404.906 ms 2024-09-05T07:48:38.081 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1321 0.16 MB/sec execute 196 sec latency 2916.344 ms 2024-09-05T07:48:38.474 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:19:56.214 36173== Warning: unimplemented fcntl command: 1036 2024-09-05T07:48:38.481 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:19:56.221 36173== Warning: unimplemented fcntl command: 1036 2024-09-05T07:48:38.541 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:19:56.281 36173== Warning: unimplemented fcntl command: 1036 2024-09-05T07:48:38.544 INFO:tasks.ceph.mon.c.smithi026.stderr:==00:00:19:56.253 36186== Warning: unimplemented fcntl command: 1036 2024-09-05T07:48:38.545 INFO:tasks.ceph.mon.b.smithi026.stderr:==00:00:19:56.253 36185== Warning: unimplemented fcntl command: 1036 2024-09-05T07:48:38.547 INFO:tasks.ceph.mon.c.smithi026.stderr:==00:00:19:56.256 36186== Warning: unimplemented fcntl command: 1036 2024-09-05T07:48:38.554 INFO:tasks.ceph.mon.b.smithi026.stderr:==00:00:19:56.262 36185== Warning: unimplemented fcntl command: 1036 2024-09-05T07:48:38.617 INFO:tasks.ceph.mon.c.smithi026.stderr:==00:00:19:56.325 36186== Warning: unimplemented fcntl command: 1036 2024-09-05T07:48:38.624 INFO:tasks.ceph.mon.b.smithi026.stderr:==00:00:19:56.332 36185== Warning: unimplemented fcntl command: 1036 2024-09-05T07:48:39.081 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1332 0.18 MB/sec execute 197 sec latency 2905.192 ms 2024-09-05T07:48:39.947 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:48:39.950 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:48:40.081 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1333 0.18 MB/sec execute 198 sec latency 2902.687 ms 2024-09-05T07:48:41.081 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1333 0.17 MB/sec execute 199 sec latency 2337.170 ms 2024-09-05T07:48:42.081 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1342 0.19 MB/sec execute 200 sec latency 2735.170 ms 2024-09-05T07:48:43.081 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1381 0.24 MB/sec execute 201 sec latency 2922.640 ms 2024-09-05T07:48:44.081 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1383 0.24 MB/sec execute 202 sec latency 2921.176 ms 2024-09-05T07:48:45.081 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1383 0.24 MB/sec execute 203 sec latency 3361.162 ms 2024-09-05T07:48:46.082 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1384 0.24 MB/sec execute 204 sec latency 3135.201 ms 2024-09-05T07:48:47.081 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1388 0.24 MB/sec execute 205 sec latency 2993.815 ms 2024-09-05T07:48:48.082 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1390 0.24 MB/sec execute 206 sec latency 2494.692 ms 2024-09-05T07:48:49.082 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1392 0.24 MB/sec execute 207 sec latency 2524.251 ms 2024-09-05T07:48:50.082 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1394 0.24 MB/sec execute 208 sec latency 2828.720 ms 2024-09-05T07:48:51.082 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1396 0.23 MB/sec execute 209 sec latency 2823.583 ms 2024-09-05T07:48:52.082 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1400 0.23 MB/sec execute 210 sec latency 3074.553 ms 2024-09-05T07:48:53.082 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1404 0.23 MB/sec execute 211 sec latency 2219.853 ms 2024-09-05T07:48:54.082 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1405 0.23 MB/sec execute 212 sec latency 2446.293 ms 2024-09-05T07:48:55.082 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1406 0.23 MB/sec execute 213 sec latency 2929.220 ms 2024-09-05T07:48:56.082 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1410 0.23 MB/sec execute 214 sec latency 3096.325 ms 2024-09-05T07:48:57.082 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1414 0.23 MB/sec execute 215 sec latency 3006.911 ms 2024-09-05T07:48:58.082 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1419 0.23 MB/sec execute 216 sec latency 2178.404 ms 2024-09-05T07:48:59.082 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1422 0.23 MB/sec execute 217 sec latency 1603.739 ms 2024-09-05T07:49:00.082 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1424 0.23 MB/sec execute 218 sec latency 2603.765 ms 2024-09-05T07:49:01.082 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1425 0.22 MB/sec execute 219 sec latency 3392.428 ms 2024-09-05T07:49:02.082 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1431 0.22 MB/sec execute 220 sec latency 3250.915 ms 2024-09-05T07:49:03.082 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1437 0.22 MB/sec execute 221 sec latency 2880.370 ms 2024-09-05T07:49:04.082 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1441 0.22 MB/sec execute 222 sec latency 2949.928 ms 2024-09-05T07:49:05.083 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1443 0.22 MB/sec execute 223 sec latency 3131.997 ms 2024-09-05T07:49:06.083 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1444 0.22 MB/sec execute 224 sec latency 3315.953 ms 2024-09-05T07:49:07.083 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1447 0.22 MB/sec execute 225 sec latency 3323.966 ms 2024-09-05T07:49:08.083 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1452 0.22 MB/sec execute 226 sec latency 3106.608 ms 2024-09-05T07:49:09.083 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1455 0.22 MB/sec execute 227 sec latency 2850.862 ms 2024-09-05T07:49:10.009 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:49:10.012 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:49:10.083 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1461 0.22 MB/sec execute 228 sec latency 3342.536 ms 2024-09-05T07:49:11.083 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1467 0.22 MB/sec execute 229 sec latency 1478.691 ms 2024-09-05T07:49:12.083 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1468 0.21 MB/sec execute 230 sec latency 2478.719 ms 2024-09-05T07:49:13.083 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1470 0.21 MB/sec execute 231 sec latency 2946.185 ms 2024-09-05T07:49:14.083 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1471 0.21 MB/sec execute 232 sec latency 3431.923 ms 2024-09-05T07:49:15.083 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1473 0.21 MB/sec execute 233 sec latency 3455.556 ms 2024-09-05T07:49:16.083 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1474 0.21 MB/sec execute 234 sec latency 3984.547 ms 2024-09-05T07:49:17.083 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1480 0.21 MB/sec execute 235 sec latency 4186.873 ms 2024-09-05T07:49:18.083 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1483 0.21 MB/sec execute 236 sec latency 4695.275 ms 2024-09-05T07:49:19.083 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1484 0.21 MB/sec execute 237 sec latency 3825.456 ms 2024-09-05T07:49:20.083 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1488 0.21 MB/sec execute 238 sec latency 2702.419 ms 2024-09-05T07:49:21.083 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1489 0.21 MB/sec execute 239 sec latency 2604.139 ms 2024-09-05T07:49:22.083 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1496 0.21 MB/sec execute 240 sec latency 3050.093 ms 2024-09-05T07:49:23.084 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1503 0.21 MB/sec execute 241 sec latency 3057.428 ms 2024-09-05T07:49:24.084 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1505 0.21 MB/sec execute 242 sec latency 2342.163 ms 2024-09-05T07:49:25.083 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1506 0.20 MB/sec execute 243 sec latency 3199.810 ms 2024-09-05T07:49:26.084 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1509 0.20 MB/sec execute 244 sec latency 3307.766 ms 2024-09-05T07:49:27.084 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1510 0.20 MB/sec execute 245 sec latency 3687.627 ms 2024-09-05T07:49:28.084 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1514 0.20 MB/sec execute 246 sec latency 3144.802 ms 2024-09-05T07:49:29.084 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1516 0.20 MB/sec execute 247 sec latency 3310.432 ms 2024-09-05T07:49:30.084 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1518 0.20 MB/sec execute 248 sec latency 3160.486 ms 2024-09-05T07:49:31.084 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1522 0.20 MB/sec execute 249 sec latency 3218.161 ms 2024-09-05T07:49:32.084 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1525 0.20 MB/sec execute 250 sec latency 3382.420 ms 2024-09-05T07:49:33.084 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1532 0.20 MB/sec execute 251 sec latency 2971.665 ms 2024-09-05T07:49:34.084 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1536 0.20 MB/sec execute 252 sec latency 3340.949 ms 2024-09-05T07:49:35.084 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1537 0.20 MB/sec execute 253 sec latency 2575.827 ms 2024-09-05T07:49:36.084 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1541 0.20 MB/sec execute 254 sec latency 3400.602 ms 2024-09-05T07:49:37.084 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1545 0.20 MB/sec execute 255 sec latency 3200.520 ms 2024-09-05T07:49:38.084 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1550 0.20 MB/sec execute 256 sec latency 3159.392 ms 2024-09-05T07:49:39.084 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1553 0.20 MB/sec execute 257 sec latency 3661.711 ms 2024-09-05T07:49:40.067 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:49:40.070 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:49:40.084 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1555 0.19 MB/sec execute 258 sec latency 4058.350 ms 2024-09-05T07:49:41.085 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1557 0.19 MB/sec execute 259 sec latency 3950.765 ms 2024-09-05T07:49:42.085 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1560 0.19 MB/sec execute 260 sec latency 3772.336 ms 2024-09-05T07:49:43.085 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1562 0.19 MB/sec execute 261 sec latency 2908.274 ms 2024-09-05T07:49:44.085 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1566 0.19 MB/sec execute 262 sec latency 2924.379 ms 2024-09-05T07:49:45.085 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1568 0.19 MB/sec execute 263 sec latency 3622.831 ms 2024-09-05T07:49:46.085 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1571 0.19 MB/sec execute 264 sec latency 3545.925 ms 2024-09-05T07:49:47.085 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1578 0.19 MB/sec execute 265 sec latency 3325.726 ms 2024-09-05T07:49:48.085 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1582 0.19 MB/sec execute 266 sec latency 2516.109 ms 2024-09-05T07:49:49.085 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1585 0.19 MB/sec execute 267 sec latency 2504.848 ms 2024-09-05T07:49:50.085 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1586 0.19 MB/sec execute 268 sec latency 3504.878 ms 2024-09-05T07:49:51.086 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1590 0.19 MB/sec execute 269 sec latency 4029.412 ms 2024-09-05T07:49:52.085 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1594 0.19 MB/sec execute 270 sec latency 3133.568 ms 2024-09-05T07:49:53.085 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1598 0.19 MB/sec execute 271 sec latency 1866.511 ms 2024-09-05T07:49:54.085 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1601 0.19 MB/sec execute 272 sec latency 2866.544 ms 2024-09-05T07:49:55.085 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1603 0.19 MB/sec execute 273 sec latency 3423.601 ms 2024-09-05T07:49:56.085 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1608 0.18 MB/sec execute 274 sec latency 3822.445 ms 2024-09-05T07:49:57.085 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1610 0.18 MB/sec execute 275 sec latency 2558.053 ms 2024-09-05T07:49:58.085 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1611 0.18 MB/sec execute 276 sec latency 1807.162 ms 2024-09-05T07:49:59.086 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1612 0.18 MB/sec execute 277 sec latency 2556.734 ms 2024-09-05T07:50:00.086 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1614 0.18 MB/sec execute 278 sec latency 3150.700 ms 2024-09-05T07:50:01.085 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1622 0.18 MB/sec execute 279 sec latency 3182.328 ms 2024-09-05T07:50:02.086 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1627 0.18 MB/sec execute 280 sec latency 1561.669 ms 2024-09-05T07:50:03.086 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1631 0.18 MB/sec execute 281 sec latency 2527.862 ms 2024-09-05T07:50:04.086 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1633 0.18 MB/sec execute 282 sec latency 3123.595 ms 2024-09-05T07:50:05.086 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1635 0.18 MB/sec execute 283 sec latency 3101.545 ms 2024-09-05T07:50:06.086 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1638 0.18 MB/sec execute 284 sec latency 3195.606 ms 2024-09-05T07:50:07.086 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1640 0.18 MB/sec execute 285 sec latency 2202.509 ms 2024-09-05T07:50:08.086 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1640 0.18 MB/sec execute 286 sec latency 2933.097 ms 2024-09-05T07:50:09.086 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1642 0.18 MB/sec execute 287 sec latency 3476.283 ms 2024-09-05T07:50:10.086 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1647 0.18 MB/sec execute 288 sec latency 3956.173 ms 2024-09-05T07:50:10.124 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:50:10.127 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:50:11.086 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1652 0.18 MB/sec execute 289 sec latency 3957.066 ms 2024-09-05T07:50:12.086 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1656 0.18 MB/sec execute 290 sec latency 2035.876 ms 2024-09-05T07:50:13.086 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1659 0.18 MB/sec execute 291 sec latency 2557.805 ms 2024-09-05T07:50:14.086 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1662 0.17 MB/sec execute 292 sec latency 2915.341 ms 2024-09-05T07:50:15.086 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1664 0.17 MB/sec execute 293 sec latency 3415.982 ms 2024-09-05T07:50:16.086 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1667 0.17 MB/sec execute 294 sec latency 4115.216 ms 2024-09-05T07:50:17.086 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1673 0.17 MB/sec execute 295 sec latency 4350.791 ms 2024-09-05T07:50:18.086 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1681 0.17 MB/sec execute 296 sec latency 4247.414 ms 2024-09-05T07:50:19.087 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1687 0.17 MB/sec execute 297 sec latency 2912.974 ms 2024-09-05T07:50:20.086 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1688 0.17 MB/sec execute 298 sec latency 2815.466 ms 2024-09-05T07:50:21.086 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1692 0.17 MB/sec execute 299 sec latency 3815.511 ms 2024-09-05T07:50:22.087 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1694 0.17 MB/sec execute 300 sec latency 4146.988 ms 2024-09-05T07:50:23.087 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1697 0.17 MB/sec execute 301 sec latency 4428.928 ms 2024-09-05T07:50:24.087 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1699 0.17 MB/sec execute 302 sec latency 4246.630 ms 2024-09-05T07:50:25.087 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1700 0.17 MB/sec execute 303 sec latency 4544.473 ms 2024-09-05T07:50:26.087 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1702 0.17 MB/sec execute 304 sec latency 4589.411 ms 2024-09-05T07:50:27.087 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1708 0.17 MB/sec execute 305 sec latency 4760.957 ms 2024-09-05T07:50:28.087 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1711 0.17 MB/sec execute 306 sec latency 5650.972 ms 2024-09-05T07:50:29.087 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1714 0.17 MB/sec execute 307 sec latency 5833.523 ms 2024-09-05T07:50:30.087 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1719 0.17 MB/sec execute 308 sec latency 5618.615 ms 2024-09-05T07:50:31.087 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1726 0.17 MB/sec execute 309 sec latency 4146.199 ms 2024-09-05T07:50:32.087 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1730 0.17 MB/sec execute 310 sec latency 3008.392 ms 2024-09-05T07:50:33.087 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1731 0.17 MB/sec execute 311 sec latency 4008.425 ms 2024-09-05T07:50:34.087 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1738 0.17 MB/sec execute 312 sec latency 4331.341 ms 2024-09-05T07:50:35.087 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1744 0.17 MB/sec execute 313 sec latency 3692.583 ms 2024-09-05T07:50:36.087 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1746 0.16 MB/sec execute 314 sec latency 4692.608 ms 2024-09-05T07:50:37.087 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1747 0.16 MB/sec execute 315 sec latency 5692.711 ms 2024-09-05T07:50:38.087 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1749 0.16 MB/sec execute 316 sec latency 5860.205 ms 2024-09-05T07:50:39.087 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1752 0.16 MB/sec execute 317 sec latency 4957.887 ms 2024-09-05T07:50:40.087 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1754 0.16 MB/sec execute 318 sec latency 4159.572 ms 2024-09-05T07:50:40.188 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:50:40.191 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:50:41.087 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1758 0.16 MB/sec execute 319 sec latency 4740.084 ms 2024-09-05T07:50:42.087 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1762 0.16 MB/sec execute 320 sec latency 4917.174 ms 2024-09-05T07:50:43.087 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1768 0.16 MB/sec execute 321 sec latency 4115.919 ms 2024-09-05T07:50:44.088 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1772 0.16 MB/sec execute 322 sec latency 4431.705 ms 2024-09-05T07:50:45.088 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1774 0.16 MB/sec execute 323 sec latency 2937.416 ms 2024-09-05T07:50:46.088 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1775 0.16 MB/sec execute 324 sec latency 3692.759 ms 2024-09-05T07:50:47.088 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1778 0.16 MB/sec execute 325 sec latency 3525.822 ms 2024-09-05T07:50:48.088 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1781 0.16 MB/sec execute 326 sec latency 3966.253 ms 2024-09-05T07:50:49.088 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1785 0.16 MB/sec execute 327 sec latency 3914.925 ms 2024-09-05T07:50:50.088 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1792 0.16 MB/sec execute 328 sec latency 4121.567 ms 2024-09-05T07:50:51.088 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1802 0.16 MB/sec execute 329 sec latency 4864.883 ms 2024-09-05T07:50:52.088 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1804 0.16 MB/sec execute 330 sec latency 4472.273 ms 2024-09-05T07:50:53.088 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1807 0.16 MB/sec execute 331 sec latency 3915.107 ms 2024-09-05T07:50:54.088 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1808 0.16 MB/sec execute 332 sec latency 2313.036 ms 2024-09-05T07:50:55.088 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1810 0.16 MB/sec execute 333 sec latency 2933.892 ms 2024-09-05T07:50:56.088 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1815 0.16 MB/sec execute 334 sec latency 3143.260 ms 2024-09-05T07:50:57.088 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1817 0.16 MB/sec execute 335 sec latency 3907.390 ms 2024-09-05T07:50:58.088 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1821 0.16 MB/sec execute 336 sec latency 4178.780 ms 2024-09-05T07:50:59.088 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1824 0.16 MB/sec execute 337 sec latency 3999.641 ms 2024-09-05T07:51:00.088 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1828 0.16 MB/sec execute 338 sec latency 3189.784 ms 2024-09-05T07:51:01.088 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1830 0.15 MB/sec execute 339 sec latency 3002.268 ms 2024-09-05T07:51:02.089 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1832 0.15 MB/sec execute 340 sec latency 2809.033 ms 2024-09-05T07:51:03.089 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1835 0.15 MB/sec execute 341 sec latency 2489.041 ms 2024-09-05T07:51:04.089 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1836 0.15 MB/sec execute 342 sec latency 2525.256 ms 2024-09-05T07:51:05.089 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1839 0.15 MB/sec execute 343 sec latency 2562.606 ms 2024-09-05T07:51:06.089 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1842 0.15 MB/sec execute 344 sec latency 3083.195 ms 2024-09-05T07:51:07.092 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1846 0.15 MB/sec execute 345 sec latency 3223.416 ms 2024-09-05T07:51:08.089 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1849 0.15 MB/sec execute 346 sec latency 3125.625 ms 2024-09-05T07:51:09.089 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1852 0.15 MB/sec execute 347 sec latency 2635.116 ms 2024-09-05T07:51:10.089 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1855 0.15 MB/sec execute 348 sec latency 2780.085 ms 2024-09-05T07:51:10.248 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:51:10.251 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:51:11.089 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1858 0.15 MB/sec execute 349 sec latency 2778.735 ms 2024-09-05T07:51:12.099 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1864 0.15 MB/sec execute 350 sec latency 2725.303 ms 2024-09-05T07:51:13.089 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1866 0.15 MB/sec execute 351 sec latency 2781.687 ms 2024-09-05T07:51:14.089 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1868 0.15 MB/sec execute 352 sec latency 2743.265 ms 2024-09-05T07:51:15.089 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1871 0.15 MB/sec execute 353 sec latency 2785.750 ms 2024-09-05T07:51:16.089 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1872 0.15 MB/sec execute 354 sec latency 2977.050 ms 2024-09-05T07:51:17.089 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1872 0.15 MB/sec execute 355 sec latency 2880.840 ms 2024-09-05T07:51:18.090 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1878 0.15 MB/sec execute 356 sec latency 3195.395 ms 2024-09-05T07:51:19.089 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1883 0.15 MB/sec execute 357 sec latency 2197.352 ms 2024-09-05T07:51:20.089 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1886 0.15 MB/sec execute 358 sec latency 1632.179 ms 2024-09-05T07:51:21.089 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1886 0.15 MB/sec execute 359 sec latency 2379.109 ms 2024-09-05T07:51:22.090 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1894 0.15 MB/sec execute 360 sec latency 2507.069 ms 2024-09-05T07:51:23.090 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1902 0.15 MB/sec execute 361 sec latency 2630.243 ms 2024-09-05T07:51:24.090 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1906 0.15 MB/sec execute 362 sec latency 2628.068 ms 2024-09-05T07:51:25.090 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1907 0.15 MB/sec execute 363 sec latency 3184.850 ms 2024-09-05T07:51:26.090 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1912 0.15 MB/sec execute 364 sec latency 3461.696 ms 2024-09-05T07:51:27.090 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1918 0.15 MB/sec execute 365 sec latency 2867.047 ms 2024-09-05T07:51:28.090 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1920 0.15 MB/sec execute 366 sec latency 1333.074 ms 2024-09-05T07:51:29.090 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1921 0.15 MB/sec execute 367 sec latency 2333.107 ms 2024-09-05T07:51:30.090 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1923 0.15 MB/sec execute 368 sec latency 3333.206 ms 2024-09-05T07:51:31.090 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1923 0.14 MB/sec execute 369 sec latency 4271.712 ms 2024-09-05T07:51:32.090 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1929 0.14 MB/sec execute 370 sec latency 4199.394 ms 2024-09-05T07:51:33.090 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1932 0.14 MB/sec execute 371 sec latency 3593.707 ms 2024-09-05T07:51:34.090 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1936 0.14 MB/sec execute 372 sec latency 3475.227 ms 2024-09-05T07:51:35.090 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1942 0.14 MB/sec execute 373 sec latency 3020.159 ms 2024-09-05T07:51:36.090 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1950 0.14 MB/sec execute 374 sec latency 3141.625 ms 2024-09-05T07:51:37.090 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1952 0.14 MB/sec execute 375 sec latency 3932.817 ms 2024-09-05T07:51:38.091 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1956 0.14 MB/sec execute 376 sec latency 4171.591 ms 2024-09-05T07:51:39.091 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1957 0.14 MB/sec execute 377 sec latency 4031.335 ms 2024-09-05T07:51:40.091 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1958 0.14 MB/sec execute 378 sec latency 2589.867 ms 2024-09-05T07:51:40.304 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:51:40.306 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:51:41.091 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1959 0.14 MB/sec execute 379 sec latency 3408.851 ms 2024-09-05T07:51:42.091 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1961 0.14 MB/sec execute 380 sec latency 4220.450 ms 2024-09-05T07:51:43.091 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1971 0.14 MB/sec execute 381 sec latency 3851.302 ms 2024-09-05T07:51:44.091 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1977 0.14 MB/sec execute 382 sec latency 2377.213 ms 2024-09-05T07:51:45.091 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1983 0.14 MB/sec execute 383 sec latency 2783.285 ms 2024-09-05T07:51:46.091 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1986 0.14 MB/sec execute 384 sec latency 2978.086 ms 2024-09-05T07:51:47.091 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1988 0.14 MB/sec execute 385 sec latency 3716.973 ms 2024-09-05T07:51:48.092 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1989 0.14 MB/sec execute 386 sec latency 3165.357 ms 2024-09-05T07:51:49.091 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1993 0.14 MB/sec execute 387 sec latency 3424.280 ms 2024-09-05T07:51:50.091 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1997 0.14 MB/sec execute 388 sec latency 3685.299 ms 2024-09-05T07:51:51.092 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2000 0.14 MB/sec execute 389 sec latency 4209.419 ms 2024-09-05T07:51:52.091 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2002 0.14 MB/sec execute 390 sec latency 5115.143 ms 2024-09-05T07:51:53.091 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2005 0.14 MB/sec execute 391 sec latency 5598.977 ms 2024-09-05T07:51:54.092 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2012 0.14 MB/sec execute 392 sec latency 5621.015 ms 2024-09-05T07:51:55.091 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2014 0.14 MB/sec execute 393 sec latency 4229.014 ms 2024-09-05T07:51:56.092 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2015 0.14 MB/sec execute 394 sec latency 5229.052 ms 2024-09-05T07:51:57.092 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2017 0.14 MB/sec execute 395 sec latency 5585.226 ms 2024-09-05T07:51:58.092 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2019 0.14 MB/sec execute 396 sec latency 4152.039 ms 2024-09-05T07:51:59.092 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2023 0.14 MB/sec execute 397 sec latency 2750.669 ms 2024-09-05T07:52:00.092 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2026 0.14 MB/sec execute 398 sec latency 912.397 ms 2024-09-05T07:52:01.092 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2029 0.14 MB/sec execute 399 sec latency 1555.734 ms 2024-09-05T07:52:02.092 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2032 0.14 MB/sec execute 400 sec latency 2555.821 ms 2024-09-05T07:52:03.092 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2034 0.14 MB/sec execute 401 sec latency 3555.847 ms 2024-09-05T07:52:04.092 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2039 0.14 MB/sec execute 402 sec latency 3689.607 ms 2024-09-05T07:52:05.092 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2042 0.14 MB/sec execute 403 sec latency 2546.513 ms 2024-09-05T07:52:06.092 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2043 0.14 MB/sec execute 404 sec latency 2904.088 ms 2024-09-05T07:52:07.092 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2047 0.14 MB/sec execute 405 sec latency 3183.652 ms 2024-09-05T07:52:08.092 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2050 0.14 MB/sec execute 406 sec latency 3662.234 ms 2024-09-05T07:52:09.093 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2052 0.14 MB/sec execute 407 sec latency 2735.095 ms 2024-09-05T07:52:10.093 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2054 0.14 MB/sec execute 408 sec latency 3360.761 ms 2024-09-05T07:52:10.374 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:52:10.380 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:52:11.092 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2056 0.13 MB/sec execute 409 sec latency 3340.802 ms 2024-09-05T07:52:12.093 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2060 0.13 MB/sec execute 410 sec latency 3235.653 ms 2024-09-05T07:52:13.093 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2062 0.13 MB/sec execute 411 sec latency 2704.522 ms 2024-09-05T07:52:14.093 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2063 0.13 MB/sec execute 412 sec latency 2389.104 ms 2024-09-05T07:52:15.096 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2066 0.13 MB/sec execute 413 sec latency 2847.933 ms 2024-09-05T07:52:16.093 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2067 0.13 MB/sec execute 414 sec latency 3017.871 ms 2024-09-05T07:52:17.093 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2070 0.13 MB/sec execute 415 sec latency 3327.874 ms 2024-09-05T07:52:18.093 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2071 0.13 MB/sec execute 416 sec latency 3320.890 ms 2024-09-05T07:52:19.093 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2074 0.13 MB/sec execute 417 sec latency 3417.880 ms 2024-09-05T07:52:20.093 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2081 0.13 MB/sec execute 418 sec latency 2809.799 ms 2024-09-05T07:52:21.093 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2082 0.13 MB/sec execute 419 sec latency 2495.909 ms 2024-09-05T07:52:22.093 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2085 0.13 MB/sec execute 420 sec latency 2965.247 ms 2024-09-05T07:52:23.093 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2088 0.13 MB/sec execute 421 sec latency 3079.549 ms 2024-09-05T07:52:24.093 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2093 0.13 MB/sec execute 422 sec latency 2896.576 ms 2024-09-05T07:52:25.093 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2097 0.13 MB/sec execute 423 sec latency 2692.195 ms 2024-09-05T07:52:26.093 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2098 0.13 MB/sec execute 424 sec latency 2910.215 ms 2024-09-05T07:52:27.093 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2098 0.13 MB/sec execute 425 sec latency 3631.737 ms 2024-09-05T07:52:28.093 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2100 0.13 MB/sec execute 426 sec latency 4131.626 ms 2024-09-05T07:52:29.093 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2102 0.13 MB/sec execute 427 sec latency 4562.686 ms 2024-09-05T07:52:30.093 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2105 0.13 MB/sec execute 428 sec latency 4525.009 ms 2024-09-05T07:52:31.093 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2109 0.13 MB/sec execute 429 sec latency 4743.239 ms 2024-09-05T07:52:32.093 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2115 0.13 MB/sec execute 430 sec latency 4171.061 ms 2024-09-05T07:52:33.093 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2120 0.13 MB/sec execute 431 sec latency 3351.047 ms 2024-09-05T07:52:34.094 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2122 0.13 MB/sec execute 432 sec latency 2604.823 ms 2024-09-05T07:52:35.094 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2124 0.13 MB/sec execute 433 sec latency 2919.231 ms 2024-09-05T07:52:36.094 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2126 0.13 MB/sec execute 434 sec latency 2913.721 ms 2024-09-05T07:52:37.094 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2126 0.13 MB/sec execute 435 sec latency 3432.325 ms 2024-09-05T07:52:38.094 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2129 0.13 MB/sec execute 436 sec latency 3657.972 ms 2024-09-05T07:52:39.094 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2133 0.13 MB/sec execute 437 sec latency 3812.132 ms 2024-09-05T07:52:40.094 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2135 0.13 MB/sec execute 438 sec latency 4272.823 ms 2024-09-05T07:52:40.432 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:52:40.435 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:52:41.094 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2141 0.13 MB/sec execute 439 sec latency 3834.034 ms 2024-09-05T07:52:42.094 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2147 0.13 MB/sec execute 440 sec latency 3100.164 ms 2024-09-05T07:52:43.094 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2149 0.13 MB/sec execute 441 sec latency 3168.043 ms 2024-09-05T07:52:44.094 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2156 0.13 MB/sec execute 442 sec latency 3207.431 ms 2024-09-05T07:52:45.094 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2158 0.13 MB/sec execute 443 sec latency 3594.293 ms 2024-09-05T07:52:46.094 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2159 0.13 MB/sec execute 444 sec latency 3587.352 ms 2024-09-05T07:52:47.094 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2163 0.13 MB/sec execute 445 sec latency 3590.208 ms 2024-09-05T07:52:48.094 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2166 0.13 MB/sec execute 446 sec latency 2911.435 ms 2024-09-05T07:52:49.094 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2170 0.13 MB/sec execute 447 sec latency 3911.462 ms 2024-09-05T07:52:50.094 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2172 0.13 MB/sec execute 448 sec latency 4191.841 ms 2024-09-05T07:52:51.094 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2173 0.13 MB/sec execute 449 sec latency 4377.375 ms 2024-09-05T07:52:52.094 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2178 0.13 MB/sec execute 450 sec latency 4779.104 ms 2024-09-05T07:52:53.095 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2185 0.13 MB/sec execute 451 sec latency 3800.864 ms 2024-09-05T07:52:54.095 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2192 0.13 MB/sec execute 452 sec latency 3850.915 ms 2024-09-05T07:52:55.096 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2196 0.13 MB/sec execute 453 sec latency 1567.209 ms 2024-09-05T07:52:56.095 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2200 0.13 MB/sec execute 454 sec latency 2567.251 ms 2024-09-05T07:52:57.095 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2201 0.13 MB/sec execute 455 sec latency 3567.333 ms 2024-09-05T07:52:58.095 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2203 0.13 MB/sec execute 456 sec latency 4092.196 ms 2024-09-05T07:52:59.095 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2204 0.13 MB/sec execute 457 sec latency 4202.839 ms 2024-09-05T07:53:00.095 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2211 0.13 MB/sec execute 458 sec latency 4182.334 ms 2024-09-05T07:53:01.095 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2216 0.13 MB/sec execute 459 sec latency 4008.914 ms 2024-09-05T07:53:02.095 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2221 0.13 MB/sec execute 460 sec latency 3181.728 ms 2024-09-05T07:53:03.095 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2222 0.13 MB/sec execute 461 sec latency 3500.749 ms 2024-09-05T07:53:04.095 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2224 0.13 MB/sec execute 462 sec latency 2764.621 ms 2024-09-05T07:53:05.095 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2233 0.13 MB/sec execute 463 sec latency 2249.198 ms 2024-09-05T07:53:06.096 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2235 0.13 MB/sec execute 464 sec latency 1887.820 ms 2024-09-05T07:53:07.095 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2236 0.13 MB/sec execute 465 sec latency 2887.862 ms 2024-09-05T07:53:08.095 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2243 0.13 MB/sec execute 466 sec latency 3755.155 ms 2024-09-05T07:53:09.095 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2246 0.13 MB/sec execute 467 sec latency 3836.995 ms 2024-09-05T07:53:10.095 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2249 0.13 MB/sec execute 468 sec latency 2678.697 ms 2024-09-05T07:53:10.488 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:53:10.491 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:53:11.095 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2251 0.13 MB/sec execute 469 sec latency 3132.851 ms 2024-09-05T07:53:12.095 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2255 0.13 MB/sec execute 470 sec latency 3620.797 ms 2024-09-05T07:53:13.096 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2262 0.13 MB/sec execute 471 sec latency 3508.513 ms 2024-09-05T07:53:14.095 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2267 0.13 MB/sec execute 472 sec latency 3972.054 ms 2024-09-05T07:53:15.096 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2274 0.13 MB/sec execute 473 sec latency 3162.672 ms 2024-09-05T07:53:15.776 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:24:33.516 36173== Warning: unimplemented fcntl command: 1036 2024-09-05T07:53:15.780 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:24:33.520 36173== Warning: unimplemented fcntl command: 1036 2024-09-05T07:53:15.787 INFO:tasks.ceph.mon.b.smithi026.stderr:==00:00:24:33.496 36185== Warning: unimplemented fcntl command: 1036 2024-09-05T07:53:15.790 INFO:tasks.ceph.mon.b.smithi026.stderr:==00:00:24:33.498 36185== Warning: unimplemented fcntl command: 1036 2024-09-05T07:53:15.836 INFO:tasks.ceph.mon.c.smithi026.stderr:==00:00:24:33.544 36186== Warning: unimplemented fcntl command: 1036 2024-09-05T07:53:15.843 INFO:tasks.ceph.mon.c.smithi026.stderr:==00:00:24:33.551 36186== Warning: unimplemented fcntl command: 1036 2024-09-05T07:53:15.890 INFO:tasks.ceph.mon.b.smithi026.stderr:==00:00:24:33.598 36185== Warning: unimplemented fcntl command: 1036 2024-09-05T07:53:15.901 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:24:33.641 36173== Warning: unimplemented fcntl command: 1036 2024-09-05T07:53:15.949 INFO:tasks.ceph.mon.c.smithi026.stderr:==00:00:24:33.657 36186== Warning: unimplemented fcntl command: 1036 2024-09-05T07:53:16.096 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2277 0.13 MB/sec execute 474 sec latency 3223.789 ms 2024-09-05T07:53:17.096 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2284 0.13 MB/sec execute 475 sec latency 3499.116 ms 2024-09-05T07:53:18.096 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2290 0.13 MB/sec execute 476 sec latency 3632.944 ms 2024-09-05T07:53:19.096 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2295 0.14 MB/sec execute 477 sec latency 3585.893 ms 2024-09-05T07:53:20.096 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2299 0.14 MB/sec execute 478 sec latency 3694.679 ms 2024-09-05T07:53:21.096 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2303 0.14 MB/sec execute 479 sec latency 3853.722 ms 2024-09-05T07:53:22.096 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2305 0.14 MB/sec execute 480 sec latency 4106.292 ms 2024-09-05T07:53:23.096 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2307 0.14 MB/sec execute 481 sec latency 3968.156 ms 2024-09-05T07:53:24.096 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2309 0.14 MB/sec execute 482 sec latency 4374.311 ms 2024-09-05T07:53:25.096 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2310 0.14 MB/sec execute 483 sec latency 4547.521 ms 2024-09-05T07:53:26.096 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2314 0.14 MB/sec execute 484 sec latency 4398.268 ms 2024-09-05T07:53:27.096 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2316 0.14 MB/sec execute 485 sec latency 3660.656 ms 2024-09-05T07:53:28.096 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2317 0.14 MB/sec execute 486 sec latency 4224.492 ms 2024-09-05T07:53:29.096 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2317 0.14 MB/sec execute 487 sec latency 3661.357 ms 2024-09-05T07:53:30.096 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2321 0.14 MB/sec execute 488 sec latency 3825.645 ms 2024-09-05T07:53:31.096 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2323 0.14 MB/sec execute 489 sec latency 2642.883 ms 2024-09-05T07:53:32.097 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2324 0.14 MB/sec execute 490 sec latency 2835.917 ms 2024-09-05T07:53:33.096 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2327 0.14 MB/sec execute 491 sec latency 2982.916 ms 2024-09-05T07:53:34.097 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2329 0.14 MB/sec execute 492 sec latency 2945.116 ms 2024-09-05T07:53:35.097 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2331 0.14 MB/sec execute 493 sec latency 2841.191 ms 2024-09-05T07:53:36.097 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2335 0.14 MB/sec execute 494 sec latency 3066.018 ms 2024-09-05T07:53:37.097 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2335 0.14 MB/sec execute 495 sec latency 3152.490 ms 2024-09-05T07:53:38.097 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2336 0.14 MB/sec execute 496 sec latency 3347.417 ms 2024-09-05T07:53:39.097 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2339 0.14 MB/sec execute 497 sec latency 3110.537 ms 2024-09-05T07:53:40.097 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2340 0.14 MB/sec execute 498 sec latency 3241.338 ms 2024-09-05T07:53:40.560 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:53:40.563 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:53:41.097 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2343 0.14 MB/sec execute 499 sec latency 3070.462 ms 2024-09-05T07:53:42.097 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2345 0.14 MB/sec execute 500 sec latency 3091.265 ms 2024-09-05T07:53:43.097 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2348 0.14 MB/sec execute 501 sec latency 3028.072 ms 2024-09-05T07:53:44.097 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2349 0.13 MB/sec execute 502 sec latency 2904.082 ms 2024-09-05T07:53:45.097 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2350 0.13 MB/sec execute 503 sec latency 3090.965 ms 2024-09-05T07:53:46.098 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2351 0.13 MB/sec execute 504 sec latency 2890.618 ms 2024-09-05T07:53:47.097 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2351 0.13 MB/sec execute 505 sec latency 3281.940 ms 2024-09-05T07:53:48.097 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2355 0.13 MB/sec execute 506 sec latency 3459.539 ms 2024-09-05T07:53:49.097 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2358 0.13 MB/sec execute 507 sec latency 3657.141 ms 2024-09-05T07:53:50.100 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2361 0.13 MB/sec execute 508 sec latency 3523.396 ms 2024-09-05T07:53:51.098 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2363 0.13 MB/sec execute 509 sec latency 3156.722 ms 2024-09-05T07:53:52.098 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2365 0.13 MB/sec execute 510 sec latency 2901.856 ms 2024-09-05T07:53:53.098 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2367 0.13 MB/sec execute 511 sec latency 3263.527 ms 2024-09-05T07:53:54.098 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2370 0.13 MB/sec execute 512 sec latency 3191.820 ms 2024-09-05T07:53:55.098 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2372 0.13 MB/sec execute 513 sec latency 3108.277 ms 2024-09-05T07:53:56.098 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2374 0.13 MB/sec execute 514 sec latency 3133.834 ms 2024-09-05T07:53:57.098 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2375 0.13 MB/sec execute 515 sec latency 3395.772 ms 2024-09-05T07:53:58.098 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2376 0.13 MB/sec execute 516 sec latency 3341.921 ms 2024-09-05T07:53:59.098 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2378 0.13 MB/sec execute 517 sec latency 3250.607 ms 2024-09-05T07:54:00.098 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2380 0.13 MB/sec execute 518 sec latency 3352.726 ms 2024-09-05T07:54:01.098 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2384 0.13 MB/sec execute 519 sec latency 3154.497 ms 2024-09-05T07:54:02.098 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2386 0.13 MB/sec execute 520 sec latency 2986.190 ms 2024-09-05T07:54:03.098 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2388 0.13 MB/sec execute 521 sec latency 3657.615 ms 2024-09-05T07:54:04.098 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2389 0.13 MB/sec execute 522 sec latency 3364.805 ms 2024-09-05T07:54:05.098 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2390 0.13 MB/sec execute 523 sec latency 2881.296 ms 2024-09-05T07:54:06.098 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2392 0.13 MB/sec execute 524 sec latency 2863.948 ms 2024-09-05T07:54:07.099 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2394 0.13 MB/sec execute 525 sec latency 3367.535 ms 2024-09-05T07:54:08.099 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2397 0.13 MB/sec execute 526 sec latency 3435.762 ms 2024-09-05T07:54:09.099 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2399 0.13 MB/sec execute 527 sec latency 3332.232 ms 2024-09-05T07:54:10.099 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2402 0.13 MB/sec execute 528 sec latency 3435.705 ms 2024-09-05T07:54:10.616 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:54:10.619 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:54:11.099 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2406 0.13 MB/sec execute 529 sec latency 3279.209 ms 2024-09-05T07:54:12.099 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2407 0.13 MB/sec execute 530 sec latency 3391.012 ms 2024-09-05T07:54:13.099 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2410 0.13 MB/sec execute 531 sec latency 3623.498 ms 2024-09-05T07:54:14.099 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2413 0.13 MB/sec execute 532 sec latency 3688.172 ms 2024-09-05T07:54:15.099 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2416 0.13 MB/sec execute 533 sec latency 3048.331 ms 2024-09-05T07:54:16.099 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2418 0.13 MB/sec execute 534 sec latency 3676.273 ms 2024-09-05T07:54:17.099 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2422 0.13 MB/sec execute 535 sec latency 3501.532 ms 2024-09-05T07:54:18.099 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2424 0.13 MB/sec execute 536 sec latency 4168.851 ms 2024-09-05T07:54:19.099 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2426 0.13 MB/sec execute 537 sec latency 3032.788 ms 2024-09-05T07:54:20.099 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2427 0.13 MB/sec execute 538 sec latency 3535.249 ms 2024-09-05T07:54:21.099 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2430 0.13 MB/sec execute 539 sec latency 3213.839 ms 2024-09-05T07:54:22.099 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2435 0.13 MB/sec execute 540 sec latency 3271.265 ms 2024-09-05T07:54:23.099 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2439 0.13 MB/sec execute 541 sec latency 3419.292 ms 2024-09-05T07:54:24.099 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2442 0.13 MB/sec execute 542 sec latency 3325.065 ms 2024-09-05T07:54:25.099 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2444 0.13 MB/sec execute 543 sec latency 3694.269 ms 2024-09-05T07:54:26.030 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:25:43.769 36173== Warning: unimplemented fcntl command: 1036 2024-09-05T07:54:26.034 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:25:43.774 36173== Warning: unimplemented fcntl command: 1036 2024-09-05T07:54:26.062 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:25:43.802 36173== Warning: unimplemented fcntl command: 1036 2024-09-05T07:54:26.099 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2446 0.13 MB/sec execute 544 sec latency 3985.817 ms 2024-09-05T07:54:26.116 INFO:tasks.ceph.mon.b.smithi026.stderr:==00:00:25:43.825 36185== Warning: unimplemented fcntl command: 1036 2024-09-05T07:54:26.117 INFO:tasks.ceph.mon.c.smithi026.stderr:==00:00:25:43.825 36186== Warning: unimplemented fcntl command: 1036 2024-09-05T07:54:26.122 INFO:tasks.ceph.mon.b.smithi026.stderr:==00:00:25:43.830 36185== Warning: unimplemented fcntl command: 1036 2024-09-05T07:54:26.140 INFO:tasks.ceph.mon.c.smithi026.stderr:==00:00:25:43.848 36186== Warning: unimplemented fcntl command: 1036 2024-09-05T07:54:26.152 INFO:tasks.ceph.mon.b.smithi026.stderr:==00:00:25:43.861 36185== Warning: unimplemented fcntl command: 1036 2024-09-05T07:54:26.176 INFO:tasks.ceph.mon.c.smithi026.stderr:==00:00:25:43.884 36186== Warning: unimplemented fcntl command: 1036 2024-09-05T07:54:27.099 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2448 0.13 MB/sec execute 545 sec latency 3657.900 ms 2024-09-05T07:54:28.099 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2450 0.13 MB/sec execute 546 sec latency 3928.875 ms 2024-09-05T07:54:29.099 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2454 0.13 MB/sec execute 547 sec latency 3911.360 ms 2024-09-05T07:54:30.099 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2455 0.13 MB/sec execute 548 sec latency 3625.723 ms 2024-09-05T07:54:31.099 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2458 0.13 MB/sec execute 549 sec latency 3212.086 ms 2024-09-05T07:54:32.099 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2459 0.13 MB/sec execute 550 sec latency 3292.082 ms 2024-09-05T07:54:33.100 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2461 0.13 MB/sec execute 551 sec latency 3260.379 ms 2024-09-05T07:54:34.100 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2465 0.13 MB/sec execute 552 sec latency 3113.263 ms 2024-09-05T07:54:35.100 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2466 0.13 MB/sec execute 553 sec latency 3259.764 ms 2024-09-05T07:54:36.100 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2470 0.13 MB/sec execute 554 sec latency 3408.865 ms 2024-09-05T07:54:37.100 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2476 0.13 MB/sec execute 555 sec latency 3414.480 ms 2024-09-05T07:54:38.100 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2482 0.13 MB/sec execute 556 sec latency 3310.323 ms 2024-09-05T07:54:39.100 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2487 0.13 MB/sec execute 557 sec latency 3486.905 ms 2024-09-05T07:54:40.100 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2488 0.13 MB/sec execute 558 sec latency 3572.750 ms 2024-09-05T07:54:40.673 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:54:40.675 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:54:41.100 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2492 0.14 MB/sec execute 559 sec latency 3348.379 ms 2024-09-05T07:54:42.100 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2492 0.14 MB/sec execute 560 sec latency 3023.977 ms 2024-09-05T07:54:43.100 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2498 0.14 MB/sec execute 561 sec latency 3116.332 ms 2024-09-05T07:54:44.100 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2504 0.14 MB/sec execute 562 sec latency 3330.528 ms 2024-09-05T07:54:45.100 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2508 0.14 MB/sec execute 563 sec latency 2840.104 ms 2024-09-05T07:54:46.100 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2509 0.14 MB/sec execute 564 sec latency 3562.605 ms 2024-09-05T07:54:47.100 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2511 0.14 MB/sec execute 565 sec latency 3128.664 ms 2024-09-05T07:54:48.100 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2516 0.14 MB/sec execute 566 sec latency 3913.807 ms 2024-09-05T07:54:49.100 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2519 0.14 MB/sec execute 567 sec latency 3474.217 ms 2024-09-05T07:54:50.100 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2526 0.14 MB/sec execute 568 sec latency 3245.653 ms 2024-09-05T07:54:51.100 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2528 0.14 MB/sec execute 569 sec latency 3032.101 ms 2024-09-05T07:54:52.100 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2528 0.14 MB/sec execute 570 sec latency 3347.486 ms 2024-09-05T07:54:53.101 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2530 0.14 MB/sec execute 571 sec latency 3415.739 ms 2024-09-05T07:54:54.101 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2532 0.14 MB/sec execute 572 sec latency 2885.129 ms 2024-09-05T07:54:55.101 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2535 0.14 MB/sec execute 573 sec latency 2152.446 ms 2024-09-05T07:54:56.101 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2537 0.13 MB/sec execute 574 sec latency 2683.635 ms 2024-09-05T07:54:57.101 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2538 0.13 MB/sec execute 575 sec latency 3023.604 ms 2024-09-05T07:54:58.101 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2549 0.14 MB/sec execute 576 sec latency 3192.011 ms 2024-09-05T07:54:59.101 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2555 0.14 MB/sec execute 577 sec latency 3366.981 ms 2024-09-05T07:55:00.101 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2561 0.14 MB/sec execute 578 sec latency 3357.484 ms 2024-09-05T07:55:01.101 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2562 0.14 MB/sec execute 579 sec latency 3204.265 ms 2024-09-05T07:55:02.101 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2568 0.14 MB/sec execute 580 sec latency 2935.043 ms 2024-09-05T07:55:03.101 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2570 0.14 MB/sec execute 581 sec latency 2922.655 ms 2024-09-05T07:55:04.101 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2572 0.13 MB/sec execute 582 sec latency 2938.308 ms 2024-09-05T07:55:05.101 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2574 0.13 MB/sec execute 583 sec latency 2814.516 ms 2024-09-05T07:55:06.101 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2576 0.13 MB/sec execute 584 sec latency 3227.630 ms 2024-09-05T07:55:07.101 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2578 0.13 MB/sec execute 585 sec latency 3427.054 ms 2024-09-05T07:55:08.101 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2578 0.13 MB/sec execute 586 sec latency 3616.705 ms 2024-09-05T07:55:09.101 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2580 0.13 MB/sec execute 587 sec latency 3787.278 ms 2024-09-05T07:55:10.101 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2583 0.13 MB/sec execute 588 sec latency 3467.764 ms 2024-09-05T07:55:10.732 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:55:10.735 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:55:11.101 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2586 0.13 MB/sec execute 589 sec latency 2918.180 ms 2024-09-05T07:55:12.102 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2588 0.13 MB/sec execute 590 sec latency 3626.880 ms 2024-09-05T07:55:13.101 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2591 0.13 MB/sec execute 591 sec latency 3330.821 ms 2024-09-05T07:55:14.102 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2593 0.13 MB/sec execute 592 sec latency 3378.258 ms 2024-09-05T07:55:15.102 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2595 0.13 MB/sec execute 593 sec latency 3308.425 ms 2024-09-05T07:55:16.102 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2597 0.13 MB/sec execute 594 sec latency 3024.199 ms 2024-09-05T07:55:17.102 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2598 0.13 MB/sec execute 595 sec latency 3045.280 ms 2024-09-05T07:55:18.102 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2598 0.13 MB/sec execute 596 sec latency 3303.520 ms 2024-09-05T07:55:19.102 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2609 0.14 MB/sec execute 597 sec latency 3303.775 ms 2024-09-05T07:55:20.102 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2620 0.14 MB/sec execute 598 sec latency 3538.305 ms 2024-09-05T07:55:21.102 INFO:tasks.workunit.client.0.smithi017.stdout: 10 2622 0.14 MB/sec execute 599 sec latency 2913.794 ms 2024-09-05T07:55:22.102 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 600 sec 2024-09-05T07:55:23.102 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 601 sec 2024-09-05T07:55:24.102 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 602 sec 2024-09-05T07:55:25.102 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 603 sec 2024-09-05T07:55:26.102 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 604 sec 2024-09-05T07:55:27.102 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 605 sec 2024-09-05T07:55:28.102 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 606 sec 2024-09-05T07:55:29.102 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 607 sec 2024-09-05T07:55:30.102 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 608 sec 2024-09-05T07:55:31.102 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 609 sec 2024-09-05T07:55:32.102 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 610 sec 2024-09-05T07:55:33.102 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 611 sec 2024-09-05T07:55:34.111 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 612 sec 2024-09-05T07:55:35.103 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 613 sec 2024-09-05T07:55:36.103 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 614 sec 2024-09-05T07:55:37.103 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 615 sec 2024-09-05T07:55:38.103 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 616 sec 2024-09-05T07:55:39.103 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 617 sec 2024-09-05T07:55:40.103 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 618 sec 2024-09-05T07:55:40.803 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:55:40.806 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:55:41.103 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 619 sec 2024-09-05T07:55:42.103 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 620 sec 2024-09-05T07:55:43.103 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 621 sec 2024-09-05T07:55:44.103 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 622 sec 2024-09-05T07:55:45.103 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 623 sec 2024-09-05T07:55:46.103 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 624 sec 2024-09-05T07:55:47.103 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 625 sec 2024-09-05T07:55:48.103 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 626 sec 2024-09-05T07:55:49.103 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 627 sec 2024-09-05T07:55:50.104 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 628 sec 2024-09-05T07:55:51.104 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 629 sec 2024-09-05T07:55:52.104 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 630 sec 2024-09-05T07:55:53.104 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 631 sec 2024-09-05T07:55:54.104 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 632 sec 2024-09-05T07:55:55.104 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 633 sec 2024-09-05T07:55:56.104 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 634 sec 2024-09-05T07:55:57.104 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 635 sec 2024-09-05T07:55:58.104 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 636 sec 2024-09-05T07:55:59.104 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 637 sec 2024-09-05T07:56:00.104 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 638 sec 2024-09-05T07:56:01.104 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 639 sec 2024-09-05T07:56:02.104 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 640 sec 2024-09-05T07:56:03.104 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 641 sec 2024-09-05T07:56:04.104 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 642 sec 2024-09-05T07:56:05.114 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 643 sec 2024-09-05T07:56:06.105 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 644 sec 2024-09-05T07:56:07.105 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 645 sec 2024-09-05T07:56:08.105 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 646 sec 2024-09-05T07:56:09.105 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 647 sec 2024-09-05T07:56:10.105 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 648 sec 2024-09-05T07:56:10.875 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:56:10.877 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:56:11.105 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 649 sec 2024-09-05T07:56:12.105 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 650 sec 2024-09-05T07:56:13.105 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 651 sec 2024-09-05T07:56:14.105 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 652 sec 2024-09-05T07:56:15.105 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 653 sec 2024-09-05T07:56:16.105 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 654 sec 2024-09-05T07:56:17.105 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 655 sec 2024-09-05T07:56:18.105 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 656 sec 2024-09-05T07:56:19.106 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 657 sec 2024-09-05T07:56:20.105 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 658 sec 2024-09-05T07:56:21.106 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 659 sec 2024-09-05T07:56:22.106 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 660 sec 2024-09-05T07:56:23.106 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 661 sec 2024-09-05T07:56:24.106 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 662 sec 2024-09-05T07:56:25.106 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 663 sec 2024-09-05T07:56:26.106 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 664 sec 2024-09-05T07:56:27.106 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 665 sec 2024-09-05T07:56:28.106 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 666 sec 2024-09-05T07:56:29.106 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 667 sec 2024-09-05T07:56:30.106 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 668 sec 2024-09-05T07:56:31.106 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 669 sec 2024-09-05T07:56:32.106 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 670 sec 2024-09-05T07:56:33.106 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 671 sec 2024-09-05T07:56:34.106 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 672 sec 2024-09-05T07:56:35.106 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 673 sec 2024-09-05T07:56:36.111 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 674 sec 2024-09-05T07:56:37.107 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 675 sec 2024-09-05T07:56:38.107 INFO:tasks.workunit.client.0.smithi017.stdout: 8 cleanup 676 sec 2024-09-05T07:56:39.107 INFO:tasks.workunit.client.0.smithi017.stdout: 7 cleanup 677 sec 2024-09-05T07:56:40.107 INFO:tasks.workunit.client.0.smithi017.stdout: 7 cleanup 678 sec 2024-09-05T07:56:40.939 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:56:40.942 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:56:41.107 INFO:tasks.workunit.client.0.smithi017.stdout: 6 cleanup 679 sec 2024-09-05T07:56:42.108 INFO:tasks.workunit.client.0.smithi017.stdout: 6 cleanup 680 sec 2024-09-05T07:56:43.107 INFO:tasks.workunit.client.0.smithi017.stdout: 1 cleanup 681 sec 2024-09-05T07:56:43.570 INFO:tasks.workunit.client.0.smithi017.stdout: 0 cleanup 681 sec 2024-09-05T07:56:43.570 INFO:tasks.workunit.client.0.smithi017.stdout: 2024-09-05T07:56:43.570 INFO:tasks.workunit.client.0.smithi017.stdout: Operation Count AvgLat MaxLat 2024-09-05T07:56:43.570 INFO:tasks.workunit.client.0.smithi017.stdout: ---------------------------------------- 2024-09-05T07:56:43.570 INFO:tasks.workunit.client.0.smithi017.stdout: NTCreateX 3472 315.986 2257.011 2024-09-05T07:56:43.570 INFO:tasks.workunit.client.0.smithi017.stdout: Close 2973 3.262 54.505 2024-09-05T07:56:43.570 INFO:tasks.workunit.client.0.smithi017.stdout: Rename 168 1001.958 1777.636 2024-09-05T07:56:43.570 INFO:tasks.workunit.client.0.smithi017.stdout: Unlink 385 308.495 912.446 2024-09-05T07:56:43.570 INFO:tasks.workunit.client.0.smithi017.stdout: Qpathinfo 3437 209.102 1714.159 2024-09-05T07:56:43.571 INFO:tasks.workunit.client.0.smithi017.stdout: Qfileinfo 650 6.038 44.204 2024-09-05T07:56:43.571 INFO:tasks.workunit.client.0.smithi017.stdout: Qfsinfo 390 19.205 103.867 2024-09-05T07:56:43.571 INFO:tasks.workunit.client.0.smithi017.stdout: Sfileinfo 478 43.006 169.547 2024-09-05T07:56:43.571 INFO:tasks.workunit.client.0.smithi017.stdout: Find 1149 3250.851 5860.199 2024-09-05T07:56:43.571 INFO:tasks.workunit.client.0.smithi017.stdout: WriteX 1995 14.928 901.909 2024-09-05T07:56:43.571 INFO:tasks.workunit.client.0.smithi017.stdout: ReadX 4254 0.117 19.710 2024-09-05T07:56:43.571 INFO:tasks.workunit.client.0.smithi017.stdout: Flush 333 342.872 1118.828 2024-09-05T07:56:43.571 INFO:tasks.workunit.client.0.smithi017.stdout: 2024-09-05T07:56:43.571 INFO:tasks.workunit.client.0.smithi017.stdout:Throughput 0.141924 MB/sec 10 clients 10 procs max_latency=5860.205 ms 2024-09-05T07:56:43.571 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-05T07:56:43.572 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-05T07:56:53.393 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:28:11.133 36173== Warning: unimplemented fcntl command: 1036 2024-09-05T07:56:53.396 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:28:11.136 36173== Warning: unimplemented fcntl command: 1036 2024-09-05T07:56:53.404 INFO:tasks.ceph.mon.c.smithi026.stderr:==00:00:28:11.112 36186== Warning: unimplemented fcntl command: 1036 2024-09-05T07:56:53.407 INFO:tasks.ceph.mon.c.smithi026.stderr:==00:00:28:11.115 36186== Warning: unimplemented fcntl command: 1036 2024-09-05T07:56:53.407 INFO:tasks.ceph.mon.b.smithi026.stderr:==00:00:28:11.115 36185== Warning: unimplemented fcntl command: 1036 2024-09-05T07:56:53.409 INFO:tasks.ceph.mon.b.smithi026.stderr:==00:00:28:11.118 36185== Warning: unimplemented fcntl command: 1036 2024-09-05T07:56:53.456 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:28:11.196 36173== Warning: unimplemented fcntl command: 1036 2024-09-05T07:56:53.470 INFO:tasks.ceph.mon.c.smithi026.stderr:==00:00:28:11.178 36186== Warning: unimplemented fcntl command: 1036 2024-09-05T07:56:53.479 INFO:tasks.ceph.mon.b.smithi026.stderr:==00:00:28:11.187 36185== Warning: unimplemented fcntl command: 1036 2024-09-05T07:57:07.778 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2024-09-05T07:57:07.779 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-05T07:57:08.086 DEBUG:teuthology.parallel:result is None 2024-09-05T07:57:08.086 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-05T07:57:08.344 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-05T07:57:08.345 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-05T07:57:08.491 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-05T07:57:08.492 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-05T07:57:08.492 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-05T07:57:08.509 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-05T07:57:08.510 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-05T07:57:08.566 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-05T07:57:08.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.707+0000 7f3260a53640 1 Processor -- start 2024-09-05T07:57:08.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.707+0000 7f3260a53640 1 -- start start 2024-09-05T07:57:08.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.708+0000 7f3260a53640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f325c0cd2d0 0x7f325c157800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:08.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.708+0000 7f3260a53640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f325c0b3b20 con 0x7f325c0ccef0 2024-09-05T07:57:08.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.708+0000 7f3260a53640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f325c15b590 con 0x7f325c157d40 2024-09-05T07:57:08.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.708+0000 7f3260a53640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f325c0b2d60 con 0x7f325c0cd2d0 2024-09-05T07:57:08.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.709+0000 7f325ad9d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f325c157d40 0x7f325c15a820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.17:57992/0 (socket says 172.21.15.17:57992) 2024-09-05T07:57:08.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.710+0000 7f325ad9d640 1 -- 172.21.15.17:0/2507617385 learned_addr learned my addr 172.21.15.17:0/2507617385 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:57:08.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.710+0000 7f3259d9b640 1 --2- 172.21.15.17:0/2507617385 >> v2:172.21.15.26:3300/0 conn(0x7f325c0cd2d0 0x7f325c157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:08.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.713+0000 7f3259d9b640 1 -- 172.21.15.17:0/2507617385 >> v1:172.21.15.26:6789/0 conn(0x7f325c157d40 legacy=0x7f325c15a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:08.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.713+0000 7f3259d9b640 1 -- 172.21.15.17:0/2507617385 >> v1:172.21.15.17:6789/0 conn(0x7f325c0ccef0 legacy=0x7f325c0b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:08.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.713+0000 7f3259d9b640 1 -- 172.21.15.17:0/2507617385 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f325c0b3040 con 0x7f325c0cd2d0 2024-09-05T07:57:08.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.717+0000 7f3259d9b640 1 --2- 172.21.15.17:0/2507617385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f325c0cd2d0 0x7f325c157800 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f32500097d0 tx=0x7f325002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=851fd0c3c308b71b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:08.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.727+0000 7f325959a640 1 -- 172.21.15.17:0/2507617385 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3250037070 con 0x7f325c0cd2d0 2024-09-05T07:57:08.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.727+0000 7f325959a640 1 -- 172.21.15.17:0/2507617385 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3250032440 con 0x7f325c0cd2d0 2024-09-05T07:57:08.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.727+0000 7f325959a640 1 -- 172.21.15.17:0/2507617385 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3250032810 con 0x7f325c0cd2d0 2024-09-05T07:57:08.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.727+0000 7f3260a53640 1 -- 172.21.15.17:0/2507617385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f325c0cd2d0 msgr2=0x7f325c157800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:08.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.727+0000 7f3260a53640 1 --2- 172.21.15.17:0/2507617385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f325c0cd2d0 0x7f325c157800 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f32500097d0 tx=0x7f325002a270 comp rx=0 tx=0).stop 2024-09-05T07:57:08.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.727+0000 7f3260a53640 1 -- 172.21.15.17:0/2507617385 shutdown_connections 2024-09-05T07:57:08.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.727+0000 7f3260a53640 1 --2- 172.21.15.17:0/2507617385 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f325c0cd2d0 0x7f325c157800 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:08.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.727+0000 7f3260a53640 1 -- 172.21.15.17:0/2507617385 >> 172.21.15.17:0/2507617385 conn(0x7f325c072230 msgr2=0x7f325c072640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:08.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.727+0000 7f3260a53640 1 -- 172.21.15.17:0/2507617385 shutdown_connections 2024-09-05T07:57:08.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.727+0000 7f3260a53640 1 -- 172.21.15.17:0/2507617385 wait complete. 2024-09-05T07:57:08.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.729+0000 7f3260a53640 1 Processor -- start 2024-09-05T07:57:08.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.729+0000 7f3260a53640 1 -- start start 2024-09-05T07:57:08.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.730+0000 7f3260a53640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f325c0ccef0 0x7f325c0d04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:08.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.730+0000 7f3260a53640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f325c0cd2d0 0x7f325c0c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:08.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.730+0000 7f3260a53640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f325c157d40 0x7f325c0c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:08.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.730+0000 7f3260a53640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f325c0b4580 con 0x7f325c0ccef0 2024-09-05T07:57:08.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.730+0000 7f3260a53640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f325c0b3600 con 0x7f325c157d40 2024-09-05T07:57:08.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.730+0000 7f3260a53640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f325c1581d0 con 0x7f325c0cd2d0 2024-09-05T07:57:08.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.730+0000 7f325ad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f325c157d40 0x7f325c0c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:08.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.730+0000 7f3259d9b640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f325c0cd2d0 0x7f325c0c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:08.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.731+0000 7f325ad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f325c157d40 0x7f325c0c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:47748/0 (socket says 172.21.15.17:47748) 2024-09-05T07:57:08.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.731+0000 7f325ad9d640 1 -- 172.21.15.17:0/3438464386 learned_addr learned my addr 172.21.15.17:0/3438464386 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:08.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.731+0000 7f325a59c640 1 --2- 172.21.15.17:0/3438464386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f325c0ccef0 0x7f325c0d04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:08.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.734+0000 7f3259d9b640 1 -- 172.21.15.17:0/3438464386 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f325c157d40 msgr2=0x7f325c0c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:08.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.734+0000 7f3259d9b640 1 --2- 172.21.15.17:0/3438464386 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f325c157d40 0x7f325c0c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:08.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.734+0000 7f3259d9b640 1 -- 172.21.15.17:0/3438464386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f325c0ccef0 msgr2=0x7f325c0d04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:08.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.734+0000 7f3259d9b640 1 --2- 172.21.15.17:0/3438464386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f325c0ccef0 0x7f325c0d04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:08.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.734+0000 7f3259d9b640 1 -- 172.21.15.17:0/3438464386 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f325c158950 con 0x7f325c0cd2d0 2024-09-05T07:57:08.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.737+0000 7f3259d9b640 1 --2- 172.21.15.17:0/3438464386 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f325c0cd2d0 0x7f325c0c77b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3250031000 tx=0x7f32500046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:08.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.741+0000 7f324affd640 1 -- 172.21.15.17:0/3438464386 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3250040020 con 0x7f325c0cd2d0 2024-09-05T07:57:08.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.741+0000 7f324affd640 1 -- 172.21.15.17:0/3438464386 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3250038040 con 0x7f325c0cd2d0 2024-09-05T07:57:08.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.741+0000 7f324affd640 1 -- 172.21.15.17:0/3438464386 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3250037070 con 0x7f325c0cd2d0 2024-09-05T07:57:08.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.741+0000 7f3260a53640 1 -- 172.21.15.17:0/3438464386 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f325c1f39b0 con 0x7f325c0cd2d0 2024-09-05T07:57:08.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.741+0000 7f3260a53640 1 -- 172.21.15.17:0/3438464386 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f325c1f3f70 con 0x7f325c0cd2d0 2024-09-05T07:57:08.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:08.742+0000 7f3260a53640 1 -- 172.21.15.17:0/3438464386 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f325c15dee0 con 0x7f325c0cd2d0 2024-09-05T07:57:09.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.017+0000 7f324affd640 1 -- 172.21.15.17:0/3438464386 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3250043020 con 0x7f325c0cd2d0 2024-09-05T07:57:09.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.017+0000 7f324affd640 1 --2- 172.21.15.17:0/3438464386 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f323c06be80 0x7f323c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:09.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.017+0000 7f325a59c640 1 --2- 172.21.15.17:0/3438464386 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f323c06be80 0x7f323c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:09.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.018+0000 7f325a59c640 1 --2- 172.21.15.17:0/3438464386 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f323c06be80 0x7f323c06e340 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f324c0016e0 tx=0x7f324c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:09.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.020+0000 7f324affd640 1 -- 172.21.15.17:0/3438464386 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f3250077b90 con 0x7f325c0cd2d0 2024-09-05T07:57:09.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.032+0000 7f324affd640 1 -- 172.21.15.17:0/3438464386 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f325004a030 con 0x7f325c0cd2d0 2024-09-05T07:57:09.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.217+0000 7f3260a53640 1 -- 172.21.15.17:0/3438464386 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f325c15e710 con 0x7f325c0cd2d0 2024-09-05T07:57:09.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.222+0000 7f324affd640 1 -- 172.21.15.17:0/3438464386 <== mon.2 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f3250079af0 con 0x7f325c0cd2d0 2024-09-05T07:57:09.223 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-09-05T07:57:09.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.224+0000 7f3260a53640 1 -- 172.21.15.17:0/3438464386 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f323c06be80 msgr2=0x7f323c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:09.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.224+0000 7f3260a53640 1 --2- 172.21.15.17:0/3438464386 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f323c06be80 0x7f323c06e340 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f324c0016e0 tx=0x7f324c009040 comp rx=0 tx=0).stop 2024-09-05T07:57:09.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.224+0000 7f3260a53640 1 -- 172.21.15.17:0/3438464386 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f325c0cd2d0 msgr2=0x7f325c0c77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:09.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.224+0000 7f3260a53640 1 --2- 172.21.15.17:0/3438464386 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f325c0cd2d0 0x7f325c0c77b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3250031000 tx=0x7f32500046c0 comp rx=0 tx=0).stop 2024-09-05T07:57:09.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.224+0000 7f3260a53640 1 -- 172.21.15.17:0/3438464386 shutdown_connections 2024-09-05T07:57:09.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.224+0000 7f3260a53640 1 --2- 172.21.15.17:0/3438464386 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f323c06be80 0x7f323c06e340 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:09.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.224+0000 7f3260a53640 1 --2- 172.21.15.17:0/3438464386 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f325c0cd2d0 0x7f325c0c77b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:09.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.224+0000 7f3260a53640 1 --2- 172.21.15.17:0/3438464386 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f325c157d40 0x7f325c0c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:09.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.224+0000 7f3260a53640 1 --2- 172.21.15.17:0/3438464386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f325c0ccef0 0x7f325c0d04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:09.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.224+0000 7f3260a53640 1 -- 172.21.15.17:0/3438464386 >> 172.21.15.17:0/3438464386 conn(0x7f325c072230 msgr2=0x7f325c072610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:09.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.224+0000 7f3260a53640 1 -- 172.21.15.17:0/3438464386 shutdown_connections 2024-09-05T07:57:09.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.224+0000 7f3260a53640 1 -- 172.21.15.17:0/3438464386 wait complete. 2024-09-05T07:57:09.236 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-05T07:57:09.236 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-05T07:57:09.251 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-05T07:57:09.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.395+0000 7f549e9d6640 1 Processor -- start 2024-09-05T07:57:09.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.395+0000 7f549e9d6640 1 -- start start 2024-09-05T07:57:09.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.395+0000 7f549e9d6640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5498154be0 0x7f54980c9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:09.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.395+0000 7f549e9d6640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f549815b310 0x7f5498165140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:09.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.395+0000 7f549e9d6640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54980c3890 con 0x7f549815aef0 2024-09-05T07:57:09.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.395+0000 7f549e9d6640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f54980c3b70 con 0x7f549815b310 2024-09-05T07:57:09.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.395+0000 7f549e9d6640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f54980c3e50 con 0x7f5498154be0 2024-09-05T07:57:09.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.396+0000 7f549cf73640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f549815b310 0x7f5498165140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:09.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.396+0000 7f549cf73640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f549815b310 0x7f5498165140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39376/0 (socket says 172.21.15.17:39376) 2024-09-05T07:57:09.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.396+0000 7f549cf73640 1 -- 172.21.15.17:0/3300657756 learned_addr learned my addr 172.21.15.17:0/3300657756 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:09.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.399+0000 7f549cf73640 1 -- 172.21.15.17:0/3300657756 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5498154be0 msgr2=0x7f54980c9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:57:09.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.399+0000 7f549cf73640 1 --2- 172.21.15.17:0/3300657756 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5498154be0 0x7f54980c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:09.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.399+0000 7f549cf73640 1 -- 172.21.15.17:0/3300657756 >> v1:172.21.15.26:6789/0 conn(0x7f549815aef0 legacy=0x7f54980caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:57:09.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.399+0000 7f549cf73640 1 -- 172.21.15.17:0/3300657756 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54980c4130 con 0x7f549815b310 2024-09-05T07:57:09.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.401+0000 7f549cf73640 1 --2- 172.21.15.17:0/3300657756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f549815b310 0x7f5498165140 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5490009e50 tx=0x7f549002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e5bcaf69f6625ba server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:09.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.407+0000 7f54977fe640 1 -- 172.21.15.17:0/3300657756 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5490036070 con 0x7f549815b310 2024-09-05T07:57:09.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.407+0000 7f54977fe640 1 -- 172.21.15.17:0/3300657756 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5490031600 con 0x7f549815b310 2024-09-05T07:57:09.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.407+0000 7f54977fe640 1 -- 172.21.15.17:0/3300657756 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54900319d0 con 0x7f549815b310 2024-09-05T07:57:09.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.408+0000 7f549e9d6640 1 -- 172.21.15.17:0/3300657756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f549815b310 msgr2=0x7f5498165140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:09.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.408+0000 7f549e9d6640 1 --2- 172.21.15.17:0/3300657756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f549815b310 0x7f5498165140 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5490009e50 tx=0x7f549002a6c0 comp rx=0 tx=0).stop 2024-09-05T07:57:09.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.408+0000 7f549e9d6640 1 -- 172.21.15.17:0/3300657756 shutdown_connections 2024-09-05T07:57:09.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.408+0000 7f549e9d6640 1 --2- 172.21.15.17:0/3300657756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f549815b310 0x7f5498165140 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:09.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.408+0000 7f549e9d6640 1 --2- 172.21.15.17:0/3300657756 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5498154be0 0x7f54980c9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:09.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.408+0000 7f549e9d6640 1 -- 172.21.15.17:0/3300657756 >> 172.21.15.17:0/3300657756 conn(0x7f5498071670 msgr2=0x7f5498071a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:09.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.408+0000 7f549e9d6640 1 -- 172.21.15.17:0/3300657756 shutdown_connections 2024-09-05T07:57:09.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.408+0000 7f549e9d6640 1 -- 172.21.15.17:0/3300657756 wait complete. 2024-09-05T07:57:09.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.409+0000 7f549e9d6640 1 Processor -- start 2024-09-05T07:57:09.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.409+0000 7f549e9d6640 1 -- start start 2024-09-05T07:57:09.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.410+0000 7f549e9d6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5498154be0 0x7f54980b0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:09.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.410+0000 7f549e9d6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f549815aef0 0x7f5498156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:09.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.410+0000 7f549e9d6640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f549815b310 0x7f5498156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:09.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.410+0000 7f549e9d6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f549815dd60 con 0x7f549815aef0 2024-09-05T07:57:09.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.410+0000 7f549e9d6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f54980c9fe0 con 0x7f5498154be0 2024-09-05T07:57:09.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.410+0000 7f549e9d6640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f54980c9c60 con 0x7f549815b310 2024-09-05T07:57:09.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.410+0000 7f5497fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5498154be0 0x7f54980b0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:09.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.410+0000 7f549cf73640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f549815b310 0x7f5498156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:09.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.411+0000 7f548ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f549815aef0 0x7f5498156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:09.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.411+0000 7f5497fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5498154be0 0x7f54980b0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:44616/0 (socket says 172.21.15.17:44616) 2024-09-05T07:57:09.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.411+0000 7f5497fff640 1 -- 172.21.15.17:0/4007756017 learned_addr learned my addr 172.21.15.17:0/4007756017 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:09.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.411+0000 7f549cf73640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f549815b310 0x7f5498156650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:50946/0 (socket says 172.21.15.17:50946) 2024-09-05T07:57:09.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.414+0000 7f549cf73640 1 -- 172.21.15.17:0/4007756017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5498154be0 msgr2=0x7f54980b0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:09.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.414+0000 7f549cf73640 1 --2- 172.21.15.17:0/4007756017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5498154be0 0x7f54980b0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:09.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.414+0000 7f549cf73640 1 -- 172.21.15.17:0/4007756017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f549815aef0 msgr2=0x7f5498156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:09.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.414+0000 7f549cf73640 1 --2- 172.21.15.17:0/4007756017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f549815aef0 0x7f5498156110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:09.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.414+0000 7f549cf73640 1 -- 172.21.15.17:0/4007756017 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5498157230 con 0x7f549815b310 2024-09-05T07:57:09.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.417+0000 7f549cf73640 1 --2- 172.21.15.17:0/4007756017 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f549815b310 0x7f5498156650 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5490030000 tx=0x7f5490004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:09.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.421+0000 7f54957fa640 1 -- 172.21.15.17:0/4007756017 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5490041020 con 0x7f549815b310 2024-09-05T07:57:09.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.421+0000 7f54957fa640 1 -- 172.21.15.17:0/4007756017 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5490037040 con 0x7f549815b310 2024-09-05T07:57:09.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.421+0000 7f54957fa640 1 -- 172.21.15.17:0/4007756017 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5490036070 con 0x7f549815b310 2024-09-05T07:57:09.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.421+0000 7f549e9d6640 1 -- 172.21.15.17:0/4007756017 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54981574d0 con 0x7f549815b310 2024-09-05T07:57:09.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.421+0000 7f549e9d6640 1 -- 172.21.15.17:0/4007756017 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5498157e50 con 0x7f549815b310 2024-09-05T07:57:09.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.422+0000 7f549e9d6640 1 -- 172.21.15.17:0/4007756017 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54980c3530 con 0x7f549815b310 2024-09-05T07:57:09.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.442+0000 7f54957fa640 1 -- 172.21.15.17:0/4007756017 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5490044020 con 0x7f549815b310 2024-09-05T07:57:09.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.442+0000 7f54957fa640 1 --2- 172.21.15.17:0/4007756017 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f547806beb0 0x7f547806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:09.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.443+0000 7f5497fff640 1 --2- 172.21.15.17:0/4007756017 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f547806beb0 0x7f547806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:09.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.443+0000 7f5497fff640 1 --2- 172.21.15.17:0/4007756017 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f547806beb0 0x7f547806e370 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f54880099a0 tx=0x7f5488006f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:09.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.445+0000 7f54957fa640 1 -- 172.21.15.17:0/4007756017 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f5490078200 con 0x7f549815b310 2024-09-05T07:57:09.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.717+0000 7f54957fa640 1 -- 172.21.15.17:0/4007756017 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f549004b030 con 0x7f549815b310 2024-09-05T07:57:09.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.907+0000 7f549e9d6640 1 -- 172.21.15.17:0/4007756017 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f54980ca740 con 0x7f549815b310 2024-09-05T07:57:09.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.912+0000 7f54957fa640 1 -- 172.21.15.17:0/4007756017 <== mon.2 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f549007a160 con 0x7f549815b310 2024-09-05T07:57:09.913 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-09-05T07:57:09.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.915+0000 7f549e9d6640 1 -- 172.21.15.17:0/4007756017 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f547806beb0 msgr2=0x7f547806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:09.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.915+0000 7f549e9d6640 1 --2- 172.21.15.17:0/4007756017 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f547806beb0 0x7f547806e370 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f54880099a0 tx=0x7f5488006f90 comp rx=0 tx=0).stop 2024-09-05T07:57:09.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.915+0000 7f549e9d6640 1 -- 172.21.15.17:0/4007756017 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f549815b310 msgr2=0x7f5498156650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:09.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.915+0000 7f549e9d6640 1 --2- 172.21.15.17:0/4007756017 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f549815b310 0x7f5498156650 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5490030000 tx=0x7f5490004a40 comp rx=0 tx=0).stop 2024-09-05T07:57:09.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.915+0000 7f549e9d6640 1 -- 172.21.15.17:0/4007756017 shutdown_connections 2024-09-05T07:57:09.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.915+0000 7f549e9d6640 1 --2- 172.21.15.17:0/4007756017 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f547806beb0 0x7f547806e370 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:09.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.915+0000 7f549e9d6640 1 --2- 172.21.15.17:0/4007756017 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f549815b310 0x7f5498156650 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:09.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.915+0000 7f549e9d6640 1 --2- 172.21.15.17:0/4007756017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f549815aef0 0x7f5498156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:09.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.915+0000 7f549e9d6640 1 --2- 172.21.15.17:0/4007756017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5498154be0 0x7f54980b0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:09.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.915+0000 7f549e9d6640 1 -- 172.21.15.17:0/4007756017 >> 172.21.15.17:0/4007756017 conn(0x7f5498071670 msgr2=0x7f54980af440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:09.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.915+0000 7f549e9d6640 1 -- 172.21.15.17:0/4007756017 shutdown_connections 2024-09-05T07:57:09.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:09.915+0000 7f549e9d6640 1 -- 172.21.15.17:0/4007756017 wait complete. 2024-09-05T07:57:09.927 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi017.front.sepia.ceph.com... 2024-09-05T07:57:09.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:57:09.927 DEBUG:teuthology.orchestra.run.smithi017:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-05T07:57:09.952 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T07:57:09.976 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[44638]: fuse finished with error 0 and tester_r 0 2024-09-05T07:57:10.995 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:57:10.998 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:57:16.054 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2024-09-05T07:57:16.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:57:16.055 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-05T07:57:16.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:57:16.089 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-05T07:57:16.149 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-05T07:57:16.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:57:16.149 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-05T07:57:16.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T07:57:16.219 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2024-09-05T07:57:16.316 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-05T07:57:16.327 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-05T07:57:16.327 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T07:57:16.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.432+0000 7f3e23ad2640 1 Processor -- start 2024-09-05T07:57:16.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.432+0000 7f3e23ad2640 1 -- start start 2024-09-05T07:57:16.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.433+0000 7f3e23ad2640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e1c06e4d0 0x7f3e1c0c9540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:16.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.433+0000 7f3e23ad2640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3e1c0c6b60 0x7f3e1c0cca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:16.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.433+0000 7f3e23ad2640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e1c0c9b80 con 0x7f3e1c152470 2024-09-05T07:57:16.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.433+0000 7f3e23ad2640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f3e1c0ccfd0 con 0x7f3e1c0c6b60 2024-09-05T07:57:16.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.433+0000 7f3e23ad2640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f3e1c0c86b0 con 0x7f3e1c06e4d0 2024-09-05T07:57:16.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.433+0000 7f3e2206f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3e1c0c6b60 0x7f3e1c0cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:16.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.434+0000 7f3e2206f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3e1c0c6b60 0x7f3e1c0cca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39390/0 (socket says 172.21.15.17:39390) 2024-09-05T07:57:16.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.434+0000 7f3e2206f640 1 -- 172.21.15.17:0/2068178283 learned_addr learned my addr 172.21.15.17:0/2068178283 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:16.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.437+0000 7f3e2206f640 1 -- 172.21.15.17:0/2068178283 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e1c06e4d0 msgr2=0x7f3e1c0c9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:57:16.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.437+0000 7f3e2206f640 1 --2- 172.21.15.17:0/2068178283 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e1c06e4d0 0x7f3e1c0c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:16.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.437+0000 7f3e2206f640 1 -- 172.21.15.17:0/2068178283 >> v1:172.21.15.17:6789/0 conn(0x7f3e1c152470 legacy=0x7f3e1c0c5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:16.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.437+0000 7f3e2206f640 1 -- 172.21.15.17:0/2068178283 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1c0c8990 con 0x7f3e1c0c6b60 2024-09-05T07:57:16.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.440+0000 7f3e2206f640 1 --2- 172.21.15.17:0/2068178283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e1c0c6b60 0x7f3e1c0cca90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3e14009e50 tx=0x7f3e1402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06f0f1db4da2f60 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:16.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.444+0000 7f3e2086c640 1 -- 172.21.15.17:0/2068178283 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e14036070 con 0x7f3e1c0c6b60 2024-09-05T07:57:16.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.444+0000 7f3e2086c640 1 -- 172.21.15.17:0/2068178283 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e14031600 con 0x7f3e1c0c6b60 2024-09-05T07:57:16.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.444+0000 7f3e2086c640 1 -- 172.21.15.17:0/2068178283 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e140319d0 con 0x7f3e1c0c6b60 2024-09-05T07:57:16.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.444+0000 7f3e23ad2640 1 -- 172.21.15.17:0/2068178283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e1c0c6b60 msgr2=0x7f3e1c0cca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:16.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.444+0000 7f3e23ad2640 1 --2- 172.21.15.17:0/2068178283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e1c0c6b60 0x7f3e1c0cca90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3e14009e50 tx=0x7f3e1402a680 comp rx=0 tx=0).stop 2024-09-05T07:57:16.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.444+0000 7f3e23ad2640 1 -- 172.21.15.17:0/2068178283 shutdown_connections 2024-09-05T07:57:16.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.444+0000 7f3e23ad2640 1 --2- 172.21.15.17:0/2068178283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e1c0c6b60 0x7f3e1c0cca90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:16.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.444+0000 7f3e23ad2640 1 --2- 172.21.15.17:0/2068178283 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e1c06e4d0 0x7f3e1c0c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:16.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.444+0000 7f3e23ad2640 1 -- 172.21.15.17:0/2068178283 >> 172.21.15.17:0/2068178283 conn(0x7f3e1c06f4f0 msgr2=0x7f3e1c06f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:16.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.444+0000 7f3e23ad2640 1 -- 172.21.15.17:0/2068178283 shutdown_connections 2024-09-05T07:57:16.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.444+0000 7f3e23ad2640 1 -- 172.21.15.17:0/2068178283 wait complete. 2024-09-05T07:57:16.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.446+0000 7f3e23ad2640 1 Processor -- start 2024-09-05T07:57:16.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.446+0000 7f3e23ad2640 1 -- start start 2024-09-05T07:57:16.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.447+0000 7f3e23ad2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e1c06e4d0 0x7f3e1c1e0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:16.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.447+0000 7f3e23ad2640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e1c0c6b60 0x7f3e1c1e1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:16.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.447+0000 7f3e23ad2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e1c152470 0x7f3e1c1e1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:16.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.447+0000 7f3e23ad2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c0c5f80 con 0x7f3e1c06e4d0 2024-09-05T07:57:16.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.447+0000 7f3e23ad2640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c0cc570 con 0x7f3e1c152470 2024-09-05T07:57:16.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.447+0000 7f3e23ad2640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f3e1c0c6100 con 0x7f3e1c0c6b60 2024-09-05T07:57:16.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.447+0000 7f3e2186e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e1c06e4d0 0x7f3e1c1e0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:16.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.447+0000 7f3e2206f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e1c152470 0x7f3e1c1e1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:16.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.448+0000 7f3e2186e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e1c06e4d0 0x7f3e1c1e0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39402/0 (socket says 172.21.15.17:39402) 2024-09-05T07:57:16.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.448+0000 7f3e2186e640 1 -- 172.21.15.17:0/653932614 learned_addr learned my addr 172.21.15.17:0/653932614 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:16.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.448+0000 7f3e2106d640 1 --2- 172.21.15.17:0/653932614 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e1c0c6b60 0x7f3e1c1e1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:16.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.451+0000 7f3e2186e640 1 -- 172.21.15.17:0/653932614 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e1c0c6b60 msgr2=0x7f3e1c1e1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:16.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.451+0000 7f3e2186e640 1 --2- 172.21.15.17:0/653932614 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e1c0c6b60 0x7f3e1c1e1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:16.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.451+0000 7f3e2186e640 1 -- 172.21.15.17:0/653932614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e1c152470 msgr2=0x7f3e1c1e1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:16.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.451+0000 7f3e2186e640 1 --2- 172.21.15.17:0/653932614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e1c152470 0x7f3e1c1e1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:16.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.451+0000 7f3e2186e640 1 -- 172.21.15.17:0/653932614 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1c14ef50 con 0x7f3e1c06e4d0 2024-09-05T07:57:16.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.454+0000 7f3e2186e640 1 --2- 172.21.15.17:0/653932614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e1c06e4d0 0x7f3e1c1e0450 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3e1800c400 tx=0x7f3e1800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:16.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.474+0000 7f3e127fc640 1 -- 172.21.15.17:0/653932614 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e180052d0 con 0x7f3e1c06e4d0 2024-09-05T07:57:16.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.474+0000 7f3e127fc640 1 -- 172.21.15.17:0/653932614 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e18005490 con 0x7f3e1c06e4d0 2024-09-05T07:57:16.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.474+0000 7f3e127fc640 1 -- 172.21.15.17:0/653932614 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e18007260 con 0x7f3e1c06e4d0 2024-09-05T07:57:16.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.474+0000 7f3e23ad2640 1 -- 172.21.15.17:0/653932614 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e1c1e12d0 con 0x7f3e1c06e4d0 2024-09-05T07:57:16.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.474+0000 7f3e23ad2640 1 -- 172.21.15.17:0/653932614 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e1c0cca90 con 0x7f3e1c06e4d0 2024-09-05T07:57:16.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.475+0000 7f3e23ad2640 1 -- 172.21.15.17:0/653932614 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e1c1f4230 con 0x7f3e1c06e4d0 2024-09-05T07:57:16.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.753+0000 7f3e127fc640 1 -- 172.21.15.17:0/653932614 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3e18007400 con 0x7f3e1c06e4d0 2024-09-05T07:57:16.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.753+0000 7f3e127fc640 1 --2- 172.21.15.17:0/653932614 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f3e0006be80 0x7f3e0006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:16.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.754+0000 7f3e2106d640 1 --2- 172.21.15.17:0/653932614 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f3e0006be80 0x7f3e0006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:16.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.754+0000 7f3e2106d640 1 --2- 172.21.15.17:0/653932614 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f3e0006be80 0x7f3e0006e340 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c0722a0 tx=0x7f3e0c009060 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:16.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.768+0000 7f3e127fc640 1 -- 172.21.15.17:0/653932614 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f3e18056bd0 con 0x7f3e1c06e4d0 2024-09-05T07:57:16.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.769+0000 7f3e127fc640 1 -- 172.21.15.17:0/653932614 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3e18058b30 con 0x7f3e1c06e4d0 2024-09-05T07:57:16.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.940+0000 7f3e23ad2640 1 -- 172.21.15.17:0/653932614 --> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3e1c14ed00 con 0x7f3e0006be80 2024-09-05T07:57:16.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.947+0000 7f3e127fc640 1 -- 172.21.15.17:0/653932614 <== mgr.4099 v2:172.21.15.26:6800/2736912541 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252849 (secure 0 0 0) 0x7f3e1c14ed00 con 0x7f3e0006be80 2024-09-05T07:57:16.951 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:57:16.952 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-05T07:57:16.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.950+0000 7f3e23ad2640 1 -- 172.21.15.17:0/653932614 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f3e0006be80 msgr2=0x7f3e0006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:16.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.950+0000 7f3e23ad2640 1 --2- 172.21.15.17:0/653932614 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f3e0006be80 0x7f3e0006e340 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c0722a0 tx=0x7f3e0c009060 comp rx=0 tx=0).stop 2024-09-05T07:57:16.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.950+0000 7f3e23ad2640 1 -- 172.21.15.17:0/653932614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e1c06e4d0 msgr2=0x7f3e1c1e0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:16.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.950+0000 7f3e23ad2640 1 --2- 172.21.15.17:0/653932614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e1c06e4d0 0x7f3e1c1e0450 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3e1800c400 tx=0x7f3e1800c8c0 comp rx=0 tx=0).stop 2024-09-05T07:57:16.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.950+0000 7f3e23ad2640 1 -- 172.21.15.17:0/653932614 shutdown_connections 2024-09-05T07:57:16.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.950+0000 7f3e23ad2640 1 --2- 172.21.15.17:0/653932614 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f3e0006be80 0x7f3e0006e340 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:16.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.950+0000 7f3e23ad2640 1 --2- 172.21.15.17:0/653932614 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3e1c0c6b60 0x7f3e1c1e1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:16.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.950+0000 7f3e23ad2640 1 --2- 172.21.15.17:0/653932614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e1c152470 0x7f3e1c1e1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:16.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.950+0000 7f3e23ad2640 1 --2- 172.21.15.17:0/653932614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e1c06e4d0 0x7f3e1c1e0450 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:16.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.950+0000 7f3e23ad2640 1 -- 172.21.15.17:0/653932614 >> 172.21.15.17:0/653932614 conn(0x7f3e1c06f4f0 msgr2=0x7f3e1c14c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:16.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.950+0000 7f3e23ad2640 1 -- 172.21.15.17:0/653932614 shutdown_connections 2024-09-05T07:57:16.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:16.950+0000 7f3e23ad2640 1 -- 172.21.15.17:0/653932614 wait complete. 2024-09-05T07:57:16.962 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":861,"stamp":"2024-09-05T07:57:16.209610+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":37814792,"num_objects":109,"num_object_clones":0,"num_object_copies":218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":0,"num_read":985,"num_read_kb":1016,"num_write":14418,"num_write_kb":339547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13324,"ondisk_log_size":13324,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":376824,"kb_used_data":76024,"kb_used_omap":12,"kb_used_meta":300659,"kb_avail":754597896,"statfs":{"total":773094113280,"available":772708245504,"internally_reserved":0,"allocated":77848576,"data_stored":76338904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":307875377},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":195947,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":12,"num_write":69,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002816"},"pg_stats":[{"pgid":"3.3f","version":"24'52","reported_seq":75,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.326626+0000","last_change":"2024-09-05T07:30:02.495241+0000","last_active":"2024-09-05T07:57:10.326626+0000","last_peered":"2024-09-05T07:57:10.326626+0000","last_clean":"2024-09-05T07:57:10.326626+0000","last_became_active":"2024-09-05T07:30:02.494878+0000","last_became_peered":"2024-09-05T07:30:02.494878+0000","last_unstale":"2024-09-05T07:57:10.326626+0000","last_undegraded":"2024-09-05T07:57:10.326626+0000","last_fullsized":"2024-09-05T07:57:10.326626+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:15:28.381136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":2980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"24'95","reported_seq":124,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.313902+0000","last_change":"2024-09-05T07:29:30.658489+0000","last_active":"2024-09-05T07:57:10.313902+0000","last_peered":"2024-09-05T07:57:10.313902+0000","last_clean":"2024-09-05T07:57:10.313902+0000","last_became_active":"2024-09-05T07:29:30.658225+0000","last_became_peered":"2024-09-05T07:29:30.658225+0000","last_unstale":"2024-09-05T07:57:10.313902+0000","last_undegraded":"2024-09-05T07:57:10.313902+0000","last_fullsized":"2024-09-05T07:57:10.313902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:03:07.788844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":7017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"24'86","reported_seq":115,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.313139+0000","last_change":"2024-09-05T07:29:30.659535+0000","last_active":"2024-09-05T07:57:10.313139+0000","last_peered":"2024-09-05T07:57:10.313139+0000","last_clean":"2024-09-05T07:57:10.313139+0000","last_became_active":"2024-09-05T07:29:30.659042+0000","last_became_peered":"2024-09-05T07:29:30.659042+0000","last_unstale":"2024-09-05T07:57:10.313139+0000","last_undegraded":"2024-09-05T07:57:10.313139+0000","last_fullsized":"2024-09-05T07:57:10.313139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:08:39.718764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":4627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"24'50","reported_seq":79,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.356926+0000","last_change":"2024-09-05T07:29:30.640489+0000","last_active":"2024-09-05T07:57:10.356926+0000","last_peered":"2024-09-05T07:57:10.356926+0000","last_clean":"2024-09-05T07:57:10.356926+0000","last_became_active":"2024-09-05T07:29:30.640141+0000","last_became_peered":"2024-09-05T07:29:30.640141+0000","last_unstale":"2024-09-05T07:57:10.356926+0000","last_undegraded":"2024-09-05T07:57:10.356926+0000","last_fullsized":"2024-09-05T07:57:10.356926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:53:14.516901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":3092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"24'51","reported_seq":78,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.338096+0000","last_change":"2024-09-05T07:29:30.659266+0000","last_active":"2024-09-05T07:57:10.338096+0000","last_peered":"2024-09-05T07:57:10.338096+0000","last_clean":"2024-09-05T07:57:10.338096+0000","last_became_active":"2024-09-05T07:29:30.658981+0000","last_became_peered":"2024-09-05T07:29:30.658981+0000","last_unstale":"2024-09-05T07:57:10.338096+0000","last_undegraded":"2024-09-05T07:57:10.338096+0000","last_fullsized":"2024-09-05T07:57:10.338096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:34:49.879681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":3119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"24'102","reported_seq":129,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.347508+0000","last_change":"2024-09-05T07:29:30.641512+0000","last_active":"2024-09-05T07:57:10.347508+0000","last_peered":"2024-09-05T07:57:10.347508+0000","last_clean":"2024-09-05T07:57:10.347508+0000","last_became_active":"2024-09-05T07:29:30.641255+0000","last_became_peered":"2024-09-05T07:29:30.641255+0000","last_unstale":"2024-09-05T07:57:10.347508+0000","last_undegraded":"2024-09-05T07:57:10.347508+0000","last_fullsized":"2024-09-05T07:57:10.347508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:42.938157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":5219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"24'87","reported_seq":114,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.330915+0000","last_change":"2024-09-05T07:29:30.556064+0000","last_active":"2024-09-05T07:57:10.330915+0000","last_peered":"2024-09-05T07:57:10.330915+0000","last_clean":"2024-09-05T07:57:10.330915+0000","last_became_active":"2024-09-05T07:29:30.555796+0000","last_became_peered":"2024-09-05T07:29:30.555796+0000","last_unstale":"2024-09-05T07:57:10.330915+0000","last_undegraded":"2024-09-05T07:57:10.330915+0000","last_fullsized":"2024-09-05T07:57:10.330915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:37:28.088603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":6302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"24'64","reported_seq":91,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.319405+0000","last_change":"2024-09-05T07:29:30.659561+0000","last_active":"2024-09-05T07:57:10.319405+0000","last_peered":"2024-09-05T07:57:10.319405+0000","last_clean":"2024-09-05T07:57:10.319405+0000","last_became_active":"2024-09-05T07:29:30.659070+0000","last_became_peered":"2024-09-05T07:29:30.659070+0000","last_unstale":"2024-09-05T07:57:10.319405+0000","last_undegraded":"2024-09-05T07:57:10.319405+0000","last_fullsized":"2024-09-05T07:57:10.319405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:13:33.902479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"24'73","reported_seq":100,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.317525+0000","last_change":"2024-09-05T07:29:30.565653+0000","last_active":"2024-09-05T07:57:10.317525+0000","last_peered":"2024-09-05T07:57:10.317525+0000","last_clean":"2024-09-05T07:57:10.317525+0000","last_became_active":"2024-09-05T07:29:30.565408+0000","last_became_peered":"2024-09-05T07:29:30.565408+0000","last_unstale":"2024-09-05T07:57:10.317525+0000","last_undegraded":"2024-09-05T07:57:10.317525+0000","last_fullsized":"2024-09-05T07:57:10.317525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:42.938157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":5244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"24'70","reported_seq":97,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.351153+0000","last_change":"2024-09-05T07:29:30.643865+0000","last_active":"2024-09-05T07:57:10.351153+0000","last_peered":"2024-09-05T07:57:10.351153+0000","last_clean":"2024-09-05T07:57:10.351153+0000","last_became_active":"2024-09-05T07:29:30.643587+0000","last_became_peered":"2024-09-05T07:29:30.643587+0000","last_unstale":"2024-09-05T07:57:10.351153+0000","last_undegraded":"2024-09-05T07:57:10.351153+0000","last_fullsized":"2024-09-05T07:57:10.351153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:37:46.507371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":1781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"24'68","reported_seq":95,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.344205+0000","last_change":"2024-09-05T07:29:30.557314+0000","last_active":"2024-09-05T07:57:10.344205+0000","last_peered":"2024-09-05T07:57:10.344205+0000","last_clean":"2024-09-05T07:57:10.344205+0000","last_became_active":"2024-09-05T07:29:30.557039+0000","last_became_peered":"2024-09-05T07:29:30.557039+0000","last_unstale":"2024-09-05T07:57:10.344205+0000","last_undegraded":"2024-09-05T07:57:10.344205+0000","last_fullsized":"2024-09-05T07:57:10.344205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:08:39.718764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"24'49","reported_seq":76,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.348843+0000","last_change":"2024-09-05T07:29:30.564518+0000","last_active":"2024-09-05T07:57:10.348843+0000","last_peered":"2024-09-05T07:57:10.348843+0000","last_clean":"2024-09-05T07:57:10.348843+0000","last_became_active":"2024-09-05T07:29:30.564271+0000","last_became_peered":"2024-09-05T07:29:30.564271+0000","last_unstale":"2024-09-05T07:57:10.348843+0000","last_undegraded":"2024-09-05T07:57:10.348843+0000","last_fullsized":"2024-09-05T07:57:10.348843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:09:22.026287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":2250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"24'77","reported_seq":104,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.296011+0000","last_change":"2024-09-05T07:29:30.631857+0000","last_active":"2024-09-05T07:57:10.296011+0000","last_peered":"2024-09-05T07:57:10.296011+0000","last_clean":"2024-09-05T07:57:10.296011+0000","last_became_active":"2024-09-05T07:29:30.631588+0000","last_became_peered":"2024-09-05T07:29:30.631588+0000","last_unstale":"2024-09-05T07:57:10.296011+0000","last_undegraded":"2024-09-05T07:57:10.296011+0000","last_fullsized":"2024-09-05T07:57:10.296011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:41:25.696697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"24'67","reported_seq":94,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.297577+0000","last_change":"2024-09-05T07:29:30.632829+0000","last_active":"2024-09-05T07:57:10.297577+0000","last_peered":"2024-09-05T07:57:10.297577+0000","last_clean":"2024-09-05T07:57:10.297577+0000","last_became_active":"2024-09-05T07:29:30.632528+0000","last_became_peered":"2024-09-05T07:29:30.632528+0000","last_unstale":"2024-09-05T07:57:10.297577+0000","last_undegraded":"2024-09-05T07:57:10.297577+0000","last_fullsized":"2024-09-05T07:57:10.297577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:22:35.613478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":4207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"24'87","reported_seq":114,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.313845+0000","last_change":"2024-09-05T07:29:30.657306+0000","last_active":"2024-09-05T07:57:10.313845+0000","last_peered":"2024-09-05T07:57:10.313845+0000","last_clean":"2024-09-05T07:57:10.313845+0000","last_became_active":"2024-09-05T07:29:30.656997+0000","last_became_peered":"2024-09-05T07:29:30.656997+0000","last_unstale":"2024-09-05T07:57:10.313845+0000","last_undegraded":"2024-09-05T07:57:10.313845+0000","last_fullsized":"2024-09-05T07:57:10.313845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:15:28.381136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"24'76","reported_seq":103,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.293131+0000","last_change":"2024-09-05T07:29:30.641543+0000","last_active":"2024-09-05T07:57:10.293131+0000","last_peered":"2024-09-05T07:57:10.293131+0000","last_clean":"2024-09-05T07:57:10.293131+0000","last_became_active":"2024-09-05T07:29:30.641283+0000","last_became_peered":"2024-09-05T07:29:30.641283+0000","last_unstale":"2024-09-05T07:57:10.293131+0000","last_undegraded":"2024-09-05T07:57:10.293131+0000","last_fullsized":"2024-09-05T07:57:10.293131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:36:59.967135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"24'92","reported_seq":119,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.291737+0000","last_change":"2024-09-05T07:29:30.558414+0000","last_active":"2024-09-05T07:57:10.291737+0000","last_peered":"2024-09-05T07:57:10.291737+0000","last_clean":"2024-09-05T07:57:10.291737+0000","last_became_active":"2024-09-05T07:29:30.558105+0000","last_became_peered":"2024-09-05T07:29:30.558105+0000","last_unstale":"2024-09-05T07:57:10.291737+0000","last_undegraded":"2024-09-05T07:57:10.291737+0000","last_fullsized":"2024-09-05T07:57:10.291737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:55:31.494616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":4227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"24'95","reported_seq":122,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.326590+0000","last_change":"2024-09-05T07:29:30.643169+0000","last_active":"2024-09-05T07:57:10.326590+0000","last_peered":"2024-09-05T07:57:10.326590+0000","last_clean":"2024-09-05T07:57:10.326590+0000","last_became_active":"2024-09-05T07:29:30.642876+0000","last_became_peered":"2024-09-05T07:29:30.642876+0000","last_unstale":"2024-09-05T07:57:10.326590+0000","last_undegraded":"2024-09-05T07:57:10.326590+0000","last_fullsized":"2024-09-05T07:57:10.326590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:40.101513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":9001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"24'66","reported_seq":94,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.288476+0000","last_change":"2024-09-05T07:29:30.557239+0000","last_active":"2024-09-05T07:57:10.288476+0000","last_peered":"2024-09-05T07:57:10.288476+0000","last_clean":"2024-09-05T07:57:10.288476+0000","last_became_active":"2024-09-05T07:29:30.556969+0000","last_became_peered":"2024-09-05T07:29:30.556969+0000","last_unstale":"2024-09-05T07:57:10.288476+0000","last_undegraded":"2024-09-05T07:57:10.288476+0000","last_fullsized":"2024-09-05T07:57:10.288476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:47:29.801348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":2884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"24'78","reported_seq":106,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.347143+0000","last_change":"2024-09-05T07:29:30.564077+0000","last_active":"2024-09-05T07:57:10.347143+0000","last_peered":"2024-09-05T07:57:10.347143+0000","last_clean":"2024-09-05T07:57:10.347143+0000","last_became_active":"2024-09-05T07:29:30.563808+0000","last_became_peered":"2024-09-05T07:29:30.563808+0000","last_unstale":"2024-09-05T07:57:10.347143+0000","last_undegraded":"2024-09-05T07:57:10.347143+0000","last_fullsized":"2024-09-05T07:57:10.347143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:00:35.625571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":5103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"24'109","reported_seq":137,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.356586+0000","last_change":"2024-09-05T07:29:30.643879+0000","last_active":"2024-09-05T07:57:10.356586+0000","last_peered":"2024-09-05T07:57:10.356586+0000","last_clean":"2024-09-05T07:57:10.356586+0000","last_became_active":"2024-09-05T07:29:30.643559+0000","last_became_peered":"2024-09-05T07:29:30.643559+0000","last_unstale":"2024-09-05T07:57:10.356586+0000","last_undegraded":"2024-09-05T07:57:10.356586+0000","last_fullsized":"2024-09-05T07:57:10.356586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:52:56.756904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":8204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"24'68","reported_seq":96,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.320057+0000","last_change":"2024-09-05T07:29:30.564954+0000","last_active":"2024-09-05T07:57:10.320057+0000","last_peered":"2024-09-05T07:57:10.320057+0000","last_clean":"2024-09-05T07:57:10.320057+0000","last_became_active":"2024-09-05T07:29:30.564669+0000","last_became_peered":"2024-09-05T07:29:30.564669+0000","last_unstale":"2024-09-05T07:57:10.320057+0000","last_undegraded":"2024-09-05T07:57:10.320057+0000","last_fullsized":"2024-09-05T07:57:10.320057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:53:40.150507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":2069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"24'75","reported_seq":103,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.315721+0000","last_change":"2024-09-05T07:29:30.656718+0000","last_active":"2024-09-05T07:57:10.315721+0000","last_peered":"2024-09-05T07:57:10.315721+0000","last_clean":"2024-09-05T07:57:10.315721+0000","last_became_active":"2024-09-05T07:29:30.656451+0000","last_became_peered":"2024-09-05T07:29:30.656451+0000","last_unstale":"2024-09-05T07:57:10.315721+0000","last_undegraded":"2024-09-05T07:57:10.315721+0000","last_fullsized":"2024-09-05T07:57:10.315721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:38:11.961137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":3632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"24'60","reported_seq":88,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.291730+0000","last_change":"2024-09-05T07:29:30.658481+0000","last_active":"2024-09-05T07:57:10.291730+0000","last_peered":"2024-09-05T07:57:10.291730+0000","last_clean":"2024-09-05T07:57:10.291730+0000","last_became_active":"2024-09-05T07:29:30.658207+0000","last_became_peered":"2024-09-05T07:29:30.658207+0000","last_unstale":"2024-09-05T07:57:10.291730+0000","last_undegraded":"2024-09-05T07:57:10.291730+0000","last_fullsized":"2024-09-05T07:57:10.291730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:23:04.483495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":3656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"24'76","reported_seq":104,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.312991+0000","last_change":"2024-09-05T07:29:30.657936+0000","last_active":"2024-09-05T07:57:10.312991+0000","last_peered":"2024-09-05T07:57:10.312991+0000","last_clean":"2024-09-05T07:57:10.312991+0000","last_became_active":"2024-09-05T07:29:30.657177+0000","last_became_peered":"2024-09-05T07:29:30.657177+0000","last_unstale":"2024-09-05T07:57:10.312991+0000","last_undegraded":"2024-09-05T07:57:10.312991+0000","last_fullsized":"2024-09-05T07:57:10.312991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:01:34.217228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":7413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"24'76","reported_seq":104,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.352634+0000","last_change":"2024-09-05T07:29:30.642790+0000","last_active":"2024-09-05T07:57:10.352634+0000","last_peered":"2024-09-05T07:57:10.352634+0000","last_clean":"2024-09-05T07:57:10.352634+0000","last_became_active":"2024-09-05T07:29:30.641834+0000","last_became_peered":"2024-09-05T07:29:30.641834+0000","last_unstale":"2024-09-05T07:57:10.352634+0000","last_undegraded":"2024-09-05T07:57:10.352634+0000","last_fullsized":"2024-09-05T07:57:10.352634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:34:17.448981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":3360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"24'83","reported_seq":111,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.297659+0000","last_change":"2024-09-05T07:29:30.633776+0000","last_active":"2024-09-05T07:57:10.297659+0000","last_peered":"2024-09-05T07:57:10.297659+0000","last_clean":"2024-09-05T07:57:10.297659+0000","last_became_active":"2024-09-05T07:29:30.633507+0000","last_became_peered":"2024-09-05T07:29:30.633507+0000","last_unstale":"2024-09-05T07:57:10.297659+0000","last_undegraded":"2024-09-05T07:57:10.297659+0000","last_fullsized":"2024-09-05T07:57:10.297659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:34:54.335152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":5040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"24'50","reported_seq":78,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.296242+0000","last_change":"2024-09-05T07:29:30.632558+0000","last_active":"2024-09-05T07:57:10.296242+0000","last_peered":"2024-09-05T07:57:10.296242+0000","last_clean":"2024-09-05T07:57:10.296242+0000","last_became_active":"2024-09-05T07:29:30.632269+0000","last_became_peered":"2024-09-05T07:29:30.632269+0000","last_unstale":"2024-09-05T07:57:10.296242+0000","last_undegraded":"2024-09-05T07:57:10.296242+0000","last_fullsized":"2024-09-05T07:57:10.296242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:35:18.927192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":6253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"24'73","reported_seq":102,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.312088+0000","last_change":"2024-09-05T07:29:30.656638+0000","last_active":"2024-09-05T07:57:10.312088+0000","last_peered":"2024-09-05T07:57:10.312088+0000","last_clean":"2024-09-05T07:57:10.312088+0000","last_became_active":"2024-09-05T07:29:30.656382+0000","last_became_peered":"2024-09-05T07:29:30.656382+0000","last_unstale":"2024-09-05T07:57:10.312088+0000","last_undegraded":"2024-09-05T07:57:10.312088+0000","last_fullsized":"2024-09-05T07:57:10.312088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:34:49.879681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":7725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"24'117","reported_seq":146,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.285819+0000","last_change":"2024-09-05T07:29:30.657421+0000","last_active":"2024-09-05T07:57:10.285819+0000","last_peered":"2024-09-05T07:57:10.285819+0000","last_clean":"2024-09-05T07:57:10.285819+0000","last_became_active":"2024-09-05T07:29:30.657159+0000","last_became_peered":"2024-09-05T07:29:30.657159+0000","last_unstale":"2024-09-05T07:57:10.285819+0000","last_undegraded":"2024-09-05T07:57:10.285819+0000","last_fullsized":"2024-09-05T07:57:10.285819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:13:05.334750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":4986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"24'92","reported_seq":121,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.327999+0000","last_change":"2024-09-05T07:29:30.624866+0000","last_active":"2024-09-05T07:57:10.327999+0000","last_peered":"2024-09-05T07:57:10.327999+0000","last_clean":"2024-09-05T07:57:10.327999+0000","last_became_active":"2024-09-05T07:29:30.624605+0000","last_became_peered":"2024-09-05T07:29:30.624605+0000","last_unstale":"2024-09-05T07:57:10.327999+0000","last_undegraded":"2024-09-05T07:57:10.327999+0000","last_fullsized":"2024-09-05T07:57:10.327999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:42.938157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":7891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"24'80","reported_seq":109,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.355465+0000","last_change":"2024-09-05T07:29:30.642514+0000","last_active":"2024-09-05T07:57:10.355465+0000","last_peered":"2024-09-05T07:57:10.355465+0000","last_clean":"2024-09-05T07:57:10.355465+0000","last_became_active":"2024-09-05T07:29:30.642084+0000","last_became_peered":"2024-09-05T07:29:30.642084+0000","last_unstale":"2024-09-05T07:57:10.355465+0000","last_undegraded":"2024-09-05T07:57:10.355465+0000","last_fullsized":"2024-09-05T07:57:10.355465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:40.101513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":4235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"24'60","reported_seq":87,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.320160+0000","last_change":"2024-09-05T07:29:30.657456+0000","last_active":"2024-09-05T07:57:10.320160+0000","last_peered":"2024-09-05T07:57:10.320160+0000","last_clean":"2024-09-05T07:57:10.320160+0000","last_became_active":"2024-09-05T07:29:30.657117+0000","last_became_peered":"2024-09-05T07:29:30.657117+0000","last_unstale":"2024-09-05T07:57:10.320160+0000","last_undegraded":"2024-09-05T07:57:10.320160+0000","last_fullsized":"2024-09-05T07:57:10.320160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:40.101513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":3534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"24'647","reported_seq":676,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:05.043520+0000","last_change":"2024-09-05T07:29:29.568126+0000","last_active":"2024-09-05T07:57:05.043520+0000","last_peered":"2024-09-05T07:57:05.043520+0000","last_clean":"2024-09-05T07:57:05.043520+0000","last_became_active":"2024-09-05T07:29:29.567846+0000","last_became_peered":"2024-09-05T07:29:29.567846+0000","last_unstale":"2024-09-05T07:57:05.043520+0000","last_undegraded":"2024-09-05T07:57:05.043520+0000","last_fullsized":"2024-09-05T07:57:05.043520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:48:25.900221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195510,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":639,"num_write_kb":4403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"24'89","reported_seq":116,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.358386+0000","last_change":"2024-09-05T07:29:30.557504+0000","last_active":"2024-09-05T07:57:10.358386+0000","last_peered":"2024-09-05T07:57:10.358386+0000","last_clean":"2024-09-05T07:57:10.358386+0000","last_became_active":"2024-09-05T07:29:30.557203+0000","last_became_peered":"2024-09-05T07:29:30.557203+0000","last_unstale":"2024-09-05T07:57:10.358386+0000","last_undegraded":"2024-09-05T07:57:10.358386+0000","last_fullsized":"2024-09-05T07:57:10.358386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:55:13.742728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":6286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"24'598","reported_seq":627,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:54:31.541138+0000","last_change":"2024-09-05T07:29:29.524587+0000","last_active":"2024-09-05T07:54:31.541138+0000","last_peered":"2024-09-05T07:54:31.541138+0000","last_clean":"2024-09-05T07:54:31.541138+0000","last_became_active":"2024-09-05T07:29:29.524321+0000","last_became_peered":"2024-09-05T07:29:29.524321+0000","last_unstale":"2024-09-05T07:54:31.541138+0000","last_undegraded":"2024-09-05T07:54:31.541138+0000","last_fullsized":"2024-09-05T07:54:31.541138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":598,"log_dups_size":0,"ondisk_log_size":598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:53:13.376716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"24'6","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:56:53.384231+0000","last_change":"2024-09-05T07:29:29.570879+0000","last_active":"2024-09-05T07:56:53.384231+0000","last_peered":"2024-09-05T07:56:53.384231+0000","last_clean":"2024-09-05T07:56:53.384231+0000","last_became_active":"2024-09-05T07:29:29.570456+0000","last_became_peered":"2024-09-05T07:29:29.570456+0000","last_unstale":"2024-09-05T07:56:53.384231+0000","last_undegraded":"2024-09-05T07:56:53.384231+0000","last_fullsized":"2024-09-05T07:56:53.384231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:52:54.638586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"24'84","reported_seq":111,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.318416+0000","last_change":"2024-09-05T07:29:30.657364+0000","last_active":"2024-09-05T07:57:10.318416+0000","last_peered":"2024-09-05T07:57:10.318416+0000","last_clean":"2024-09-05T07:57:10.318416+0000","last_became_active":"2024-09-05T07:29:30.657008+0000","last_became_peered":"2024-09-05T07:29:30.657008+0000","last_unstale":"2024-09-05T07:57:10.318416+0000","last_undegraded":"2024-09-05T07:57:10.318416+0000","last_fullsized":"2024-09-05T07:57:10.318416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:36:59.967135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":7830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"24'7","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:56:49.948482+0000","last_change":"2024-09-05T07:29:29.562802+0000","last_active":"2024-09-05T07:56:49.948482+0000","last_peered":"2024-09-05T07:56:49.948482+0000","last_clean":"2024-09-05T07:56:49.948482+0000","last_became_active":"2024-09-05T07:29:29.562520+0000","last_became_peered":"2024-09-05T07:29:29.562520+0000","last_unstale":"2024-09-05T07:56:49.948482+0000","last_undegraded":"2024-09-05T07:56:49.948482+0000","last_fullsized":"2024-09-05T07:56:49.948482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:34:16.308797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"24'88","reported_seq":115,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.358272+0000","last_change":"2024-09-05T07:29:30.563197+0000","last_active":"2024-09-05T07:57:10.358272+0000","last_peered":"2024-09-05T07:57:10.358272+0000","last_clean":"2024-09-05T07:57:10.358272+0000","last_became_active":"2024-09-05T07:29:30.562945+0000","last_became_peered":"2024-09-05T07:29:30.562945+0000","last_unstale":"2024-09-05T07:57:10.358272+0000","last_undegraded":"2024-09-05T07:57:10.358272+0000","last_fullsized":"2024-09-05T07:57:10.358272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:31:37.754325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"24'14","reported_seq":43,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.079133+0000","last_change":"2024-09-05T07:29:29.559012+0000","last_active":"2024-09-05T07:57:10.079133+0000","last_peered":"2024-09-05T07:57:10.079133+0000","last_clean":"2024-09-05T07:57:10.079133+0000","last_became_active":"2024-09-05T07:29:29.558744+0000","last_became_peered":"2024-09-05T07:29:29.558744+0000","last_unstale":"2024-09-05T07:57:10.079133+0000","last_undegraded":"2024-09-05T07:57:10.079133+0000","last_fullsized":"2024-09-05T07:57:10.079133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:28:41.630593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"24'98","reported_seq":125,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.357735+0000","last_change":"2024-09-05T07:29:30.641594+0000","last_active":"2024-09-05T07:57:10.357735+0000","last_peered":"2024-09-05T07:57:10.357735+0000","last_clean":"2024-09-05T07:57:10.357735+0000","last_became_active":"2024-09-05T07:29:30.641360+0000","last_became_peered":"2024-09-05T07:29:30.641360+0000","last_unstale":"2024-09-05T07:57:10.357735+0000","last_undegraded":"2024-09-05T07:57:10.357735+0000","last_fullsized":"2024-09-05T07:57:10.357735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:49:40.327718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":5807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"24'8","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:02.687264+0000","last_change":"2024-09-05T07:29:29.559998+0000","last_active":"2024-09-05T07:57:02.687264+0000","last_peered":"2024-09-05T07:57:02.687264+0000","last_clean":"2024-09-05T07:57:02.687264+0000","last_became_active":"2024-09-05T07:29:29.559717+0000","last_became_peered":"2024-09-05T07:29:29.559717+0000","last_unstale":"2024-09-05T07:57:02.687264+0000","last_undegraded":"2024-09-05T07:57:02.687264+0000","last_fullsized":"2024-09-05T07:57:02.687264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:58.513308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"24'57","reported_seq":84,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.314763+0000","last_change":"2024-09-05T07:29:30.657727+0000","last_active":"2024-09-05T07:57:10.314763+0000","last_peered":"2024-09-05T07:57:10.314763+0000","last_clean":"2024-09-05T07:57:10.314763+0000","last_became_active":"2024-09-05T07:29:30.657038+0000","last_became_peered":"2024-09-05T07:29:30.657038+0000","last_unstale":"2024-09-05T07:57:10.314763+0000","last_undegraded":"2024-09-05T07:57:10.314763+0000","last_fullsized":"2024-09-05T07:57:10.314763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:00:35.625571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":3450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"24'613","reported_seq":642,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:09.740261+0000","last_change":"2024-09-05T07:29:29.566840+0000","last_active":"2024-09-05T07:57:09.740261+0000","last_peered":"2024-09-05T07:57:09.740261+0000","last_clean":"2024-09-05T07:57:09.740261+0000","last_became_active":"2024-09-05T07:29:29.566501+0000","last_became_peered":"2024-09-05T07:29:29.566501+0000","last_unstale":"2024-09-05T07:57:09.740261+0000","last_undegraded":"2024-09-05T07:57:09.740261+0000","last_fullsized":"2024-09-05T07:57:09.740261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:47:57.187710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":613,"num_write_kb":614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"24'72","reported_seq":99,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.303889+0000","last_change":"2024-09-05T07:29:30.642252+0000","last_active":"2024-09-05T07:57:10.303889+0000","last_peered":"2024-09-05T07:57:10.303889+0000","last_clean":"2024-09-05T07:57:10.303889+0000","last_became_active":"2024-09-05T07:29:30.641991+0000","last_became_peered":"2024-09-05T07:29:30.641991+0000","last_unstale":"2024-09-05T07:57:10.303889+0000","last_undegraded":"2024-09-05T07:57:10.303889+0000","last_fullsized":"2024-09-05T07:57:10.303889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:42:04.216273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":2982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"24'832","reported_seq":861,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:00.513516+0000","last_change":"2024-09-05T07:29:29.562441+0000","last_active":"2024-09-05T07:57:00.513516+0000","last_peered":"2024-09-05T07:57:00.513516+0000","last_clean":"2024-09-05T07:57:00.513516+0000","last_became_active":"2024-09-05T07:29:29.562136+0000","last_became_peered":"2024-09-05T07:29:29.562136+0000","last_unstale":"2024-09-05T07:57:00.513516+0000","last_undegraded":"2024-09-05T07:57:00.513516+0000","last_fullsized":"2024-09-05T07:57:00.513516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:06:20.633881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":830,"num_write_kb":4536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"24'66","reported_seq":93,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.339442+0000","last_change":"2024-09-05T07:29:30.633033+0000","last_active":"2024-09-05T07:57:10.339442+0000","last_peered":"2024-09-05T07:57:10.339442+0000","last_clean":"2024-09-05T07:57:10.339442+0000","last_became_active":"2024-09-05T07:29:30.632784+0000","last_became_peered":"2024-09-05T07:29:30.632784+0000","last_unstale":"2024-09-05T07:57:10.339442+0000","last_undegraded":"2024-09-05T07:57:10.339442+0000","last_fullsized":"2024-09-05T07:57:10.339442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:03:07.788844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":3605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'14","reported_seq":43,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:02.687518+0000","last_change":"2024-09-05T07:29:29.567195+0000","last_active":"2024-09-05T07:57:02.687518+0000","last_peered":"2024-09-05T07:57:02.687518+0000","last_clean":"2024-09-05T07:57:02.687518+0000","last_became_active":"2024-09-05T07:29:29.566934+0000","last_became_peered":"2024-09-05T07:29:29.566934+0000","last_unstale":"2024-09-05T07:57:02.687518+0000","last_undegraded":"2024-09-05T07:57:02.687518+0000","last_fullsized":"2024-09-05T07:57:02.687518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:10:28.438071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"24'76","reported_seq":103,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.298339+0000","last_change":"2024-09-05T07:29:30.632260+0000","last_active":"2024-09-05T07:57:10.298339+0000","last_peered":"2024-09-05T07:57:10.298339+0000","last_clean":"2024-09-05T07:57:10.298339+0000","last_became_active":"2024-09-05T07:29:30.631974+0000","last_became_peered":"2024-09-05T07:29:30.631974+0000","last_unstale":"2024-09-05T07:57:10.298339+0000","last_undegraded":"2024-09-05T07:57:10.298339+0000","last_fullsized":"2024-09-05T07:57:10.298339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:45:00.967978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"24'10","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:09.707101+0000","last_change":"2024-09-05T07:29:29.567028+0000","last_active":"2024-09-05T07:57:09.707101+0000","last_peered":"2024-09-05T07:57:09.707101+0000","last_clean":"2024-09-05T07:57:09.707101+0000","last_became_active":"2024-09-05T07:29:29.566754+0000","last_became_peered":"2024-09-05T07:29:29.566754+0000","last_unstale":"2024-09-05T07:57:09.707101+0000","last_undegraded":"2024-09-05T07:57:09.707101+0000","last_fullsized":"2024-09-05T07:57:09.707101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:49:13.565181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"24'97","reported_seq":124,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.302295+0000","last_change":"2024-09-05T07:29:30.558658+0000","last_active":"2024-09-05T07:57:10.302295+0000","last_peered":"2024-09-05T07:57:10.302295+0000","last_clean":"2024-09-05T07:57:10.302295+0000","last_became_active":"2024-09-05T07:29:30.558179+0000","last_became_peered":"2024-09-05T07:29:30.558179+0000","last_unstale":"2024-09-05T07:57:10.302295+0000","last_undegraded":"2024-09-05T07:57:10.302295+0000","last_fullsized":"2024-09-05T07:57:10.302295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:44:13.003367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":15470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"24'10","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:07.727452+0000","last_change":"2024-09-05T07:29:29.525420+0000","last_active":"2024-09-05T07:57:07.727452+0000","last_peered":"2024-09-05T07:57:07.727452+0000","last_clean":"2024-09-05T07:57:07.727452+0000","last_became_active":"2024-09-05T07:29:29.525139+0000","last_became_peered":"2024-09-05T07:29:29.525139+0000","last_unstale":"2024-09-05T07:57:07.727452+0000","last_undegraded":"2024-09-05T07:57:07.727452+0000","last_fullsized":"2024-09-05T07:57:07.727452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:54:00.339029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1172,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"24'53","reported_seq":80,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.316662+0000","last_change":"2024-09-05T07:29:30.659606+0000","last_active":"2024-09-05T07:57:10.316662+0000","last_peered":"2024-09-05T07:57:10.316662+0000","last_clean":"2024-09-05T07:57:10.316662+0000","last_became_active":"2024-09-05T07:29:30.659311+0000","last_became_peered":"2024-09-05T07:29:30.659311+0000","last_unstale":"2024-09-05T07:57:10.316662+0000","last_undegraded":"2024-09-05T07:57:10.316662+0000","last_fullsized":"2024-09-05T07:57:10.316662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:54:01.479214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":2804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"24'22","reported_seq":51,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:07.724968+0000","last_change":"2024-09-05T07:29:29.566784+0000","last_active":"2024-09-05T07:57:07.724968+0000","last_peered":"2024-09-05T07:57:07.724968+0000","last_clean":"2024-09-05T07:57:07.724968+0000","last_became_active":"2024-09-05T07:29:29.566503+0000","last_became_peered":"2024-09-05T07:29:29.566503+0000","last_unstale":"2024-09-05T07:57:07.724968+0000","last_undegraded":"2024-09-05T07:57:07.724968+0000","last_fullsized":"2024-09-05T07:57:07.724968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:35:54.465221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"24'65","reported_seq":92,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.290685+0000","last_change":"2024-09-05T07:29:30.641565+0000","last_active":"2024-09-05T07:57:10.290685+0000","last_peered":"2024-09-05T07:57:10.290685+0000","last_clean":"2024-09-05T07:57:10.290685+0000","last_became_active":"2024-09-05T07:29:30.641309+0000","last_became_peered":"2024-09-05T07:29:30.641309+0000","last_unstale":"2024-09-05T07:57:10.290685+0000","last_undegraded":"2024-09-05T07:57:10.290685+0000","last_fullsized":"2024-09-05T07:57:10.290685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:37:28.088603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":5311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"24'6","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:00.512888+0000","last_change":"2024-09-05T07:29:29.524793+0000","last_active":"2024-09-05T07:57:00.512888+0000","last_peered":"2024-09-05T07:57:00.512888+0000","last_clean":"2024-09-05T07:57:00.512888+0000","last_became_active":"2024-09-05T07:29:29.524522+0000","last_became_peered":"2024-09-05T07:29:29.524522+0000","last_unstale":"2024-09-05T07:57:00.512888+0000","last_undegraded":"2024-09-05T07:57:00.512888+0000","last_fullsized":"2024-09-05T07:57:00.512888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:41.797972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"24'36","reported_seq":64,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.348352+0000","last_change":"2024-09-05T07:29:30.642565+0000","last_active":"2024-09-05T07:57:10.348352+0000","last_peered":"2024-09-05T07:57:10.348352+0000","last_clean":"2024-09-05T07:57:10.348352+0000","last_became_active":"2024-09-05T07:29:30.641774+0000","last_became_peered":"2024-09-05T07:29:30.641774+0000","last_unstale":"2024-09-05T07:57:10.348352+0000","last_undegraded":"2024-09-05T07:57:10.348352+0000","last_fullsized":"2024-09-05T07:57:10.348352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:09:36.911425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"24'7","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:04.683555+0000","last_change":"2024-09-05T07:29:29.525374+0000","last_active":"2024-09-05T07:57:04.683555+0000","last_peered":"2024-09-05T07:57:04.683555+0000","last_clean":"2024-09-05T07:57:04.683555+0000","last_became_active":"2024-09-05T07:29:29.525044+0000","last_became_peered":"2024-09-05T07:29:29.525044+0000","last_unstale":"2024-09-05T07:57:04.683555+0000","last_undegraded":"2024-09-05T07:57:04.683555+0000","last_fullsized":"2024-09-05T07:57:04.683555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:25:35.862773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"24'52","reported_seq":80,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.346677+0000","last_change":"2024-09-05T07:29:30.563669+0000","last_active":"2024-09-05T07:57:10.346677+0000","last_peered":"2024-09-05T07:57:10.346677+0000","last_clean":"2024-09-05T07:57:10.346677+0000","last_became_active":"2024-09-05T07:29:30.563408+0000","last_became_peered":"2024-09-05T07:29:30.563408+0000","last_unstale":"2024-09-05T07:57:10.346677+0000","last_undegraded":"2024-09-05T07:57:10.346677+0000","last_fullsized":"2024-09-05T07:57:10.346677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:42:04.216273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":3705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'6","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:56:58.387111+0000","last_change":"2024-09-05T07:29:29.559111+0000","last_active":"2024-09-05T07:56:58.387111+0000","last_peered":"2024-09-05T07:56:58.387111+0000","last_clean":"2024-09-05T07:56:58.387111+0000","last_became_active":"2024-09-05T07:29:29.558856+0000","last_became_peered":"2024-09-05T07:29:29.558856+0000","last_unstale":"2024-09-05T07:56:58.387111+0000","last_undegraded":"2024-09-05T07:56:58.387111+0000","last_fullsized":"2024-09-05T07:56:58.387111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:47:57.187710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"24'61","reported_seq":89,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.339287+0000","last_change":"2024-09-05T07:29:30.624401+0000","last_active":"2024-09-05T07:57:10.339287+0000","last_peered":"2024-09-05T07:57:10.339287+0000","last_clean":"2024-09-05T07:57:10.339287+0000","last_became_active":"2024-09-05T07:29:30.624057+0000","last_became_peered":"2024-09-05T07:29:30.624057+0000","last_unstale":"2024-09-05T07:57:10.339287+0000","last_undegraded":"2024-09-05T07:57:10.339287+0000","last_fullsized":"2024-09-05T07:57:10.339287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:36:59.967135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":4070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"24'14","reported_seq":44,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:09.732085+0000","last_change":"2024-09-05T07:29:29.570940+0000","last_active":"2024-09-05T07:57:09.732085+0000","last_peered":"2024-09-05T07:57:09.732085+0000","last_clean":"2024-09-05T07:57:09.732085+0000","last_became_active":"2024-09-05T07:29:29.570478+0000","last_became_peered":"2024-09-05T07:29:29.570478+0000","last_unstale":"2024-09-05T07:57:09.732085+0000","last_undegraded":"2024-09-05T07:57:09.732085+0000","last_fullsized":"2024-09-05T07:57:09.732085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:35:54.465221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1754,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"24'65","reported_seq":93,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.298478+0000","last_change":"2024-09-05T07:29:30.563109+0000","last_active":"2024-09-05T07:57:10.298478+0000","last_peered":"2024-09-05T07:57:10.298478+0000","last_clean":"2024-09-05T07:57:10.298478+0000","last_became_active":"2024-09-05T07:29:30.562824+0000","last_became_peered":"2024-09-05T07:29:30.562824+0000","last_unstale":"2024-09-05T07:57:10.298478+0000","last_undegraded":"2024-09-05T07:57:10.298478+0000","last_fullsized":"2024-09-05T07:57:10.298478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:42:02.212868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":2542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":188,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:53:16.573037+0000","last_change":"2024-09-05T07:29:13.366600+0000","last_active":"2024-09-05T07:53:16.573037+0000","last_peered":"2024-09-05T07:53:16.573037+0000","last_clean":"2024-09-05T07:53:16.573037+0000","last_became_active":"2024-09-05T07:29:13.365841+0000","last_became_peered":"2024-09-05T07:29:13.365841+0000","last_unstale":"2024-09-05T07:53:16.573037+0000","last_undegraded":"2024-09-05T07:53:16.573037+0000","last_fullsized":"2024-09-05T07:53:16.573037+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:10.874807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:10.874807+0000","last_clean_scrub_stamp":"2024-09-05T07:29:10.874807+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:21:17.673107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"22'6","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:54:31.541160+0000","last_change":"2024-09-05T07:29:29.563604+0000","last_active":"2024-09-05T07:54:31.541160+0000","last_peered":"2024-09-05T07:54:31.541160+0000","last_clean":"2024-09-05T07:54:31.541160+0000","last_became_active":"2024-09-05T07:29:29.562956+0000","last_became_peered":"2024-09-05T07:29:29.562956+0000","last_unstale":"2024-09-05T07:54:31.541160+0000","last_undegraded":"2024-09-05T07:54:31.541160+0000","last_fullsized":"2024-09-05T07:54:31.541160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:41.797972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"24'54","reported_seq":83,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.355759+0000","last_change":"2024-09-05T07:29:30.641543+0000","last_active":"2024-09-05T07:57:10.355759+0000","last_peered":"2024-09-05T07:57:10.355759+0000","last_clean":"2024-09-05T07:57:10.355759+0000","last_became_active":"2024-09-05T07:29:30.641243+0000","last_became_peered":"2024-09-05T07:29:30.641243+0000","last_unstale":"2024-09-05T07:57:10.355759+0000","last_undegraded":"2024-09-05T07:57:10.355759+0000","last_fullsized":"2024-09-05T07:57:10.355759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:34:54.335152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":3733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"24'323","reported_seq":354,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.091544+0000","last_change":"2024-09-05T07:29:29.479329+0000","last_active":"2024-09-05T07:57:10.091544+0000","last_peered":"2024-09-05T07:57:10.091544+0000","last_clean":"2024-09-05T07:57:10.091544+0000","last_became_active":"2024-09-05T07:29:29.479005+0000","last_became_peered":"2024-09-05T07:29:29.479005+0000","last_unstale":"2024-09-05T07:57:10.091544+0000","last_undegraded":"2024-09-05T07:57:10.091544+0000","last_fullsized":"2024-09-05T07:57:10.091544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:49:39.187534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3479043,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":3552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"24'55","reported_seq":84,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.295183+0000","last_change":"2024-09-05T07:29:30.641557+0000","last_active":"2024-09-05T07:57:10.295183+0000","last_peered":"2024-09-05T07:57:10.295183+0000","last_clean":"2024-09-05T07:57:10.295183+0000","last_became_active":"2024-09-05T07:29:30.641269+0000","last_became_peered":"2024-09-05T07:29:30.641269+0000","last_unstale":"2024-09-05T07:57:10.295183+0000","last_undegraded":"2024-09-05T07:57:10.295183+0000","last_fullsized":"2024-09-05T07:57:10.295183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:32:30.263430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":2599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"24'880","reported_seq":1780,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.687136+0000","last_change":"2024-09-05T07:29:29.568835+0000","last_active":"2024-09-05T07:57:10.687136+0000","last_peered":"2024-09-05T07:57:10.687136+0000","last_clean":"2024-09-05T07:57:10.687136+0000","last_became_active":"2024-09-05T07:29:29.568576+0000","last_became_peered":"2024-09-05T07:29:29.568576+0000","last_unstale":"2024-09-05T07:57:10.687136+0000","last_undegraded":"2024-09-05T07:57:10.687136+0000","last_fullsized":"2024-09-05T07:57:10.687136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:05:05.417016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182215,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":869,"num_read_kb":916,"num_write":877,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"24'71","reported_seq":100,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.317538+0000","last_change":"2024-09-05T07:29:30.660008+0000","last_active":"2024-09-05T07:57:10.317538+0000","last_peered":"2024-09-05T07:57:10.317538+0000","last_clean":"2024-09-05T07:57:10.317538+0000","last_became_active":"2024-09-05T07:29:30.659720+0000","last_became_peered":"2024-09-05T07:29:30.659720+0000","last_unstale":"2024-09-05T07:57:10.317538+0000","last_undegraded":"2024-09-05T07:57:10.317538+0000","last_fullsized":"2024-09-05T07:57:10.317538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:42:04.216273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":2450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"24'8","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:00.601508+0000","last_change":"2024-09-05T07:29:29.568569+0000","last_active":"2024-09-05T07:57:00.601508+0000","last_peered":"2024-09-05T07:57:00.601508+0000","last_clean":"2024-09-05T07:57:00.601508+0000","last_became_active":"2024-09-05T07:29:29.568307+0000","last_became_peered":"2024-09-05T07:29:29.568307+0000","last_unstale":"2024-09-05T07:57:00.601508+0000","last_undegraded":"2024-09-05T07:57:00.601508+0000","last_fullsized":"2024-09-05T07:57:00.601508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:12:38.814463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"24'89","reported_seq":118,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.332346+0000","last_change":"2024-09-05T07:29:30.642687+0000","last_active":"2024-09-05T07:57:10.332346+0000","last_peered":"2024-09-05T07:57:10.332346+0000","last_clean":"2024-09-05T07:57:10.332346+0000","last_became_active":"2024-09-05T07:29:30.642414+0000","last_became_peered":"2024-09-05T07:29:30.642414+0000","last_unstale":"2024-09-05T07:57:10.332346+0000","last_undegraded":"2024-09-05T07:57:10.332346+0000","last_fullsized":"2024-09-05T07:57:10.332346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:01:34.217228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":7430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"24'5","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:02.684653+0000","last_change":"2024-09-05T07:29:29.568739+0000","last_active":"2024-09-05T07:57:02.684653+0000","last_peered":"2024-09-05T07:57:02.684653+0000","last_clean":"2024-09-05T07:57:02.684653+0000","last_became_active":"2024-09-05T07:29:29.568499+0000","last_became_peered":"2024-09-05T07:29:29.568499+0000","last_unstale":"2024-09-05T07:57:02.684653+0000","last_undegraded":"2024-09-05T07:57:02.684653+0000","last_fullsized":"2024-09-05T07:57:02.684653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:05:05.417016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"24'66","reported_seq":95,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.351595+0000","last_change":"2024-09-05T07:29:30.641340+0000","last_active":"2024-09-05T07:57:10.351595+0000","last_peered":"2024-09-05T07:57:10.351595+0000","last_clean":"2024-09-05T07:57:10.351595+0000","last_became_active":"2024-09-05T07:29:30.640805+0000","last_became_peered":"2024-09-05T07:29:30.640805+0000","last_unstale":"2024-09-05T07:57:10.351595+0000","last_undegraded":"2024-09-05T07:57:10.351595+0000","last_fullsized":"2024-09-05T07:57:10.351595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:59.653492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":1781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"24'8","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:04.908697+0000","last_change":"2024-09-05T07:29:29.525212+0000","last_active":"2024-09-05T07:57:04.908697+0000","last_peered":"2024-09-05T07:57:04.908697+0000","last_clean":"2024-09-05T07:57:04.908697+0000","last_became_active":"2024-09-05T07:29:29.524918+0000","last_became_peered":"2024-09-05T07:29:29.524918+0000","last_unstale":"2024-09-05T07:57:04.908697+0000","last_undegraded":"2024-09-05T07:57:04.908697+0000","last_fullsized":"2024-09-05T07:57:04.908697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:09:35.771241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"24'64","reported_seq":93,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.294385+0000","last_change":"2024-09-05T07:29:30.658407+0000","last_active":"2024-09-05T07:57:10.294385+0000","last_peered":"2024-09-05T07:57:10.294385+0000","last_clean":"2024-09-05T07:57:10.294385+0000","last_became_active":"2024-09-05T07:29:30.658155+0000","last_became_peered":"2024-09-05T07:29:30.658155+0000","last_unstale":"2024-09-05T07:57:10.294385+0000","last_undegraded":"2024-09-05T07:57:10.294385+0000","last_fullsized":"2024-09-05T07:57:10.294385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:52:56.756904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":2545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"24'1349","reported_seq":1379,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:09.621151+0000","last_change":"2024-09-05T07:29:29.526674+0000","last_active":"2024-09-05T07:57:09.621151+0000","last_peered":"2024-09-05T07:57:09.621151+0000","last_clean":"2024-09-05T07:57:09.621151+0000","last_became_active":"2024-09-05T07:29:29.526421+0000","last_became_peered":"2024-09-05T07:29:29.526421+0000","last_unstale":"2024-09-05T07:57:09.621151+0000","last_undegraded":"2024-09-05T07:57:09.621151+0000","last_fullsized":"2024-09-05T07:57:09.621151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":1349,"log_dups_size":0,"ondisk_log_size":1349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:52:13.496606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3429,"num_write_kb":1221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"24'72","reported_seq":100,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.357110+0000","last_change":"2024-09-05T07:29:30.633806+0000","last_active":"2024-09-05T07:57:10.357110+0000","last_peered":"2024-09-05T07:57:10.357110+0000","last_clean":"2024-09-05T07:57:10.357110+0000","last_became_active":"2024-09-05T07:29:30.633535+0000","last_became_peered":"2024-09-05T07:29:30.633535+0000","last_unstale":"2024-09-05T07:57:10.357110+0000","last_undegraded":"2024-09-05T07:57:10.357110+0000","last_fullsized":"2024-09-05T07:57:10.357110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:40:35.334862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"24'12","reported_seq":42,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:04.909123+0000","last_change":"2024-09-05T07:29:29.524532+0000","last_active":"2024-09-05T07:57:04.909123+0000","last_peered":"2024-09-05T07:57:04.909123+0000","last_clean":"2024-09-05T07:57:04.909123+0000","last_became_active":"2024-09-05T07:29:29.524268+0000","last_became_peered":"2024-09-05T07:29:29.524268+0000","last_unstale":"2024-09-05T07:57:04.909123+0000","last_undegraded":"2024-09-05T07:57:04.909123+0000","last_fullsized":"2024-09-05T07:57:04.909123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:58.513308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'84","reported_seq":112,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.357971+0000","last_change":"2024-09-05T07:29:30.624431+0000","last_active":"2024-09-05T07:57:10.357971+0000","last_peered":"2024-09-05T07:57:10.357971+0000","last_clean":"2024-09-05T07:57:10.357971+0000","last_became_active":"2024-09-05T07:29:30.624117+0000","last_became_peered":"2024-09-05T07:29:30.624117+0000","last_unstale":"2024-09-05T07:57:10.357971+0000","last_undegraded":"2024-09-05T07:57:10.357971+0000","last_fullsized":"2024-09-05T07:57:10.357971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:10:00.845713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":5195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'9","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:07.727533+0000","last_change":"2024-09-05T07:29:29.561285+0000","last_active":"2024-09-05T07:57:07.727533+0000","last_peered":"2024-09-05T07:57:07.727533+0000","last_clean":"2024-09-05T07:57:07.727533+0000","last_became_active":"2024-09-05T07:29:29.561026+0000","last_became_peered":"2024-09-05T07:29:29.561026+0000","last_unstale":"2024-09-05T07:57:07.727533+0000","last_undegraded":"2024-09-05T07:57:07.727533+0000","last_fullsized":"2024-09-05T07:57:07.727533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:48:25.900221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"24'80","reported_seq":108,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:56:44.931312+0000","last_change":"2024-09-05T07:29:30.556889+0000","last_active":"2024-09-05T07:56:44.931312+0000","last_peered":"2024-09-05T07:56:44.931312+0000","last_clean":"2024-09-05T07:56:44.931312+0000","last_became_active":"2024-09-05T07:29:30.556627+0000","last_became_peered":"2024-09-05T07:29:30.556627+0000","last_unstale":"2024-09-05T07:56:44.931312+0000","last_undegraded":"2024-09-05T07:56:44.931312+0000","last_fullsized":"2024-09-05T07:56:44.931312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:20:01.152157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":7503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"24'11","reported_seq":41,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:56:58.431425+0000","last_change":"2024-09-05T07:29:29.526873+0000","last_active":"2024-09-05T07:56:58.431425+0000","last_peered":"2024-09-05T07:56:58.431425+0000","last_clean":"2024-09-05T07:56:58.431425+0000","last_became_active":"2024-09-05T07:29:29.526572+0000","last_became_peered":"2024-09-05T07:29:29.526572+0000","last_unstale":"2024-09-05T07:56:58.431425+0000","last_undegraded":"2024-09-05T07:56:58.431425+0000","last_fullsized":"2024-09-05T07:56:58.431425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:33:14.122911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"24'71","reported_seq":99,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.357807+0000","last_change":"2024-09-05T07:29:30.624592+0000","last_active":"2024-09-05T07:57:10.357807+0000","last_peered":"2024-09-05T07:57:10.357807+0000","last_clean":"2024-09-05T07:57:10.357807+0000","last_became_active":"2024-09-05T07:29:30.624109+0000","last_became_peered":"2024-09-05T07:29:30.624109+0000","last_unstale":"2024-09-05T07:57:10.357807+0000","last_undegraded":"2024-09-05T07:57:10.357807+0000","last_fullsized":"2024-09-05T07:57:10.357807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:22:35.613478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":2208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"24'5","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:56:47.894301+0000","last_change":"2024-09-05T07:29:29.569816+0000","last_active":"2024-09-05T07:56:47.894301+0000","last_peered":"2024-09-05T07:56:47.894301+0000","last_clean":"2024-09-05T07:56:47.894301+0000","last_became_active":"2024-09-05T07:29:29.569536+0000","last_became_peered":"2024-09-05T07:29:29.569536+0000","last_unstale":"2024-09-05T07:56:47.894301+0000","last_undegraded":"2024-09-05T07:56:47.894301+0000","last_fullsized":"2024-09-05T07:56:47.894301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:59:18.418220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"24'86","reported_seq":114,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.326387+0000","last_change":"2024-09-05T07:29:30.632805+0000","last_active":"2024-09-05T07:57:10.326387+0000","last_peered":"2024-09-05T07:57:10.326387+0000","last_clean":"2024-09-05T07:57:10.326387+0000","last_became_active":"2024-09-05T07:29:30.632502+0000","last_became_peered":"2024-09-05T07:29:30.632502+0000","last_unstale":"2024-09-05T07:57:10.326387+0000","last_undegraded":"2024-09-05T07:57:10.326387+0000","last_fullsized":"2024-09-05T07:57:10.326387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:59.653492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":4049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"24'545","reported_seq":575,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:02.691674+0000","last_change":"2024-09-05T07:29:29.563821+0000","last_active":"2024-09-05T07:57:02.691674+0000","last_peered":"2024-09-05T07:57:02.691674+0000","last_clean":"2024-09-05T07:57:02.691674+0000","last_became_active":"2024-09-05T07:29:29.563316+0000","last_became_peered":"2024-09-05T07:29:29.563316+0000","last_unstale":"2024-09-05T07:57:02.691674+0000","last_undegraded":"2024-09-05T07:57:02.691674+0000","last_fullsized":"2024-09-05T07:57:02.691674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:38.961328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":542,"num_write_kb":4368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"24'76","reported_seq":104,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.303070+0000","last_change":"2024-09-05T07:29:30.563106+0000","last_active":"2024-09-05T07:57:10.303070+0000","last_peered":"2024-09-05T07:57:10.303070+0000","last_clean":"2024-09-05T07:57:10.303070+0000","last_became_active":"2024-09-05T07:29:30.562776+0000","last_became_peered":"2024-09-05T07:29:30.562776+0000","last_unstale":"2024-09-05T07:57:10.303070+0000","last_undegraded":"2024-09-05T07:57:10.303070+0000","last_fullsized":"2024-09-05T07:57:10.303070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:37:16.174244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":1880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"24'79","reported_seq":106,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.297970+0000","last_change":"2024-09-05T07:29:30.558029+0000","last_active":"2024-09-05T07:57:10.297970+0000","last_peered":"2024-09-05T07:57:10.297970+0000","last_clean":"2024-09-05T07:57:10.297970+0000","last_became_active":"2024-09-05T07:29:30.557747+0000","last_became_peered":"2024-09-05T07:29:30.557747+0000","last_unstale":"2024-09-05T07:57:10.297970+0000","last_undegraded":"2024-09-05T07:57:10.297970+0000","last_fullsized":"2024-09-05T07:57:10.297970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:55:28.983976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":6364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"24'9","reported_seq":38,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:02.742338+0000","last_change":"2024-09-05T07:29:29.561333+0000","last_active":"2024-09-05T07:57:02.742338+0000","last_peered":"2024-09-05T07:57:02.742338+0000","last_clean":"2024-09-05T07:57:02.742338+0000","last_became_active":"2024-09-05T07:29:29.561065+0000","last_became_peered":"2024-09-05T07:29:29.561065+0000","last_unstale":"2024-09-05T07:57:02.742338+0000","last_undegraded":"2024-09-05T07:57:02.742338+0000","last_fullsized":"2024-09-05T07:57:02.742338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:38.961328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"24'45","reported_seq":72,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.321239+0000","last_change":"2024-09-05T07:29:30.566028+0000","last_active":"2024-09-05T07:57:10.321239+0000","last_peered":"2024-09-05T07:57:10.321239+0000","last_clean":"2024-09-05T07:57:10.321239+0000","last_became_active":"2024-09-05T07:29:30.565787+0000","last_became_peered":"2024-09-05T07:29:30.565787+0000","last_unstale":"2024-09-05T07:57:10.321239+0000","last_undegraded":"2024-09-05T07:57:10.321239+0000","last_fullsized":"2024-09-05T07:57:10.321239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:59.653492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":3021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"24'1204","reported_seq":1233,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:02.679237+0000","last_change":"2024-09-05T07:29:29.559969+0000","last_active":"2024-09-05T07:57:02.679237+0000","last_peered":"2024-09-05T07:57:02.679237+0000","last_clean":"2024-09-05T07:57:02.679237+0000","last_became_active":"2024-09-05T07:29:29.559675+0000","last_became_peered":"2024-09-05T07:29:29.559675+0000","last_unstale":"2024-09-05T07:57:02.679237+0000","last_undegraded":"2024-09-05T07:57:02.679237+0000","last_fullsized":"2024-09-05T07:57:02.679237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":1204,"log_dups_size":0,"ondisk_log_size":1204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:53:39.010323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1200,"num_write_kb":8869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"24'101","reported_seq":130,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.316956+0000","last_change":"2024-09-05T07:29:30.657369+0000","last_active":"2024-09-05T07:57:10.316956+0000","last_peered":"2024-09-05T07:57:10.316956+0000","last_clean":"2024-09-05T07:57:10.316956+0000","last_became_active":"2024-09-05T07:29:30.656876+0000","last_became_peered":"2024-09-05T07:29:30.656876+0000","last_unstale":"2024-09-05T07:57:10.316956+0000","last_undegraded":"2024-09-05T07:57:10.316956+0000","last_fullsized":"2024-09-05T07:57:10.316956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:09:22.026287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":8259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"24'716","reported_seq":747,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:56:58.419911+0000","last_change":"2024-09-05T07:29:29.567440+0000","last_active":"2024-09-05T07:56:58.419911+0000","last_peered":"2024-09-05T07:56:58.419911+0000","last_clean":"2024-09-05T07:56:58.419911+0000","last_became_active":"2024-09-05T07:29:29.567129+0000","last_became_peered":"2024-09-05T07:29:29.567129+0000","last_unstale":"2024-09-05T07:56:58.419911+0000","last_undegraded":"2024-09-05T07:56:58.419911+0000","last_fullsized":"2024-09-05T07:56:58.419911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":716,"log_dups_size":0,"ondisk_log_size":716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:54:00.339029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":711,"num_write_kb":4517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"24'60","reported_seq":89,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.313108+0000","last_change":"2024-09-05T07:29:30.657929+0000","last_active":"2024-09-05T07:57:10.313108+0000","last_peered":"2024-09-05T07:57:10.313108+0000","last_clean":"2024-09-05T07:57:10.313108+0000","last_became_active":"2024-09-05T07:29:30.657625+0000","last_became_peered":"2024-09-05T07:29:30.657625+0000","last_unstale":"2024-09-05T07:57:10.313108+0000","last_undegraded":"2024-09-05T07:57:10.313108+0000","last_fullsized":"2024-09-05T07:57:10.313108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:37:46.507371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":2166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"24'587","reported_seq":618,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:56:53.509229+0000","last_change":"2024-09-05T07:29:29.526099+0000","last_active":"2024-09-05T07:56:53.509229+0000","last_peered":"2024-09-05T07:56:53.509229+0000","last_clean":"2024-09-05T07:56:53.509229+0000","last_became_active":"2024-09-05T07:29:29.525832+0000","last_became_peered":"2024-09-05T07:29:29.525832+0000","last_unstale":"2024-09-05T07:56:53.509229+0000","last_undegraded":"2024-09-05T07:56:53.509229+0000","last_fullsized":"2024-09-05T07:56:53.509229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:44:32.741898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3789,"num_write_kb":295314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4716,"ondisk_log_size":4716,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":37224424,"num_objects":107,"num_object_clones":0,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":869,"num_read_kb":916,"num_write":10470,"num_write_kb":41817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":74694656,"data_stored":74448848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8491,"ondisk_log_size":8491,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719477078,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61848,"kb_used_data":12616,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94309992,"statfs":{"total":96636764160,"available":96573431808,"internally_reserved":0,"allocated":12918784,"data_stored":12730197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509781,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35736,"kb_used_data":4552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94336104,"statfs":{"total":96636764160,"available":96600170496,"internally_reserved":0,"allocated":4661248,"data_stored":4466126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509781,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47156,"kb_used_data":15972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94324684,"statfs":{"total":96636764160,"available":96588476416,"internally_reserved":0,"allocated":16355328,"data_stored":16153926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509781,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47952,"kb_used_data":8448,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323888,"statfs":{"total":96636764160,"available":96587661312,"internally_reserved":0,"allocated":8650752,"data_stored":8478013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509780,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48536,"kb_used_data":9032,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323304,"statfs":{"total":96636764160,"available":96587063296,"internally_reserved":0,"allocated":9248768,"data_stored":9069055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509780,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47908,"kb_used_data":12564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323932,"statfs":{"total":96636764160,"available":96587706368,"internally_reserved":0,"allocated":12865536,"data_stored":12675287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542486,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43860,"kb_used_data":4356,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327980,"statfs":{"total":96636764160,"available":96591851520,"internally_reserved":0,"allocated":4460544,"data_stored":4286517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542485,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43828,"kb_used_data":8484,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94328012,"statfs":{"total":96636764160,"available":96591884288,"internally_reserved":0,"allocated":8687616,"data_stored":8479783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12619776,"data_stored":12586622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8409088,"data_stored":8390022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16109568,"data_stored":16065261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8441856,"data_stored":8391118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12079104,"data_stored":12051164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4214784,"data_stored":4197852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4415488,"data_stored":4377461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T07:57:16.966 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T07:57:17.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.101+0000 7f8a8cb18640 1 Processor -- start 2024-09-05T07:57:17.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.101+0000 7f8a8cb18640 1 -- start start 2024-09-05T07:57:17.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.102+0000 7f8a8cb18640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8a88154770 0x7f8a8815b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:17.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.102+0000 7f8a8cb18640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8a880c5a80 0x7f8a880c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:17.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.102+0000 7f8a8cb18640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a8806c8c0 con 0x7f8a880cafa0 2024-09-05T07:57:17.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.102+0000 7f8a8cb18640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f8a880c5310 con 0x7f8a880c5a80 2024-09-05T07:57:17.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.102+0000 7f8a8cb18640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f8a880cb950 con 0x7f8a88154770 2024-09-05T07:57:17.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.103+0000 7f8a85d9b640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f8a880cafa0 0x7f8a880d05c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:51694/0 (socket says 172.21.15.17:51694) 2024-09-05T07:57:17.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.103+0000 7f8a85d9b640 1 -- 172.21.15.17:0/1309450139 learned_addr learned my addr 172.21.15.17:0/1309450139 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:57:17.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.103+0000 7f8a8659c640 1 --2- 172.21.15.17:0/1309450139 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8a88154770 0x7f8a8815b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:17.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.103+0000 7f8a86d9d640 1 --2- 172.21.15.17:0/1309450139 >> v2:172.21.15.26:3300/0 conn(0x7f8a880c5a80 0x7f8a880c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:17.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.105+0000 7f8a8559a640 1 -- 172.21.15.17:0/1309450139 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3306123849 0 0) 0x7f8a8806c8c0 con 0x7f8a880cafa0 2024-09-05T07:57:17.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.105+0000 7f8a8559a640 1 -- 172.21.15.17:0/1309450139 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a74003520 con 0x7f8a880cafa0 2024-09-05T07:57:17.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.106+0000 7f8a86d9d640 1 -- 172.21.15.17:0/1309450139 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8a88154770 msgr2=0x7f8a8815b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:57:17.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.106+0000 7f8a86d9d640 1 --2- 172.21.15.17:0/1309450139 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8a88154770 0x7f8a8815b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:17.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.106+0000 7f8a86d9d640 1 -- 172.21.15.17:0/1309450139 >> v1:172.21.15.17:6789/0 conn(0x7f8a880cafa0 legacy=0x7f8a880d05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:17.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.106+0000 7f8a86d9d640 1 -- 172.21.15.17:0/1309450139 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a8806cb60 con 0x7f8a880c5a80 2024-09-05T07:57:17.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.108+0000 7f8a86d9d640 1 --2- 172.21.15.17:0/1309450139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a880c5a80 0x7f8a880c5f10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8a880c5490 tx=0x7f8a7802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f79593e91bf0cc72 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:17.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.112+0000 7f8a8559a640 1 -- 172.21.15.17:0/1309450139 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a78037070 con 0x7f8a880c5a80 2024-09-05T07:57:17.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.112+0000 7f8a8559a640 1 -- 172.21.15.17:0/1309450139 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a78032440 con 0x7f8a880c5a80 2024-09-05T07:57:17.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.112+0000 7f8a8559a640 1 -- 172.21.15.17:0/1309450139 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a78032810 con 0x7f8a880c5a80 2024-09-05T07:57:17.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.113+0000 7f8a8cb18640 1 -- 172.21.15.17:0/1309450139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a880c5a80 msgr2=0x7f8a880c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:17.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.113+0000 7f8a8cb18640 1 --2- 172.21.15.17:0/1309450139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a880c5a80 0x7f8a880c5f10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8a880c5490 tx=0x7f8a7802a180 comp rx=0 tx=0).stop 2024-09-05T07:57:17.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.113+0000 7f8a8cb18640 1 -- 172.21.15.17:0/1309450139 shutdown_connections 2024-09-05T07:57:17.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.113+0000 7f8a8cb18640 1 --2- 172.21.15.17:0/1309450139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a880c5a80 0x7f8a880c5f10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:17.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.113+0000 7f8a8cb18640 1 --2- 172.21.15.17:0/1309450139 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8a88154770 0x7f8a8815b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:17.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.113+0000 7f8a8cb18640 1 -- 172.21.15.17:0/1309450139 >> 172.21.15.17:0/1309450139 conn(0x7f8a88073710 msgr2=0x7f8a88073b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:17.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.113+0000 7f8a8cb18640 1 -- 172.21.15.17:0/1309450139 shutdown_connections 2024-09-05T07:57:17.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.113+0000 7f8a8cb18640 1 -- 172.21.15.17:0/1309450139 wait complete. 2024-09-05T07:57:17.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.114+0000 7f8a8cb18640 1 Processor -- start 2024-09-05T07:57:17.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.114+0000 7f8a8cb18640 1 -- start start 2024-09-05T07:57:17.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.115+0000 7f8a8cb18640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8a880c5a80 0x7f8a880c9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:17.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.115+0000 7f8a8cb18640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a880cafa0 0x7f8a8814b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:17.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.115+0000 7f8a8cb18640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a88154770 0x7f8a8814c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:17.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.115+0000 7f8a8cb18640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8a880c6450 con 0x7f8a880cafa0 2024-09-05T07:57:17.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.115+0000 7f8a8cb18640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8a880cbc30 con 0x7f8a88154770 2024-09-05T07:57:17.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.115+0000 7f8a8cb18640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f8a88154b50 con 0x7f8a880c5a80 2024-09-05T07:57:17.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.116+0000 7f8a85d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a880cafa0 0x7f8a8814b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:17.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.116+0000 7f8a86d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a88154770 0x7f8a8814c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:17.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.116+0000 7f8a8659c640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8a880c5a80 0x7f8a880c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:17.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.116+0000 7f8a85d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a880cafa0 0x7f8a8814b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39414/0 (socket says 172.21.15.17:39414) 2024-09-05T07:57:17.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.116+0000 7f8a85d9b640 1 -- 172.21.15.17:0/1811072212 learned_addr learned my addr 172.21.15.17:0/1811072212 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:17.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.119+0000 7f8a85d9b640 1 -- 172.21.15.17:0/1811072212 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8a880c5a80 msgr2=0x7f8a880c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:17.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.119+0000 7f8a85d9b640 1 --2- 172.21.15.17:0/1811072212 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8a880c5a80 0x7f8a880c9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:17.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.119+0000 7f8a85d9b640 1 -- 172.21.15.17:0/1811072212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a88154770 msgr2=0x7f8a8814c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:17.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.119+0000 7f8a85d9b640 1 --2- 172.21.15.17:0/1811072212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a88154770 0x7f8a8814c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:17.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.119+0000 7f8a85d9b640 1 -- 172.21.15.17:0/1811072212 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a8814bf00 con 0x7f8a880cafa0 2024-09-05T07:57:17.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.122+0000 7f8a85d9b640 1 --2- 172.21.15.17:0/1811072212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a880cafa0 0x7f8a8814b690 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000c400 tx=0x7f8a7000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:17.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.126+0000 7f8a7effd640 1 -- 172.21.15.17:0/1811072212 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a70017070 con 0x7f8a880cafa0 2024-09-05T07:57:17.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.126+0000 7f8a7effd640 1 -- 172.21.15.17:0/1811072212 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a70005d00 con 0x7f8a880cafa0 2024-09-05T07:57:17.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.126+0000 7f8a7effd640 1 -- 172.21.15.17:0/1811072212 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a70007310 con 0x7f8a880cafa0 2024-09-05T07:57:17.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.126+0000 7f8a8cb18640 1 -- 172.21.15.17:0/1811072212 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a8814c1a0 con 0x7f8a880cafa0 2024-09-05T07:57:17.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.126+0000 7f8a8cb18640 1 -- 172.21.15.17:0/1811072212 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a880cf870 con 0x7f8a880cafa0 2024-09-05T07:57:17.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.127+0000 7f8a8cb18640 1 -- 172.21.15.17:0/1811072212 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a8806bca0 con 0x7f8a880cafa0 2024-09-05T07:57:17.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.401+0000 7f8a7effd640 1 -- 172.21.15.17:0/1811072212 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8a7001a070 con 0x7f8a880cafa0 2024-09-05T07:57:17.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.401+0000 7f8a7effd640 1 --2- 172.21.15.17:0/1811072212 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f8a6806be80 0x7f8a6806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:17.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.402+0000 7f8a8659c640 1 --2- 172.21.15.17:0/1811072212 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f8a6806be80 0x7f8a6806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:17.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.402+0000 7f8a8659c640 1 --2- 172.21.15.17:0/1811072212 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f8a6806be80 0x7f8a6806e340 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8a88153410 tx=0x7f8a8000b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:17.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.416+0000 7f8a7effd640 1 -- 172.21.15.17:0/1811072212 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f8a70056a90 con 0x7f8a880cafa0 2024-09-05T07:57:17.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.416+0000 7f8a7effd640 1 -- 172.21.15.17:0/1811072212 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8a70021020 con 0x7f8a880cafa0 2024-09-05T07:57:17.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.592+0000 7f8a8cb18640 1 -- 172.21.15.17:0/1811072212 --> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8a8815ec50 con 0x7f8a6806be80 2024-09-05T07:57:17.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.599+0000 7f8a7effd640 1 -- 172.21.15.17:0/1811072212 <== mgr.4099 v2:172.21.15.26:6800/2736912541 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252849 (secure 0 0 0) 0x7f8a8815ec50 con 0x7f8a6806be80 2024-09-05T07:57:17.602 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:57:17.604 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-05T07:57:17.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.602+0000 7f8a8cb18640 1 -- 172.21.15.17:0/1811072212 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f8a6806be80 msgr2=0x7f8a6806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:17.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.602+0000 7f8a8cb18640 1 --2- 172.21.15.17:0/1811072212 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f8a6806be80 0x7f8a6806e340 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8a88153410 tx=0x7f8a8000b040 comp rx=0 tx=0).stop 2024-09-05T07:57:17.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.602+0000 7f8a8cb18640 1 -- 172.21.15.17:0/1811072212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a880cafa0 msgr2=0x7f8a8814b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:17.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.602+0000 7f8a8cb18640 1 --2- 172.21.15.17:0/1811072212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a880cafa0 0x7f8a8814b690 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000c400 tx=0x7f8a7000c8c0 comp rx=0 tx=0).stop 2024-09-05T07:57:17.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.602+0000 7f8a8cb18640 1 -- 172.21.15.17:0/1811072212 shutdown_connections 2024-09-05T07:57:17.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.602+0000 7f8a8cb18640 1 --2- 172.21.15.17:0/1811072212 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f8a6806be80 0x7f8a6806e340 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:17.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.602+0000 7f8a8cb18640 1 --2- 172.21.15.17:0/1811072212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a88154770 0x7f8a8814c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:17.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.602+0000 7f8a8cb18640 1 --2- 172.21.15.17:0/1811072212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a880cafa0 0x7f8a8814b690 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:17.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.602+0000 7f8a8cb18640 1 --2- 172.21.15.17:0/1811072212 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8a880c5a80 0x7f8a880c9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:17.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.602+0000 7f8a8cb18640 1 -- 172.21.15.17:0/1811072212 >> 172.21.15.17:0/1811072212 conn(0x7f8a88073710 msgr2=0x7f8a88151f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:17.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.602+0000 7f8a8cb18640 1 -- 172.21.15.17:0/1811072212 shutdown_connections 2024-09-05T07:57:17.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.602+0000 7f8a8cb18640 1 -- 172.21.15.17:0/1811072212 wait complete. 2024-09-05T07:57:17.614 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":861,"stamp":"2024-09-05T07:57:16.209610+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":37814792,"num_objects":109,"num_object_clones":0,"num_object_copies":218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":0,"num_read":985,"num_read_kb":1016,"num_write":14418,"num_write_kb":339547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13324,"ondisk_log_size":13324,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":376824,"kb_used_data":76024,"kb_used_omap":12,"kb_used_meta":300659,"kb_avail":754597896,"statfs":{"total":773094113280,"available":772708245504,"internally_reserved":0,"allocated":77848576,"data_stored":76338904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":307875377},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":195947,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":12,"num_write":69,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002816"},"pg_stats":[{"pgid":"3.3f","version":"24'52","reported_seq":75,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.326626+0000","last_change":"2024-09-05T07:30:02.495241+0000","last_active":"2024-09-05T07:57:10.326626+0000","last_peered":"2024-09-05T07:57:10.326626+0000","last_clean":"2024-09-05T07:57:10.326626+0000","last_became_active":"2024-09-05T07:30:02.494878+0000","last_became_peered":"2024-09-05T07:30:02.494878+0000","last_unstale":"2024-09-05T07:57:10.326626+0000","last_undegraded":"2024-09-05T07:57:10.326626+0000","last_fullsized":"2024-09-05T07:57:10.326626+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:15:28.381136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":2980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"24'95","reported_seq":124,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.313902+0000","last_change":"2024-09-05T07:29:30.658489+0000","last_active":"2024-09-05T07:57:10.313902+0000","last_peered":"2024-09-05T07:57:10.313902+0000","last_clean":"2024-09-05T07:57:10.313902+0000","last_became_active":"2024-09-05T07:29:30.658225+0000","last_became_peered":"2024-09-05T07:29:30.658225+0000","last_unstale":"2024-09-05T07:57:10.313902+0000","last_undegraded":"2024-09-05T07:57:10.313902+0000","last_fullsized":"2024-09-05T07:57:10.313902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:03:07.788844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":7017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"24'86","reported_seq":115,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.313139+0000","last_change":"2024-09-05T07:29:30.659535+0000","last_active":"2024-09-05T07:57:10.313139+0000","last_peered":"2024-09-05T07:57:10.313139+0000","last_clean":"2024-09-05T07:57:10.313139+0000","last_became_active":"2024-09-05T07:29:30.659042+0000","last_became_peered":"2024-09-05T07:29:30.659042+0000","last_unstale":"2024-09-05T07:57:10.313139+0000","last_undegraded":"2024-09-05T07:57:10.313139+0000","last_fullsized":"2024-09-05T07:57:10.313139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:08:39.718764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":4627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"24'50","reported_seq":79,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.356926+0000","last_change":"2024-09-05T07:29:30.640489+0000","last_active":"2024-09-05T07:57:10.356926+0000","last_peered":"2024-09-05T07:57:10.356926+0000","last_clean":"2024-09-05T07:57:10.356926+0000","last_became_active":"2024-09-05T07:29:30.640141+0000","last_became_peered":"2024-09-05T07:29:30.640141+0000","last_unstale":"2024-09-05T07:57:10.356926+0000","last_undegraded":"2024-09-05T07:57:10.356926+0000","last_fullsized":"2024-09-05T07:57:10.356926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:53:14.516901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":3092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"24'51","reported_seq":78,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.338096+0000","last_change":"2024-09-05T07:29:30.659266+0000","last_active":"2024-09-05T07:57:10.338096+0000","last_peered":"2024-09-05T07:57:10.338096+0000","last_clean":"2024-09-05T07:57:10.338096+0000","last_became_active":"2024-09-05T07:29:30.658981+0000","last_became_peered":"2024-09-05T07:29:30.658981+0000","last_unstale":"2024-09-05T07:57:10.338096+0000","last_undegraded":"2024-09-05T07:57:10.338096+0000","last_fullsized":"2024-09-05T07:57:10.338096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:34:49.879681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":3119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"24'102","reported_seq":129,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.347508+0000","last_change":"2024-09-05T07:29:30.641512+0000","last_active":"2024-09-05T07:57:10.347508+0000","last_peered":"2024-09-05T07:57:10.347508+0000","last_clean":"2024-09-05T07:57:10.347508+0000","last_became_active":"2024-09-05T07:29:30.641255+0000","last_became_peered":"2024-09-05T07:29:30.641255+0000","last_unstale":"2024-09-05T07:57:10.347508+0000","last_undegraded":"2024-09-05T07:57:10.347508+0000","last_fullsized":"2024-09-05T07:57:10.347508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:42.938157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":5219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"24'87","reported_seq":114,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.330915+0000","last_change":"2024-09-05T07:29:30.556064+0000","last_active":"2024-09-05T07:57:10.330915+0000","last_peered":"2024-09-05T07:57:10.330915+0000","last_clean":"2024-09-05T07:57:10.330915+0000","last_became_active":"2024-09-05T07:29:30.555796+0000","last_became_peered":"2024-09-05T07:29:30.555796+0000","last_unstale":"2024-09-05T07:57:10.330915+0000","last_undegraded":"2024-09-05T07:57:10.330915+0000","last_fullsized":"2024-09-05T07:57:10.330915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:37:28.088603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":6302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"24'64","reported_seq":91,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.319405+0000","last_change":"2024-09-05T07:29:30.659561+0000","last_active":"2024-09-05T07:57:10.319405+0000","last_peered":"2024-09-05T07:57:10.319405+0000","last_clean":"2024-09-05T07:57:10.319405+0000","last_became_active":"2024-09-05T07:29:30.659070+0000","last_became_peered":"2024-09-05T07:29:30.659070+0000","last_unstale":"2024-09-05T07:57:10.319405+0000","last_undegraded":"2024-09-05T07:57:10.319405+0000","last_fullsized":"2024-09-05T07:57:10.319405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:13:33.902479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"24'73","reported_seq":100,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.317525+0000","last_change":"2024-09-05T07:29:30.565653+0000","last_active":"2024-09-05T07:57:10.317525+0000","last_peered":"2024-09-05T07:57:10.317525+0000","last_clean":"2024-09-05T07:57:10.317525+0000","last_became_active":"2024-09-05T07:29:30.565408+0000","last_became_peered":"2024-09-05T07:29:30.565408+0000","last_unstale":"2024-09-05T07:57:10.317525+0000","last_undegraded":"2024-09-05T07:57:10.317525+0000","last_fullsized":"2024-09-05T07:57:10.317525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:42.938157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":5244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"24'70","reported_seq":97,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.351153+0000","last_change":"2024-09-05T07:29:30.643865+0000","last_active":"2024-09-05T07:57:10.351153+0000","last_peered":"2024-09-05T07:57:10.351153+0000","last_clean":"2024-09-05T07:57:10.351153+0000","last_became_active":"2024-09-05T07:29:30.643587+0000","last_became_peered":"2024-09-05T07:29:30.643587+0000","last_unstale":"2024-09-05T07:57:10.351153+0000","last_undegraded":"2024-09-05T07:57:10.351153+0000","last_fullsized":"2024-09-05T07:57:10.351153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:37:46.507371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":1781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"24'68","reported_seq":95,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.344205+0000","last_change":"2024-09-05T07:29:30.557314+0000","last_active":"2024-09-05T07:57:10.344205+0000","last_peered":"2024-09-05T07:57:10.344205+0000","last_clean":"2024-09-05T07:57:10.344205+0000","last_became_active":"2024-09-05T07:29:30.557039+0000","last_became_peered":"2024-09-05T07:29:30.557039+0000","last_unstale":"2024-09-05T07:57:10.344205+0000","last_undegraded":"2024-09-05T07:57:10.344205+0000","last_fullsized":"2024-09-05T07:57:10.344205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:08:39.718764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"24'49","reported_seq":76,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.348843+0000","last_change":"2024-09-05T07:29:30.564518+0000","last_active":"2024-09-05T07:57:10.348843+0000","last_peered":"2024-09-05T07:57:10.348843+0000","last_clean":"2024-09-05T07:57:10.348843+0000","last_became_active":"2024-09-05T07:29:30.564271+0000","last_became_peered":"2024-09-05T07:29:30.564271+0000","last_unstale":"2024-09-05T07:57:10.348843+0000","last_undegraded":"2024-09-05T07:57:10.348843+0000","last_fullsized":"2024-09-05T07:57:10.348843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:09:22.026287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":2250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"24'77","reported_seq":104,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.296011+0000","last_change":"2024-09-05T07:29:30.631857+0000","last_active":"2024-09-05T07:57:10.296011+0000","last_peered":"2024-09-05T07:57:10.296011+0000","last_clean":"2024-09-05T07:57:10.296011+0000","last_became_active":"2024-09-05T07:29:30.631588+0000","last_became_peered":"2024-09-05T07:29:30.631588+0000","last_unstale":"2024-09-05T07:57:10.296011+0000","last_undegraded":"2024-09-05T07:57:10.296011+0000","last_fullsized":"2024-09-05T07:57:10.296011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:41:25.696697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"24'67","reported_seq":94,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.297577+0000","last_change":"2024-09-05T07:29:30.632829+0000","last_active":"2024-09-05T07:57:10.297577+0000","last_peered":"2024-09-05T07:57:10.297577+0000","last_clean":"2024-09-05T07:57:10.297577+0000","last_became_active":"2024-09-05T07:29:30.632528+0000","last_became_peered":"2024-09-05T07:29:30.632528+0000","last_unstale":"2024-09-05T07:57:10.297577+0000","last_undegraded":"2024-09-05T07:57:10.297577+0000","last_fullsized":"2024-09-05T07:57:10.297577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:22:35.613478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":4207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"24'87","reported_seq":114,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.313845+0000","last_change":"2024-09-05T07:29:30.657306+0000","last_active":"2024-09-05T07:57:10.313845+0000","last_peered":"2024-09-05T07:57:10.313845+0000","last_clean":"2024-09-05T07:57:10.313845+0000","last_became_active":"2024-09-05T07:29:30.656997+0000","last_became_peered":"2024-09-05T07:29:30.656997+0000","last_unstale":"2024-09-05T07:57:10.313845+0000","last_undegraded":"2024-09-05T07:57:10.313845+0000","last_fullsized":"2024-09-05T07:57:10.313845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:15:28.381136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"24'76","reported_seq":103,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.293131+0000","last_change":"2024-09-05T07:29:30.641543+0000","last_active":"2024-09-05T07:57:10.293131+0000","last_peered":"2024-09-05T07:57:10.293131+0000","last_clean":"2024-09-05T07:57:10.293131+0000","last_became_active":"2024-09-05T07:29:30.641283+0000","last_became_peered":"2024-09-05T07:29:30.641283+0000","last_unstale":"2024-09-05T07:57:10.293131+0000","last_undegraded":"2024-09-05T07:57:10.293131+0000","last_fullsized":"2024-09-05T07:57:10.293131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:36:59.967135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"24'92","reported_seq":119,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.291737+0000","last_change":"2024-09-05T07:29:30.558414+0000","last_active":"2024-09-05T07:57:10.291737+0000","last_peered":"2024-09-05T07:57:10.291737+0000","last_clean":"2024-09-05T07:57:10.291737+0000","last_became_active":"2024-09-05T07:29:30.558105+0000","last_became_peered":"2024-09-05T07:29:30.558105+0000","last_unstale":"2024-09-05T07:57:10.291737+0000","last_undegraded":"2024-09-05T07:57:10.291737+0000","last_fullsized":"2024-09-05T07:57:10.291737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:55:31.494616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":4227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"24'95","reported_seq":122,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.326590+0000","last_change":"2024-09-05T07:29:30.643169+0000","last_active":"2024-09-05T07:57:10.326590+0000","last_peered":"2024-09-05T07:57:10.326590+0000","last_clean":"2024-09-05T07:57:10.326590+0000","last_became_active":"2024-09-05T07:29:30.642876+0000","last_became_peered":"2024-09-05T07:29:30.642876+0000","last_unstale":"2024-09-05T07:57:10.326590+0000","last_undegraded":"2024-09-05T07:57:10.326590+0000","last_fullsized":"2024-09-05T07:57:10.326590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:40.101513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":9001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"24'66","reported_seq":94,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.288476+0000","last_change":"2024-09-05T07:29:30.557239+0000","last_active":"2024-09-05T07:57:10.288476+0000","last_peered":"2024-09-05T07:57:10.288476+0000","last_clean":"2024-09-05T07:57:10.288476+0000","last_became_active":"2024-09-05T07:29:30.556969+0000","last_became_peered":"2024-09-05T07:29:30.556969+0000","last_unstale":"2024-09-05T07:57:10.288476+0000","last_undegraded":"2024-09-05T07:57:10.288476+0000","last_fullsized":"2024-09-05T07:57:10.288476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:47:29.801348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":2884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"24'78","reported_seq":106,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.347143+0000","last_change":"2024-09-05T07:29:30.564077+0000","last_active":"2024-09-05T07:57:10.347143+0000","last_peered":"2024-09-05T07:57:10.347143+0000","last_clean":"2024-09-05T07:57:10.347143+0000","last_became_active":"2024-09-05T07:29:30.563808+0000","last_became_peered":"2024-09-05T07:29:30.563808+0000","last_unstale":"2024-09-05T07:57:10.347143+0000","last_undegraded":"2024-09-05T07:57:10.347143+0000","last_fullsized":"2024-09-05T07:57:10.347143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:00:35.625571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":5103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"24'109","reported_seq":137,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.356586+0000","last_change":"2024-09-05T07:29:30.643879+0000","last_active":"2024-09-05T07:57:10.356586+0000","last_peered":"2024-09-05T07:57:10.356586+0000","last_clean":"2024-09-05T07:57:10.356586+0000","last_became_active":"2024-09-05T07:29:30.643559+0000","last_became_peered":"2024-09-05T07:29:30.643559+0000","last_unstale":"2024-09-05T07:57:10.356586+0000","last_undegraded":"2024-09-05T07:57:10.356586+0000","last_fullsized":"2024-09-05T07:57:10.356586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:52:56.756904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":8204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"24'68","reported_seq":96,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.320057+0000","last_change":"2024-09-05T07:29:30.564954+0000","last_active":"2024-09-05T07:57:10.320057+0000","last_peered":"2024-09-05T07:57:10.320057+0000","last_clean":"2024-09-05T07:57:10.320057+0000","last_became_active":"2024-09-05T07:29:30.564669+0000","last_became_peered":"2024-09-05T07:29:30.564669+0000","last_unstale":"2024-09-05T07:57:10.320057+0000","last_undegraded":"2024-09-05T07:57:10.320057+0000","last_fullsized":"2024-09-05T07:57:10.320057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:53:40.150507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":2069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"24'75","reported_seq":103,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.315721+0000","last_change":"2024-09-05T07:29:30.656718+0000","last_active":"2024-09-05T07:57:10.315721+0000","last_peered":"2024-09-05T07:57:10.315721+0000","last_clean":"2024-09-05T07:57:10.315721+0000","last_became_active":"2024-09-05T07:29:30.656451+0000","last_became_peered":"2024-09-05T07:29:30.656451+0000","last_unstale":"2024-09-05T07:57:10.315721+0000","last_undegraded":"2024-09-05T07:57:10.315721+0000","last_fullsized":"2024-09-05T07:57:10.315721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:38:11.961137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":3632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"24'60","reported_seq":88,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.291730+0000","last_change":"2024-09-05T07:29:30.658481+0000","last_active":"2024-09-05T07:57:10.291730+0000","last_peered":"2024-09-05T07:57:10.291730+0000","last_clean":"2024-09-05T07:57:10.291730+0000","last_became_active":"2024-09-05T07:29:30.658207+0000","last_became_peered":"2024-09-05T07:29:30.658207+0000","last_unstale":"2024-09-05T07:57:10.291730+0000","last_undegraded":"2024-09-05T07:57:10.291730+0000","last_fullsized":"2024-09-05T07:57:10.291730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:23:04.483495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":3656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"24'76","reported_seq":104,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.312991+0000","last_change":"2024-09-05T07:29:30.657936+0000","last_active":"2024-09-05T07:57:10.312991+0000","last_peered":"2024-09-05T07:57:10.312991+0000","last_clean":"2024-09-05T07:57:10.312991+0000","last_became_active":"2024-09-05T07:29:30.657177+0000","last_became_peered":"2024-09-05T07:29:30.657177+0000","last_unstale":"2024-09-05T07:57:10.312991+0000","last_undegraded":"2024-09-05T07:57:10.312991+0000","last_fullsized":"2024-09-05T07:57:10.312991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:01:34.217228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":7413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"24'76","reported_seq":104,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.352634+0000","last_change":"2024-09-05T07:29:30.642790+0000","last_active":"2024-09-05T07:57:10.352634+0000","last_peered":"2024-09-05T07:57:10.352634+0000","last_clean":"2024-09-05T07:57:10.352634+0000","last_became_active":"2024-09-05T07:29:30.641834+0000","last_became_peered":"2024-09-05T07:29:30.641834+0000","last_unstale":"2024-09-05T07:57:10.352634+0000","last_undegraded":"2024-09-05T07:57:10.352634+0000","last_fullsized":"2024-09-05T07:57:10.352634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:34:17.448981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":3360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"24'83","reported_seq":111,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.297659+0000","last_change":"2024-09-05T07:29:30.633776+0000","last_active":"2024-09-05T07:57:10.297659+0000","last_peered":"2024-09-05T07:57:10.297659+0000","last_clean":"2024-09-05T07:57:10.297659+0000","last_became_active":"2024-09-05T07:29:30.633507+0000","last_became_peered":"2024-09-05T07:29:30.633507+0000","last_unstale":"2024-09-05T07:57:10.297659+0000","last_undegraded":"2024-09-05T07:57:10.297659+0000","last_fullsized":"2024-09-05T07:57:10.297659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:34:54.335152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":5040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"24'50","reported_seq":78,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.296242+0000","last_change":"2024-09-05T07:29:30.632558+0000","last_active":"2024-09-05T07:57:10.296242+0000","last_peered":"2024-09-05T07:57:10.296242+0000","last_clean":"2024-09-05T07:57:10.296242+0000","last_became_active":"2024-09-05T07:29:30.632269+0000","last_became_peered":"2024-09-05T07:29:30.632269+0000","last_unstale":"2024-09-05T07:57:10.296242+0000","last_undegraded":"2024-09-05T07:57:10.296242+0000","last_fullsized":"2024-09-05T07:57:10.296242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:35:18.927192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":6253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"24'73","reported_seq":102,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.312088+0000","last_change":"2024-09-05T07:29:30.656638+0000","last_active":"2024-09-05T07:57:10.312088+0000","last_peered":"2024-09-05T07:57:10.312088+0000","last_clean":"2024-09-05T07:57:10.312088+0000","last_became_active":"2024-09-05T07:29:30.656382+0000","last_became_peered":"2024-09-05T07:29:30.656382+0000","last_unstale":"2024-09-05T07:57:10.312088+0000","last_undegraded":"2024-09-05T07:57:10.312088+0000","last_fullsized":"2024-09-05T07:57:10.312088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:34:49.879681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":7725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"24'117","reported_seq":146,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.285819+0000","last_change":"2024-09-05T07:29:30.657421+0000","last_active":"2024-09-05T07:57:10.285819+0000","last_peered":"2024-09-05T07:57:10.285819+0000","last_clean":"2024-09-05T07:57:10.285819+0000","last_became_active":"2024-09-05T07:29:30.657159+0000","last_became_peered":"2024-09-05T07:29:30.657159+0000","last_unstale":"2024-09-05T07:57:10.285819+0000","last_undegraded":"2024-09-05T07:57:10.285819+0000","last_fullsized":"2024-09-05T07:57:10.285819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:13:05.334750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":4986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"24'92","reported_seq":121,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.327999+0000","last_change":"2024-09-05T07:29:30.624866+0000","last_active":"2024-09-05T07:57:10.327999+0000","last_peered":"2024-09-05T07:57:10.327999+0000","last_clean":"2024-09-05T07:57:10.327999+0000","last_became_active":"2024-09-05T07:29:30.624605+0000","last_became_peered":"2024-09-05T07:29:30.624605+0000","last_unstale":"2024-09-05T07:57:10.327999+0000","last_undegraded":"2024-09-05T07:57:10.327999+0000","last_fullsized":"2024-09-05T07:57:10.327999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:42.938157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":7891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"24'80","reported_seq":109,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.355465+0000","last_change":"2024-09-05T07:29:30.642514+0000","last_active":"2024-09-05T07:57:10.355465+0000","last_peered":"2024-09-05T07:57:10.355465+0000","last_clean":"2024-09-05T07:57:10.355465+0000","last_became_active":"2024-09-05T07:29:30.642084+0000","last_became_peered":"2024-09-05T07:29:30.642084+0000","last_unstale":"2024-09-05T07:57:10.355465+0000","last_undegraded":"2024-09-05T07:57:10.355465+0000","last_fullsized":"2024-09-05T07:57:10.355465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:40.101513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":4235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"24'60","reported_seq":87,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.320160+0000","last_change":"2024-09-05T07:29:30.657456+0000","last_active":"2024-09-05T07:57:10.320160+0000","last_peered":"2024-09-05T07:57:10.320160+0000","last_clean":"2024-09-05T07:57:10.320160+0000","last_became_active":"2024-09-05T07:29:30.657117+0000","last_became_peered":"2024-09-05T07:29:30.657117+0000","last_unstale":"2024-09-05T07:57:10.320160+0000","last_undegraded":"2024-09-05T07:57:10.320160+0000","last_fullsized":"2024-09-05T07:57:10.320160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:40.101513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":3534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"24'647","reported_seq":676,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:05.043520+0000","last_change":"2024-09-05T07:29:29.568126+0000","last_active":"2024-09-05T07:57:05.043520+0000","last_peered":"2024-09-05T07:57:05.043520+0000","last_clean":"2024-09-05T07:57:05.043520+0000","last_became_active":"2024-09-05T07:29:29.567846+0000","last_became_peered":"2024-09-05T07:29:29.567846+0000","last_unstale":"2024-09-05T07:57:05.043520+0000","last_undegraded":"2024-09-05T07:57:05.043520+0000","last_fullsized":"2024-09-05T07:57:05.043520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:48:25.900221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195510,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":639,"num_write_kb":4403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"24'89","reported_seq":116,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.358386+0000","last_change":"2024-09-05T07:29:30.557504+0000","last_active":"2024-09-05T07:57:10.358386+0000","last_peered":"2024-09-05T07:57:10.358386+0000","last_clean":"2024-09-05T07:57:10.358386+0000","last_became_active":"2024-09-05T07:29:30.557203+0000","last_became_peered":"2024-09-05T07:29:30.557203+0000","last_unstale":"2024-09-05T07:57:10.358386+0000","last_undegraded":"2024-09-05T07:57:10.358386+0000","last_fullsized":"2024-09-05T07:57:10.358386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:55:13.742728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":6286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"24'598","reported_seq":627,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:54:31.541138+0000","last_change":"2024-09-05T07:29:29.524587+0000","last_active":"2024-09-05T07:54:31.541138+0000","last_peered":"2024-09-05T07:54:31.541138+0000","last_clean":"2024-09-05T07:54:31.541138+0000","last_became_active":"2024-09-05T07:29:29.524321+0000","last_became_peered":"2024-09-05T07:29:29.524321+0000","last_unstale":"2024-09-05T07:54:31.541138+0000","last_undegraded":"2024-09-05T07:54:31.541138+0000","last_fullsized":"2024-09-05T07:54:31.541138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":598,"log_dups_size":0,"ondisk_log_size":598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:53:13.376716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"24'6","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:56:53.384231+0000","last_change":"2024-09-05T07:29:29.570879+0000","last_active":"2024-09-05T07:56:53.384231+0000","last_peered":"2024-09-05T07:56:53.384231+0000","last_clean":"2024-09-05T07:56:53.384231+0000","last_became_active":"2024-09-05T07:29:29.570456+0000","last_became_peered":"2024-09-05T07:29:29.570456+0000","last_unstale":"2024-09-05T07:56:53.384231+0000","last_undegraded":"2024-09-05T07:56:53.384231+0000","last_fullsized":"2024-09-05T07:56:53.384231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:52:54.638586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"24'84","reported_seq":111,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.318416+0000","last_change":"2024-09-05T07:29:30.657364+0000","last_active":"2024-09-05T07:57:10.318416+0000","last_peered":"2024-09-05T07:57:10.318416+0000","last_clean":"2024-09-05T07:57:10.318416+0000","last_became_active":"2024-09-05T07:29:30.657008+0000","last_became_peered":"2024-09-05T07:29:30.657008+0000","last_unstale":"2024-09-05T07:57:10.318416+0000","last_undegraded":"2024-09-05T07:57:10.318416+0000","last_fullsized":"2024-09-05T07:57:10.318416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:36:59.967135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":7830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"24'7","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:56:49.948482+0000","last_change":"2024-09-05T07:29:29.562802+0000","last_active":"2024-09-05T07:56:49.948482+0000","last_peered":"2024-09-05T07:56:49.948482+0000","last_clean":"2024-09-05T07:56:49.948482+0000","last_became_active":"2024-09-05T07:29:29.562520+0000","last_became_peered":"2024-09-05T07:29:29.562520+0000","last_unstale":"2024-09-05T07:56:49.948482+0000","last_undegraded":"2024-09-05T07:56:49.948482+0000","last_fullsized":"2024-09-05T07:56:49.948482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:34:16.308797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"24'88","reported_seq":115,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.358272+0000","last_change":"2024-09-05T07:29:30.563197+0000","last_active":"2024-09-05T07:57:10.358272+0000","last_peered":"2024-09-05T07:57:10.358272+0000","last_clean":"2024-09-05T07:57:10.358272+0000","last_became_active":"2024-09-05T07:29:30.562945+0000","last_became_peered":"2024-09-05T07:29:30.562945+0000","last_unstale":"2024-09-05T07:57:10.358272+0000","last_undegraded":"2024-09-05T07:57:10.358272+0000","last_fullsized":"2024-09-05T07:57:10.358272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:31:37.754325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"24'14","reported_seq":43,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.079133+0000","last_change":"2024-09-05T07:29:29.559012+0000","last_active":"2024-09-05T07:57:10.079133+0000","last_peered":"2024-09-05T07:57:10.079133+0000","last_clean":"2024-09-05T07:57:10.079133+0000","last_became_active":"2024-09-05T07:29:29.558744+0000","last_became_peered":"2024-09-05T07:29:29.558744+0000","last_unstale":"2024-09-05T07:57:10.079133+0000","last_undegraded":"2024-09-05T07:57:10.079133+0000","last_fullsized":"2024-09-05T07:57:10.079133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:28:41.630593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"24'98","reported_seq":125,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.357735+0000","last_change":"2024-09-05T07:29:30.641594+0000","last_active":"2024-09-05T07:57:10.357735+0000","last_peered":"2024-09-05T07:57:10.357735+0000","last_clean":"2024-09-05T07:57:10.357735+0000","last_became_active":"2024-09-05T07:29:30.641360+0000","last_became_peered":"2024-09-05T07:29:30.641360+0000","last_unstale":"2024-09-05T07:57:10.357735+0000","last_undegraded":"2024-09-05T07:57:10.357735+0000","last_fullsized":"2024-09-05T07:57:10.357735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:49:40.327718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":5807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"24'8","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:02.687264+0000","last_change":"2024-09-05T07:29:29.559998+0000","last_active":"2024-09-05T07:57:02.687264+0000","last_peered":"2024-09-05T07:57:02.687264+0000","last_clean":"2024-09-05T07:57:02.687264+0000","last_became_active":"2024-09-05T07:29:29.559717+0000","last_became_peered":"2024-09-05T07:29:29.559717+0000","last_unstale":"2024-09-05T07:57:02.687264+0000","last_undegraded":"2024-09-05T07:57:02.687264+0000","last_fullsized":"2024-09-05T07:57:02.687264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:58.513308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"24'57","reported_seq":84,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.314763+0000","last_change":"2024-09-05T07:29:30.657727+0000","last_active":"2024-09-05T07:57:10.314763+0000","last_peered":"2024-09-05T07:57:10.314763+0000","last_clean":"2024-09-05T07:57:10.314763+0000","last_became_active":"2024-09-05T07:29:30.657038+0000","last_became_peered":"2024-09-05T07:29:30.657038+0000","last_unstale":"2024-09-05T07:57:10.314763+0000","last_undegraded":"2024-09-05T07:57:10.314763+0000","last_fullsized":"2024-09-05T07:57:10.314763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:00:35.625571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":3450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"24'613","reported_seq":642,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:09.740261+0000","last_change":"2024-09-05T07:29:29.566840+0000","last_active":"2024-09-05T07:57:09.740261+0000","last_peered":"2024-09-05T07:57:09.740261+0000","last_clean":"2024-09-05T07:57:09.740261+0000","last_became_active":"2024-09-05T07:29:29.566501+0000","last_became_peered":"2024-09-05T07:29:29.566501+0000","last_unstale":"2024-09-05T07:57:09.740261+0000","last_undegraded":"2024-09-05T07:57:09.740261+0000","last_fullsized":"2024-09-05T07:57:09.740261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:47:57.187710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":613,"num_write_kb":614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"24'72","reported_seq":99,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.303889+0000","last_change":"2024-09-05T07:29:30.642252+0000","last_active":"2024-09-05T07:57:10.303889+0000","last_peered":"2024-09-05T07:57:10.303889+0000","last_clean":"2024-09-05T07:57:10.303889+0000","last_became_active":"2024-09-05T07:29:30.641991+0000","last_became_peered":"2024-09-05T07:29:30.641991+0000","last_unstale":"2024-09-05T07:57:10.303889+0000","last_undegraded":"2024-09-05T07:57:10.303889+0000","last_fullsized":"2024-09-05T07:57:10.303889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:42:04.216273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":2982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"24'832","reported_seq":861,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:00.513516+0000","last_change":"2024-09-05T07:29:29.562441+0000","last_active":"2024-09-05T07:57:00.513516+0000","last_peered":"2024-09-05T07:57:00.513516+0000","last_clean":"2024-09-05T07:57:00.513516+0000","last_became_active":"2024-09-05T07:29:29.562136+0000","last_became_peered":"2024-09-05T07:29:29.562136+0000","last_unstale":"2024-09-05T07:57:00.513516+0000","last_undegraded":"2024-09-05T07:57:00.513516+0000","last_fullsized":"2024-09-05T07:57:00.513516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:06:20.633881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":830,"num_write_kb":4536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"24'66","reported_seq":93,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.339442+0000","last_change":"2024-09-05T07:29:30.633033+0000","last_active":"2024-09-05T07:57:10.339442+0000","last_peered":"2024-09-05T07:57:10.339442+0000","last_clean":"2024-09-05T07:57:10.339442+0000","last_became_active":"2024-09-05T07:29:30.632784+0000","last_became_peered":"2024-09-05T07:29:30.632784+0000","last_unstale":"2024-09-05T07:57:10.339442+0000","last_undegraded":"2024-09-05T07:57:10.339442+0000","last_fullsized":"2024-09-05T07:57:10.339442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:03:07.788844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":3605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'14","reported_seq":43,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:02.687518+0000","last_change":"2024-09-05T07:29:29.567195+0000","last_active":"2024-09-05T07:57:02.687518+0000","last_peered":"2024-09-05T07:57:02.687518+0000","last_clean":"2024-09-05T07:57:02.687518+0000","last_became_active":"2024-09-05T07:29:29.566934+0000","last_became_peered":"2024-09-05T07:29:29.566934+0000","last_unstale":"2024-09-05T07:57:02.687518+0000","last_undegraded":"2024-09-05T07:57:02.687518+0000","last_fullsized":"2024-09-05T07:57:02.687518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:10:28.438071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"24'76","reported_seq":103,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.298339+0000","last_change":"2024-09-05T07:29:30.632260+0000","last_active":"2024-09-05T07:57:10.298339+0000","last_peered":"2024-09-05T07:57:10.298339+0000","last_clean":"2024-09-05T07:57:10.298339+0000","last_became_active":"2024-09-05T07:29:30.631974+0000","last_became_peered":"2024-09-05T07:29:30.631974+0000","last_unstale":"2024-09-05T07:57:10.298339+0000","last_undegraded":"2024-09-05T07:57:10.298339+0000","last_fullsized":"2024-09-05T07:57:10.298339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:45:00.967978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"24'10","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:09.707101+0000","last_change":"2024-09-05T07:29:29.567028+0000","last_active":"2024-09-05T07:57:09.707101+0000","last_peered":"2024-09-05T07:57:09.707101+0000","last_clean":"2024-09-05T07:57:09.707101+0000","last_became_active":"2024-09-05T07:29:29.566754+0000","last_became_peered":"2024-09-05T07:29:29.566754+0000","last_unstale":"2024-09-05T07:57:09.707101+0000","last_undegraded":"2024-09-05T07:57:09.707101+0000","last_fullsized":"2024-09-05T07:57:09.707101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:49:13.565181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"24'97","reported_seq":124,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.302295+0000","last_change":"2024-09-05T07:29:30.558658+0000","last_active":"2024-09-05T07:57:10.302295+0000","last_peered":"2024-09-05T07:57:10.302295+0000","last_clean":"2024-09-05T07:57:10.302295+0000","last_became_active":"2024-09-05T07:29:30.558179+0000","last_became_peered":"2024-09-05T07:29:30.558179+0000","last_unstale":"2024-09-05T07:57:10.302295+0000","last_undegraded":"2024-09-05T07:57:10.302295+0000","last_fullsized":"2024-09-05T07:57:10.302295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:44:13.003367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":15470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"24'10","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:07.727452+0000","last_change":"2024-09-05T07:29:29.525420+0000","last_active":"2024-09-05T07:57:07.727452+0000","last_peered":"2024-09-05T07:57:07.727452+0000","last_clean":"2024-09-05T07:57:07.727452+0000","last_became_active":"2024-09-05T07:29:29.525139+0000","last_became_peered":"2024-09-05T07:29:29.525139+0000","last_unstale":"2024-09-05T07:57:07.727452+0000","last_undegraded":"2024-09-05T07:57:07.727452+0000","last_fullsized":"2024-09-05T07:57:07.727452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:54:00.339029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1172,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"24'53","reported_seq":80,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.316662+0000","last_change":"2024-09-05T07:29:30.659606+0000","last_active":"2024-09-05T07:57:10.316662+0000","last_peered":"2024-09-05T07:57:10.316662+0000","last_clean":"2024-09-05T07:57:10.316662+0000","last_became_active":"2024-09-05T07:29:30.659311+0000","last_became_peered":"2024-09-05T07:29:30.659311+0000","last_unstale":"2024-09-05T07:57:10.316662+0000","last_undegraded":"2024-09-05T07:57:10.316662+0000","last_fullsized":"2024-09-05T07:57:10.316662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:54:01.479214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":2804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"24'22","reported_seq":51,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:07.724968+0000","last_change":"2024-09-05T07:29:29.566784+0000","last_active":"2024-09-05T07:57:07.724968+0000","last_peered":"2024-09-05T07:57:07.724968+0000","last_clean":"2024-09-05T07:57:07.724968+0000","last_became_active":"2024-09-05T07:29:29.566503+0000","last_became_peered":"2024-09-05T07:29:29.566503+0000","last_unstale":"2024-09-05T07:57:07.724968+0000","last_undegraded":"2024-09-05T07:57:07.724968+0000","last_fullsized":"2024-09-05T07:57:07.724968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:35:54.465221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"24'65","reported_seq":92,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.290685+0000","last_change":"2024-09-05T07:29:30.641565+0000","last_active":"2024-09-05T07:57:10.290685+0000","last_peered":"2024-09-05T07:57:10.290685+0000","last_clean":"2024-09-05T07:57:10.290685+0000","last_became_active":"2024-09-05T07:29:30.641309+0000","last_became_peered":"2024-09-05T07:29:30.641309+0000","last_unstale":"2024-09-05T07:57:10.290685+0000","last_undegraded":"2024-09-05T07:57:10.290685+0000","last_fullsized":"2024-09-05T07:57:10.290685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:37:28.088603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":5311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"24'6","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:00.512888+0000","last_change":"2024-09-05T07:29:29.524793+0000","last_active":"2024-09-05T07:57:00.512888+0000","last_peered":"2024-09-05T07:57:00.512888+0000","last_clean":"2024-09-05T07:57:00.512888+0000","last_became_active":"2024-09-05T07:29:29.524522+0000","last_became_peered":"2024-09-05T07:29:29.524522+0000","last_unstale":"2024-09-05T07:57:00.512888+0000","last_undegraded":"2024-09-05T07:57:00.512888+0000","last_fullsized":"2024-09-05T07:57:00.512888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:41.797972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"24'36","reported_seq":64,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.348352+0000","last_change":"2024-09-05T07:29:30.642565+0000","last_active":"2024-09-05T07:57:10.348352+0000","last_peered":"2024-09-05T07:57:10.348352+0000","last_clean":"2024-09-05T07:57:10.348352+0000","last_became_active":"2024-09-05T07:29:30.641774+0000","last_became_peered":"2024-09-05T07:29:30.641774+0000","last_unstale":"2024-09-05T07:57:10.348352+0000","last_undegraded":"2024-09-05T07:57:10.348352+0000","last_fullsized":"2024-09-05T07:57:10.348352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:09:36.911425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"24'7","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:04.683555+0000","last_change":"2024-09-05T07:29:29.525374+0000","last_active":"2024-09-05T07:57:04.683555+0000","last_peered":"2024-09-05T07:57:04.683555+0000","last_clean":"2024-09-05T07:57:04.683555+0000","last_became_active":"2024-09-05T07:29:29.525044+0000","last_became_peered":"2024-09-05T07:29:29.525044+0000","last_unstale":"2024-09-05T07:57:04.683555+0000","last_undegraded":"2024-09-05T07:57:04.683555+0000","last_fullsized":"2024-09-05T07:57:04.683555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:25:35.862773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"24'52","reported_seq":80,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.346677+0000","last_change":"2024-09-05T07:29:30.563669+0000","last_active":"2024-09-05T07:57:10.346677+0000","last_peered":"2024-09-05T07:57:10.346677+0000","last_clean":"2024-09-05T07:57:10.346677+0000","last_became_active":"2024-09-05T07:29:30.563408+0000","last_became_peered":"2024-09-05T07:29:30.563408+0000","last_unstale":"2024-09-05T07:57:10.346677+0000","last_undegraded":"2024-09-05T07:57:10.346677+0000","last_fullsized":"2024-09-05T07:57:10.346677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:42:04.216273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":3705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'6","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:56:58.387111+0000","last_change":"2024-09-05T07:29:29.559111+0000","last_active":"2024-09-05T07:56:58.387111+0000","last_peered":"2024-09-05T07:56:58.387111+0000","last_clean":"2024-09-05T07:56:58.387111+0000","last_became_active":"2024-09-05T07:29:29.558856+0000","last_became_peered":"2024-09-05T07:29:29.558856+0000","last_unstale":"2024-09-05T07:56:58.387111+0000","last_undegraded":"2024-09-05T07:56:58.387111+0000","last_fullsized":"2024-09-05T07:56:58.387111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:47:57.187710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"24'61","reported_seq":89,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.339287+0000","last_change":"2024-09-05T07:29:30.624401+0000","last_active":"2024-09-05T07:57:10.339287+0000","last_peered":"2024-09-05T07:57:10.339287+0000","last_clean":"2024-09-05T07:57:10.339287+0000","last_became_active":"2024-09-05T07:29:30.624057+0000","last_became_peered":"2024-09-05T07:29:30.624057+0000","last_unstale":"2024-09-05T07:57:10.339287+0000","last_undegraded":"2024-09-05T07:57:10.339287+0000","last_fullsized":"2024-09-05T07:57:10.339287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:36:59.967135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":4070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"24'14","reported_seq":44,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:09.732085+0000","last_change":"2024-09-05T07:29:29.570940+0000","last_active":"2024-09-05T07:57:09.732085+0000","last_peered":"2024-09-05T07:57:09.732085+0000","last_clean":"2024-09-05T07:57:09.732085+0000","last_became_active":"2024-09-05T07:29:29.570478+0000","last_became_peered":"2024-09-05T07:29:29.570478+0000","last_unstale":"2024-09-05T07:57:09.732085+0000","last_undegraded":"2024-09-05T07:57:09.732085+0000","last_fullsized":"2024-09-05T07:57:09.732085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:35:54.465221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1754,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"24'65","reported_seq":93,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.298478+0000","last_change":"2024-09-05T07:29:30.563109+0000","last_active":"2024-09-05T07:57:10.298478+0000","last_peered":"2024-09-05T07:57:10.298478+0000","last_clean":"2024-09-05T07:57:10.298478+0000","last_became_active":"2024-09-05T07:29:30.562824+0000","last_became_peered":"2024-09-05T07:29:30.562824+0000","last_unstale":"2024-09-05T07:57:10.298478+0000","last_undegraded":"2024-09-05T07:57:10.298478+0000","last_fullsized":"2024-09-05T07:57:10.298478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:42:02.212868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":2542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":188,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:53:16.573037+0000","last_change":"2024-09-05T07:29:13.366600+0000","last_active":"2024-09-05T07:53:16.573037+0000","last_peered":"2024-09-05T07:53:16.573037+0000","last_clean":"2024-09-05T07:53:16.573037+0000","last_became_active":"2024-09-05T07:29:13.365841+0000","last_became_peered":"2024-09-05T07:29:13.365841+0000","last_unstale":"2024-09-05T07:53:16.573037+0000","last_undegraded":"2024-09-05T07:53:16.573037+0000","last_fullsized":"2024-09-05T07:53:16.573037+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:10.874807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:10.874807+0000","last_clean_scrub_stamp":"2024-09-05T07:29:10.874807+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:21:17.673107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"22'6","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:54:31.541160+0000","last_change":"2024-09-05T07:29:29.563604+0000","last_active":"2024-09-05T07:54:31.541160+0000","last_peered":"2024-09-05T07:54:31.541160+0000","last_clean":"2024-09-05T07:54:31.541160+0000","last_became_active":"2024-09-05T07:29:29.562956+0000","last_became_peered":"2024-09-05T07:29:29.562956+0000","last_unstale":"2024-09-05T07:54:31.541160+0000","last_undegraded":"2024-09-05T07:54:31.541160+0000","last_fullsized":"2024-09-05T07:54:31.541160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:41.797972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"24'54","reported_seq":83,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.355759+0000","last_change":"2024-09-05T07:29:30.641543+0000","last_active":"2024-09-05T07:57:10.355759+0000","last_peered":"2024-09-05T07:57:10.355759+0000","last_clean":"2024-09-05T07:57:10.355759+0000","last_became_active":"2024-09-05T07:29:30.641243+0000","last_became_peered":"2024-09-05T07:29:30.641243+0000","last_unstale":"2024-09-05T07:57:10.355759+0000","last_undegraded":"2024-09-05T07:57:10.355759+0000","last_fullsized":"2024-09-05T07:57:10.355759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:34:54.335152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":3733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"24'323","reported_seq":354,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.091544+0000","last_change":"2024-09-05T07:29:29.479329+0000","last_active":"2024-09-05T07:57:10.091544+0000","last_peered":"2024-09-05T07:57:10.091544+0000","last_clean":"2024-09-05T07:57:10.091544+0000","last_became_active":"2024-09-05T07:29:29.479005+0000","last_became_peered":"2024-09-05T07:29:29.479005+0000","last_unstale":"2024-09-05T07:57:10.091544+0000","last_undegraded":"2024-09-05T07:57:10.091544+0000","last_fullsized":"2024-09-05T07:57:10.091544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:49:39.187534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3479043,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":3552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"24'55","reported_seq":84,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.295183+0000","last_change":"2024-09-05T07:29:30.641557+0000","last_active":"2024-09-05T07:57:10.295183+0000","last_peered":"2024-09-05T07:57:10.295183+0000","last_clean":"2024-09-05T07:57:10.295183+0000","last_became_active":"2024-09-05T07:29:30.641269+0000","last_became_peered":"2024-09-05T07:29:30.641269+0000","last_unstale":"2024-09-05T07:57:10.295183+0000","last_undegraded":"2024-09-05T07:57:10.295183+0000","last_fullsized":"2024-09-05T07:57:10.295183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:32:30.263430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":2599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"24'880","reported_seq":1780,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.687136+0000","last_change":"2024-09-05T07:29:29.568835+0000","last_active":"2024-09-05T07:57:10.687136+0000","last_peered":"2024-09-05T07:57:10.687136+0000","last_clean":"2024-09-05T07:57:10.687136+0000","last_became_active":"2024-09-05T07:29:29.568576+0000","last_became_peered":"2024-09-05T07:29:29.568576+0000","last_unstale":"2024-09-05T07:57:10.687136+0000","last_undegraded":"2024-09-05T07:57:10.687136+0000","last_fullsized":"2024-09-05T07:57:10.687136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:05:05.417016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182215,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":869,"num_read_kb":916,"num_write":877,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"24'71","reported_seq":100,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.317538+0000","last_change":"2024-09-05T07:29:30.660008+0000","last_active":"2024-09-05T07:57:10.317538+0000","last_peered":"2024-09-05T07:57:10.317538+0000","last_clean":"2024-09-05T07:57:10.317538+0000","last_became_active":"2024-09-05T07:29:30.659720+0000","last_became_peered":"2024-09-05T07:29:30.659720+0000","last_unstale":"2024-09-05T07:57:10.317538+0000","last_undegraded":"2024-09-05T07:57:10.317538+0000","last_fullsized":"2024-09-05T07:57:10.317538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:42:04.216273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":2450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"24'8","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:00.601508+0000","last_change":"2024-09-05T07:29:29.568569+0000","last_active":"2024-09-05T07:57:00.601508+0000","last_peered":"2024-09-05T07:57:00.601508+0000","last_clean":"2024-09-05T07:57:00.601508+0000","last_became_active":"2024-09-05T07:29:29.568307+0000","last_became_peered":"2024-09-05T07:29:29.568307+0000","last_unstale":"2024-09-05T07:57:00.601508+0000","last_undegraded":"2024-09-05T07:57:00.601508+0000","last_fullsized":"2024-09-05T07:57:00.601508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:12:38.814463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"24'89","reported_seq":118,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.332346+0000","last_change":"2024-09-05T07:29:30.642687+0000","last_active":"2024-09-05T07:57:10.332346+0000","last_peered":"2024-09-05T07:57:10.332346+0000","last_clean":"2024-09-05T07:57:10.332346+0000","last_became_active":"2024-09-05T07:29:30.642414+0000","last_became_peered":"2024-09-05T07:29:30.642414+0000","last_unstale":"2024-09-05T07:57:10.332346+0000","last_undegraded":"2024-09-05T07:57:10.332346+0000","last_fullsized":"2024-09-05T07:57:10.332346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:01:34.217228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":7430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"24'5","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:02.684653+0000","last_change":"2024-09-05T07:29:29.568739+0000","last_active":"2024-09-05T07:57:02.684653+0000","last_peered":"2024-09-05T07:57:02.684653+0000","last_clean":"2024-09-05T07:57:02.684653+0000","last_became_active":"2024-09-05T07:29:29.568499+0000","last_became_peered":"2024-09-05T07:29:29.568499+0000","last_unstale":"2024-09-05T07:57:02.684653+0000","last_undegraded":"2024-09-05T07:57:02.684653+0000","last_fullsized":"2024-09-05T07:57:02.684653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:05:05.417016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"24'66","reported_seq":95,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.351595+0000","last_change":"2024-09-05T07:29:30.641340+0000","last_active":"2024-09-05T07:57:10.351595+0000","last_peered":"2024-09-05T07:57:10.351595+0000","last_clean":"2024-09-05T07:57:10.351595+0000","last_became_active":"2024-09-05T07:29:30.640805+0000","last_became_peered":"2024-09-05T07:29:30.640805+0000","last_unstale":"2024-09-05T07:57:10.351595+0000","last_undegraded":"2024-09-05T07:57:10.351595+0000","last_fullsized":"2024-09-05T07:57:10.351595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:59.653492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":1781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"24'8","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:04.908697+0000","last_change":"2024-09-05T07:29:29.525212+0000","last_active":"2024-09-05T07:57:04.908697+0000","last_peered":"2024-09-05T07:57:04.908697+0000","last_clean":"2024-09-05T07:57:04.908697+0000","last_became_active":"2024-09-05T07:29:29.524918+0000","last_became_peered":"2024-09-05T07:29:29.524918+0000","last_unstale":"2024-09-05T07:57:04.908697+0000","last_undegraded":"2024-09-05T07:57:04.908697+0000","last_fullsized":"2024-09-05T07:57:04.908697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:09:35.771241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"24'64","reported_seq":93,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.294385+0000","last_change":"2024-09-05T07:29:30.658407+0000","last_active":"2024-09-05T07:57:10.294385+0000","last_peered":"2024-09-05T07:57:10.294385+0000","last_clean":"2024-09-05T07:57:10.294385+0000","last_became_active":"2024-09-05T07:29:30.658155+0000","last_became_peered":"2024-09-05T07:29:30.658155+0000","last_unstale":"2024-09-05T07:57:10.294385+0000","last_undegraded":"2024-09-05T07:57:10.294385+0000","last_fullsized":"2024-09-05T07:57:10.294385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:52:56.756904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":2545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"24'1349","reported_seq":1379,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:09.621151+0000","last_change":"2024-09-05T07:29:29.526674+0000","last_active":"2024-09-05T07:57:09.621151+0000","last_peered":"2024-09-05T07:57:09.621151+0000","last_clean":"2024-09-05T07:57:09.621151+0000","last_became_active":"2024-09-05T07:29:29.526421+0000","last_became_peered":"2024-09-05T07:29:29.526421+0000","last_unstale":"2024-09-05T07:57:09.621151+0000","last_undegraded":"2024-09-05T07:57:09.621151+0000","last_fullsized":"2024-09-05T07:57:09.621151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":1349,"log_dups_size":0,"ondisk_log_size":1349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:52:13.496606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3429,"num_write_kb":1221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"24'72","reported_seq":100,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.357110+0000","last_change":"2024-09-05T07:29:30.633806+0000","last_active":"2024-09-05T07:57:10.357110+0000","last_peered":"2024-09-05T07:57:10.357110+0000","last_clean":"2024-09-05T07:57:10.357110+0000","last_became_active":"2024-09-05T07:29:30.633535+0000","last_became_peered":"2024-09-05T07:29:30.633535+0000","last_unstale":"2024-09-05T07:57:10.357110+0000","last_undegraded":"2024-09-05T07:57:10.357110+0000","last_fullsized":"2024-09-05T07:57:10.357110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:40:35.334862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"24'12","reported_seq":42,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:04.909123+0000","last_change":"2024-09-05T07:29:29.524532+0000","last_active":"2024-09-05T07:57:04.909123+0000","last_peered":"2024-09-05T07:57:04.909123+0000","last_clean":"2024-09-05T07:57:04.909123+0000","last_became_active":"2024-09-05T07:29:29.524268+0000","last_became_peered":"2024-09-05T07:29:29.524268+0000","last_unstale":"2024-09-05T07:57:04.909123+0000","last_undegraded":"2024-09-05T07:57:04.909123+0000","last_fullsized":"2024-09-05T07:57:04.909123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:58.513308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'84","reported_seq":112,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.357971+0000","last_change":"2024-09-05T07:29:30.624431+0000","last_active":"2024-09-05T07:57:10.357971+0000","last_peered":"2024-09-05T07:57:10.357971+0000","last_clean":"2024-09-05T07:57:10.357971+0000","last_became_active":"2024-09-05T07:29:30.624117+0000","last_became_peered":"2024-09-05T07:29:30.624117+0000","last_unstale":"2024-09-05T07:57:10.357971+0000","last_undegraded":"2024-09-05T07:57:10.357971+0000","last_fullsized":"2024-09-05T07:57:10.357971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:10:00.845713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":5195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'9","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:07.727533+0000","last_change":"2024-09-05T07:29:29.561285+0000","last_active":"2024-09-05T07:57:07.727533+0000","last_peered":"2024-09-05T07:57:07.727533+0000","last_clean":"2024-09-05T07:57:07.727533+0000","last_became_active":"2024-09-05T07:29:29.561026+0000","last_became_peered":"2024-09-05T07:29:29.561026+0000","last_unstale":"2024-09-05T07:57:07.727533+0000","last_undegraded":"2024-09-05T07:57:07.727533+0000","last_fullsized":"2024-09-05T07:57:07.727533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:48:25.900221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"24'80","reported_seq":108,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:56:44.931312+0000","last_change":"2024-09-05T07:29:30.556889+0000","last_active":"2024-09-05T07:56:44.931312+0000","last_peered":"2024-09-05T07:56:44.931312+0000","last_clean":"2024-09-05T07:56:44.931312+0000","last_became_active":"2024-09-05T07:29:30.556627+0000","last_became_peered":"2024-09-05T07:29:30.556627+0000","last_unstale":"2024-09-05T07:56:44.931312+0000","last_undegraded":"2024-09-05T07:56:44.931312+0000","last_fullsized":"2024-09-05T07:56:44.931312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:20:01.152157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":7503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"24'11","reported_seq":41,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:56:58.431425+0000","last_change":"2024-09-05T07:29:29.526873+0000","last_active":"2024-09-05T07:56:58.431425+0000","last_peered":"2024-09-05T07:56:58.431425+0000","last_clean":"2024-09-05T07:56:58.431425+0000","last_became_active":"2024-09-05T07:29:29.526572+0000","last_became_peered":"2024-09-05T07:29:29.526572+0000","last_unstale":"2024-09-05T07:56:58.431425+0000","last_undegraded":"2024-09-05T07:56:58.431425+0000","last_fullsized":"2024-09-05T07:56:58.431425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:33:14.122911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"24'71","reported_seq":99,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.357807+0000","last_change":"2024-09-05T07:29:30.624592+0000","last_active":"2024-09-05T07:57:10.357807+0000","last_peered":"2024-09-05T07:57:10.357807+0000","last_clean":"2024-09-05T07:57:10.357807+0000","last_became_active":"2024-09-05T07:29:30.624109+0000","last_became_peered":"2024-09-05T07:29:30.624109+0000","last_unstale":"2024-09-05T07:57:10.357807+0000","last_undegraded":"2024-09-05T07:57:10.357807+0000","last_fullsized":"2024-09-05T07:57:10.357807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:22:35.613478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":2208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"24'5","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:56:47.894301+0000","last_change":"2024-09-05T07:29:29.569816+0000","last_active":"2024-09-05T07:56:47.894301+0000","last_peered":"2024-09-05T07:56:47.894301+0000","last_clean":"2024-09-05T07:56:47.894301+0000","last_became_active":"2024-09-05T07:29:29.569536+0000","last_became_peered":"2024-09-05T07:29:29.569536+0000","last_unstale":"2024-09-05T07:56:47.894301+0000","last_undegraded":"2024-09-05T07:56:47.894301+0000","last_fullsized":"2024-09-05T07:56:47.894301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:59:18.418220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"24'86","reported_seq":114,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.326387+0000","last_change":"2024-09-05T07:29:30.632805+0000","last_active":"2024-09-05T07:57:10.326387+0000","last_peered":"2024-09-05T07:57:10.326387+0000","last_clean":"2024-09-05T07:57:10.326387+0000","last_became_active":"2024-09-05T07:29:30.632502+0000","last_became_peered":"2024-09-05T07:29:30.632502+0000","last_unstale":"2024-09-05T07:57:10.326387+0000","last_undegraded":"2024-09-05T07:57:10.326387+0000","last_fullsized":"2024-09-05T07:57:10.326387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:59.653492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":4049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"24'545","reported_seq":575,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:02.691674+0000","last_change":"2024-09-05T07:29:29.563821+0000","last_active":"2024-09-05T07:57:02.691674+0000","last_peered":"2024-09-05T07:57:02.691674+0000","last_clean":"2024-09-05T07:57:02.691674+0000","last_became_active":"2024-09-05T07:29:29.563316+0000","last_became_peered":"2024-09-05T07:29:29.563316+0000","last_unstale":"2024-09-05T07:57:02.691674+0000","last_undegraded":"2024-09-05T07:57:02.691674+0000","last_fullsized":"2024-09-05T07:57:02.691674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:38.961328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":542,"num_write_kb":4368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"24'76","reported_seq":104,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.303070+0000","last_change":"2024-09-05T07:29:30.563106+0000","last_active":"2024-09-05T07:57:10.303070+0000","last_peered":"2024-09-05T07:57:10.303070+0000","last_clean":"2024-09-05T07:57:10.303070+0000","last_became_active":"2024-09-05T07:29:30.562776+0000","last_became_peered":"2024-09-05T07:29:30.562776+0000","last_unstale":"2024-09-05T07:57:10.303070+0000","last_undegraded":"2024-09-05T07:57:10.303070+0000","last_fullsized":"2024-09-05T07:57:10.303070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:37:16.174244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":1880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"24'79","reported_seq":106,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.297970+0000","last_change":"2024-09-05T07:29:30.558029+0000","last_active":"2024-09-05T07:57:10.297970+0000","last_peered":"2024-09-05T07:57:10.297970+0000","last_clean":"2024-09-05T07:57:10.297970+0000","last_became_active":"2024-09-05T07:29:30.557747+0000","last_became_peered":"2024-09-05T07:29:30.557747+0000","last_unstale":"2024-09-05T07:57:10.297970+0000","last_undegraded":"2024-09-05T07:57:10.297970+0000","last_fullsized":"2024-09-05T07:57:10.297970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:55:28.983976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":6364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"24'9","reported_seq":38,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:02.742338+0000","last_change":"2024-09-05T07:29:29.561333+0000","last_active":"2024-09-05T07:57:02.742338+0000","last_peered":"2024-09-05T07:57:02.742338+0000","last_clean":"2024-09-05T07:57:02.742338+0000","last_became_active":"2024-09-05T07:29:29.561065+0000","last_became_peered":"2024-09-05T07:29:29.561065+0000","last_unstale":"2024-09-05T07:57:02.742338+0000","last_undegraded":"2024-09-05T07:57:02.742338+0000","last_fullsized":"2024-09-05T07:57:02.742338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:38.961328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"24'45","reported_seq":72,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.321239+0000","last_change":"2024-09-05T07:29:30.566028+0000","last_active":"2024-09-05T07:57:10.321239+0000","last_peered":"2024-09-05T07:57:10.321239+0000","last_clean":"2024-09-05T07:57:10.321239+0000","last_became_active":"2024-09-05T07:29:30.565787+0000","last_became_peered":"2024-09-05T07:29:30.565787+0000","last_unstale":"2024-09-05T07:57:10.321239+0000","last_undegraded":"2024-09-05T07:57:10.321239+0000","last_fullsized":"2024-09-05T07:57:10.321239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:59.653492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":3021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"24'1204","reported_seq":1233,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:02.679237+0000","last_change":"2024-09-05T07:29:29.559969+0000","last_active":"2024-09-05T07:57:02.679237+0000","last_peered":"2024-09-05T07:57:02.679237+0000","last_clean":"2024-09-05T07:57:02.679237+0000","last_became_active":"2024-09-05T07:29:29.559675+0000","last_became_peered":"2024-09-05T07:29:29.559675+0000","last_unstale":"2024-09-05T07:57:02.679237+0000","last_undegraded":"2024-09-05T07:57:02.679237+0000","last_fullsized":"2024-09-05T07:57:02.679237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":1204,"log_dups_size":0,"ondisk_log_size":1204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:53:39.010323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1200,"num_write_kb":8869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"24'101","reported_seq":130,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.316956+0000","last_change":"2024-09-05T07:29:30.657369+0000","last_active":"2024-09-05T07:57:10.316956+0000","last_peered":"2024-09-05T07:57:10.316956+0000","last_clean":"2024-09-05T07:57:10.316956+0000","last_became_active":"2024-09-05T07:29:30.656876+0000","last_became_peered":"2024-09-05T07:29:30.656876+0000","last_unstale":"2024-09-05T07:57:10.316956+0000","last_undegraded":"2024-09-05T07:57:10.316956+0000","last_fullsized":"2024-09-05T07:57:10.316956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:09:22.026287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":8259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"24'716","reported_seq":747,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:56:58.419911+0000","last_change":"2024-09-05T07:29:29.567440+0000","last_active":"2024-09-05T07:56:58.419911+0000","last_peered":"2024-09-05T07:56:58.419911+0000","last_clean":"2024-09-05T07:56:58.419911+0000","last_became_active":"2024-09-05T07:29:29.567129+0000","last_became_peered":"2024-09-05T07:29:29.567129+0000","last_unstale":"2024-09-05T07:56:58.419911+0000","last_undegraded":"2024-09-05T07:56:58.419911+0000","last_fullsized":"2024-09-05T07:56:58.419911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":716,"log_dups_size":0,"ondisk_log_size":716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:54:00.339029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":711,"num_write_kb":4517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"24'60","reported_seq":89,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.313108+0000","last_change":"2024-09-05T07:29:30.657929+0000","last_active":"2024-09-05T07:57:10.313108+0000","last_peered":"2024-09-05T07:57:10.313108+0000","last_clean":"2024-09-05T07:57:10.313108+0000","last_became_active":"2024-09-05T07:29:30.657625+0000","last_became_peered":"2024-09-05T07:29:30.657625+0000","last_unstale":"2024-09-05T07:57:10.313108+0000","last_undegraded":"2024-09-05T07:57:10.313108+0000","last_fullsized":"2024-09-05T07:57:10.313108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:37:46.507371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":2166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"24'587","reported_seq":618,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:56:53.509229+0000","last_change":"2024-09-05T07:29:29.526099+0000","last_active":"2024-09-05T07:56:53.509229+0000","last_peered":"2024-09-05T07:56:53.509229+0000","last_clean":"2024-09-05T07:56:53.509229+0000","last_became_active":"2024-09-05T07:29:29.525832+0000","last_became_peered":"2024-09-05T07:29:29.525832+0000","last_unstale":"2024-09-05T07:56:53.509229+0000","last_undegraded":"2024-09-05T07:56:53.509229+0000","last_fullsized":"2024-09-05T07:56:53.509229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:44:32.741898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3789,"num_write_kb":295314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4716,"ondisk_log_size":4716,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":37224424,"num_objects":107,"num_object_clones":0,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":869,"num_read_kb":916,"num_write":10470,"num_write_kb":41817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":74694656,"data_stored":74448848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8491,"ondisk_log_size":8491,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719477078,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61848,"kb_used_data":12616,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94309992,"statfs":{"total":96636764160,"available":96573431808,"internally_reserved":0,"allocated":12918784,"data_stored":12730197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509781,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35736,"kb_used_data":4552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94336104,"statfs":{"total":96636764160,"available":96600170496,"internally_reserved":0,"allocated":4661248,"data_stored":4466126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509781,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47156,"kb_used_data":15972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94324684,"statfs":{"total":96636764160,"available":96588476416,"internally_reserved":0,"allocated":16355328,"data_stored":16153926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509781,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47952,"kb_used_data":8448,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323888,"statfs":{"total":96636764160,"available":96587661312,"internally_reserved":0,"allocated":8650752,"data_stored":8478013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509780,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48536,"kb_used_data":9032,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323304,"statfs":{"total":96636764160,"available":96587063296,"internally_reserved":0,"allocated":9248768,"data_stored":9069055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509780,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47908,"kb_used_data":12564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323932,"statfs":{"total":96636764160,"available":96587706368,"internally_reserved":0,"allocated":12865536,"data_stored":12675287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542486,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43860,"kb_used_data":4356,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327980,"statfs":{"total":96636764160,"available":96591851520,"internally_reserved":0,"allocated":4460544,"data_stored":4286517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542485,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43828,"kb_used_data":8484,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94328012,"statfs":{"total":96636764160,"available":96591884288,"internally_reserved":0,"allocated":8687616,"data_stored":8479783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12619776,"data_stored":12586622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8409088,"data_stored":8390022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16109568,"data_stored":16065261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8441856,"data_stored":8391118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12079104,"data_stored":12051164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4214784,"data_stored":4197852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4415488,"data_stored":4377461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T07:57:17.617 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-05T07:57:17.618 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T07:57:17.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.752+0000 7f8cc77a8640 1 Processor -- start 2024-09-05T07:57:17.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.753+0000 7f8cc77a8640 1 -- start start 2024-09-05T07:57:17.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.754+0000 7f8cc77a8640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8cc01596c0 0x7f8cc00c9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:17.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.754+0000 7f8cc77a8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8cc00c79c0 0x7f8cc015ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:17.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.754+0000 7f8cc77a8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cc006bcb0 con 0x7f8cc00729b0 2024-09-05T07:57:17.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.754+0000 7f8cc77a8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f8cc006cd10 con 0x7f8cc00c79c0 2024-09-05T07:57:17.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.754+0000 7f8cc77a8640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f8cc015cf50 con 0x7f8cc01596c0 2024-09-05T07:57:17.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.754+0000 7f8cc5544640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8cc01596c0 0x7f8cc00c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:17.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.755+0000 7f8cc5544640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8cc01596c0 0x7f8cc00c9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:51000/0 (socket says 172.21.15.17:51000) 2024-09-05T07:57:17.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.755+0000 7f8cc5544640 1 -- 172.21.15.17:0/1154178969 learned_addr learned my addr 172.21.15.17:0/1154178969 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:17.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.755+0000 7f8cc4d43640 1 --2- 172.21.15.17:0/1154178969 >> v2:172.21.15.26:3300/0 conn(0x7f8cc00c79c0 0x7f8cc015ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:17.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.757+0000 7f8cc5544640 1 -- 172.21.15.17:0/1154178969 >> v2:172.21.15.26:3300/0 conn(0x7f8cc00c79c0 msgr2=0x7f8cc015ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:57:17.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.757+0000 7f8cc5544640 1 --2- 172.21.15.17:0/1154178969 >> v2:172.21.15.26:3300/0 conn(0x7f8cc00c79c0 0x7f8cc015ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:17.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.757+0000 7f8cc5544640 1 -- 172.21.15.17:0/1154178969 >> v1:172.21.15.26:6789/0 conn(0x7f8cc00729b0 legacy=0x7f8cc00c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:17.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.757+0000 7f8cc5544640 1 -- 172.21.15.17:0/1154178969 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cc006bf50 con 0x7f8cc01596c0 2024-09-05T07:57:17.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.759+0000 7f8cc5544640 1 --2- 172.21.15.17:0/1154178969 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8cc01596c0 0x7f8cc00c9290 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc009870 tx=0x7f8cbc02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8026eb10f58dc08 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:17.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.766+0000 7f8cb3fff640 1 -- 172.21.15.17:0/1154178969 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc037070 con 0x7f8cc01596c0 2024-09-05T07:57:17.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.766+0000 7f8cb3fff640 1 -- 172.21.15.17:0/1154178969 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cbc032440 con 0x7f8cc01596c0 2024-09-05T07:57:17.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.766+0000 7f8cb3fff640 1 -- 172.21.15.17:0/1154178969 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc032810 con 0x7f8cc01596c0 2024-09-05T07:57:17.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.766+0000 7f8cc77a8640 1 -- 172.21.15.17:0/1154178969 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8cc01596c0 msgr2=0x7f8cc00c9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:17.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.766+0000 7f8cc77a8640 1 --2- 172.21.15.17:0/1154178969 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8cc01596c0 0x7f8cc00c9290 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc009870 tx=0x7f8cbc02a270 comp rx=0 tx=0).stop 2024-09-05T07:57:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.766+0000 7f8cc77a8640 1 -- 172.21.15.17:0/1154178969 shutdown_connections 2024-09-05T07:57:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.766+0000 7f8cc77a8640 1 --2- 172.21.15.17:0/1154178969 >> v2:172.21.15.26:3300/0 conn(0x7f8cc00c79c0 0x7f8cc015ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.766+0000 7f8cc77a8640 1 --2- 172.21.15.17:0/1154178969 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8cc01596c0 0x7f8cc00c9290 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.766+0000 7f8cc77a8640 1 -- 172.21.15.17:0/1154178969 >> 172.21.15.17:0/1154178969 conn(0x7f8cc00c9ae0 msgr2=0x7f8cc00c9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.766+0000 7f8cc77a8640 1 -- 172.21.15.17:0/1154178969 shutdown_connections 2024-09-05T07:57:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.766+0000 7f8cc77a8640 1 -- 172.21.15.17:0/1154178969 wait complete. 2024-09-05T07:57:17.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.767+0000 7f8cc77a8640 1 Processor -- start 2024-09-05T07:57:17.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.767+0000 7f8cc77a8640 1 -- start start 2024-09-05T07:57:17.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.768+0000 7f8cc77a8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cc00729b0 0x7f8cc01e3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:17.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.768+0000 7f8cc77a8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8cc00c79c0 0x7f8cc01eea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:17.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.768+0000 7f8cc77a8640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8cc01596c0 0x7f8cc01e2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:17.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.768+0000 7f8cc77a8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc006c7f0 con 0x7f8cc00729b0 2024-09-05T07:57:17.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.768+0000 7f8cc77a8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc006c510 con 0x7f8cc00c79c0 2024-09-05T07:57:17.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.768+0000 7f8cc77a8640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f8cc00c9880 con 0x7f8cc01596c0 2024-09-05T07:57:17.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.769+0000 7f8cc4d43640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8cc00c79c0 0x7f8cc01eea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:17.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.769+0000 7f8cc5d45640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8cc01596c0 0x7f8cc01e2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:17.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.769+0000 7f8cc4d43640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8cc00c79c0 0x7f8cc01eea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:44670/0 (socket says 172.21.15.17:44670) 2024-09-05T07:57:17.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.769+0000 7f8cc4d43640 1 -- 172.21.15.17:0/3119733283 learned_addr learned my addr 172.21.15.17:0/3119733283 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:17.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.769+0000 7f8cc5544640 1 --2- 172.21.15.17:0/3119733283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cc00729b0 0x7f8cc01e3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:17.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.773+0000 7f8cc4d43640 1 -- 172.21.15.17:0/3119733283 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8cc01596c0 msgr2=0x7f8cc01e2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:17.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.773+0000 7f8cc4d43640 1 --2- 172.21.15.17:0/3119733283 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8cc01596c0 0x7f8cc01e2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:17.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.773+0000 7f8cc4d43640 1 -- 172.21.15.17:0/3119733283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cc00729b0 msgr2=0x7f8cc01e3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:17.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.773+0000 7f8cc4d43640 1 --2- 172.21.15.17:0/3119733283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cc00729b0 0x7f8cc01e3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:17.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.773+0000 7f8cc4d43640 1 -- 172.21.15.17:0/3119733283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cc00cb980 con 0x7f8cc00c79c0 2024-09-05T07:57:17.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.775+0000 7f8cc4d43640 1 --2- 172.21.15.17:0/3119733283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8cc00c79c0 0x7f8cc01eea20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8cb400e910 tx=0x7f8cb400edd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:17.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.780+0000 7f8cb1ffb640 1 -- 172.21.15.17:0/3119733283 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb4017070 con 0x7f8cc00c79c0 2024-09-05T07:57:17.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.780+0000 7f8cb1ffb640 1 -- 172.21.15.17:0/3119733283 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cb400ca00 con 0x7f8cc00c79c0 2024-09-05T07:57:17.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.780+0000 7f8cc77a8640 1 -- 172.21.15.17:0/3119733283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cc014f1d0 con 0x7f8cc00c79c0 2024-09-05T07:57:17.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.780+0000 7f8cb1ffb640 1 -- 172.21.15.17:0/3119733283 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb400cdf0 con 0x7f8cc00c79c0 2024-09-05T07:57:17.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.780+0000 7f8cc77a8640 1 -- 172.21.15.17:0/3119733283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cc01ee1b0 con 0x7f8cc00c79c0 2024-09-05T07:57:17.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:17.781+0000 7f8cc77a8640 1 -- 172.21.15.17:0/3119733283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cc0156300 con 0x7f8cc00c79c0 2024-09-05T07:57:18.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.058+0000 7f8cb1ffb640 1 -- 172.21.15.17:0/3119733283 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8cb401a070 con 0x7f8cc00c79c0 2024-09-05T07:57:18.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.059+0000 7f8cb1ffb640 1 --2- 172.21.15.17:0/3119733283 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f8ca406beb0 0x7f8ca406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:18.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.059+0000 7f8cc5544640 1 --2- 172.21.15.17:0/3119733283 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f8ca406beb0 0x7f8ca406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:18.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.059+0000 7f8cc5544640 1 --2- 172.21.15.17:0/3119733283 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f8ca406beb0 0x7f8ca406e370 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc034000 tx=0x7f8cbc02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:18.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.063+0000 7f8cb1ffb640 1 -- 172.21.15.17:0/3119733283 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f8cb4057910 con 0x7f8cc00c79c0 2024-09-05T07:57:18.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.074+0000 7f8cb1ffb640 1 -- 172.21.15.17:0/3119733283 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8cb4059870 con 0x7f8cc00c79c0 2024-09-05T07:57:18.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.260+0000 7f8cc77a8640 1 -- 172.21.15.17:0/3119733283 --> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8cc0156020 con 0x7f8ca406beb0 2024-09-05T07:57:18.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.267+0000 7f8cb1ffb640 1 -- 172.21.15.17:0/3119733283 <== mgr.4099 v2:172.21.15.26:6800/2736912541 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252825 (secure 0 0 0) 0x7f8cc0156020 con 0x7f8ca406beb0 2024-09-05T07:57:18.270 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:57:18.271 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-05T07:57:18.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.270+0000 7f8cc77a8640 1 -- 172.21.15.17:0/3119733283 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f8ca406beb0 msgr2=0x7f8ca406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:18.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.270+0000 7f8cc77a8640 1 --2- 172.21.15.17:0/3119733283 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f8ca406beb0 0x7f8ca406e370 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc034000 tx=0x7f8cbc02e000 comp rx=0 tx=0).stop 2024-09-05T07:57:18.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.270+0000 7f8cc77a8640 1 -- 172.21.15.17:0/3119733283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8cc00c79c0 msgr2=0x7f8cc01eea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:18.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.270+0000 7f8cc77a8640 1 --2- 172.21.15.17:0/3119733283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8cc00c79c0 0x7f8cc01eea20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8cb400e910 tx=0x7f8cb400edd0 comp rx=0 tx=0).stop 2024-09-05T07:57:18.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.270+0000 7f8cc77a8640 1 -- 172.21.15.17:0/3119733283 shutdown_connections 2024-09-05T07:57:18.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.270+0000 7f8cc77a8640 1 --2- 172.21.15.17:0/3119733283 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f8ca406beb0 0x7f8ca406e370 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:18.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.270+0000 7f8cc77a8640 1 --2- 172.21.15.17:0/3119733283 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8cc01596c0 0x7f8cc01e2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:18.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.270+0000 7f8cc77a8640 1 --2- 172.21.15.17:0/3119733283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8cc00c79c0 0x7f8cc01eea20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:18.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.270+0000 7f8cc77a8640 1 --2- 172.21.15.17:0/3119733283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cc00729b0 0x7f8cc01e3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:18.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.270+0000 7f8cc77a8640 1 -- 172.21.15.17:0/3119733283 >> 172.21.15.17:0/3119733283 conn(0x7f8cc00c9ae0 msgr2=0x7f8cc00cc460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:18.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.270+0000 7f8cc77a8640 1 -- 172.21.15.17:0/3119733283 shutdown_connections 2024-09-05T07:57:18.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.270+0000 7f8cc77a8640 1 -- 172.21.15.17:0/3119733283 wait complete. 2024-09-05T07:57:18.282 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":862,"stamp":"2024-09-05T07:57:18.210154+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":37817128,"num_objects":109,"num_object_clones":0,"num_object_copies":218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":0,"num_read":985,"num_read_kb":1016,"num_write":14420,"num_write_kb":339551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13326,"ondisk_log_size":13326,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":376824,"kb_used_data":76024,"kb_used_omap":12,"kb_used_meta":300659,"kb_avail":754597896,"statfs":{"total":773094113280,"available":772708245504,"internally_reserved":0,"allocated":77848576,"data_stored":76343576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":307875377},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":198283,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":12,"num_write":61,"num_write_kb":232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002968"},"pg_stats":[{"pgid":"3.3f","version":"24'52","reported_seq":75,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.326626+0000","last_change":"2024-09-05T07:30:02.495241+0000","last_active":"2024-09-05T07:57:10.326626+0000","last_peered":"2024-09-05T07:57:10.326626+0000","last_clean":"2024-09-05T07:57:10.326626+0000","last_became_active":"2024-09-05T07:30:02.494878+0000","last_became_peered":"2024-09-05T07:30:02.494878+0000","last_unstale":"2024-09-05T07:57:10.326626+0000","last_undegraded":"2024-09-05T07:57:10.326626+0000","last_fullsized":"2024-09-05T07:57:10.326626+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:15:28.381136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":2980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"24'95","reported_seq":124,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.313902+0000","last_change":"2024-09-05T07:29:30.658489+0000","last_active":"2024-09-05T07:57:10.313902+0000","last_peered":"2024-09-05T07:57:10.313902+0000","last_clean":"2024-09-05T07:57:10.313902+0000","last_became_active":"2024-09-05T07:29:30.658225+0000","last_became_peered":"2024-09-05T07:29:30.658225+0000","last_unstale":"2024-09-05T07:57:10.313902+0000","last_undegraded":"2024-09-05T07:57:10.313902+0000","last_fullsized":"2024-09-05T07:57:10.313902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:03:07.788844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":7017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"24'86","reported_seq":115,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.313139+0000","last_change":"2024-09-05T07:29:30.659535+0000","last_active":"2024-09-05T07:57:10.313139+0000","last_peered":"2024-09-05T07:57:10.313139+0000","last_clean":"2024-09-05T07:57:10.313139+0000","last_became_active":"2024-09-05T07:29:30.659042+0000","last_became_peered":"2024-09-05T07:29:30.659042+0000","last_unstale":"2024-09-05T07:57:10.313139+0000","last_undegraded":"2024-09-05T07:57:10.313139+0000","last_fullsized":"2024-09-05T07:57:10.313139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:08:39.718764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":4627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"24'50","reported_seq":79,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.356926+0000","last_change":"2024-09-05T07:29:30.640489+0000","last_active":"2024-09-05T07:57:10.356926+0000","last_peered":"2024-09-05T07:57:10.356926+0000","last_clean":"2024-09-05T07:57:10.356926+0000","last_became_active":"2024-09-05T07:29:30.640141+0000","last_became_peered":"2024-09-05T07:29:30.640141+0000","last_unstale":"2024-09-05T07:57:10.356926+0000","last_undegraded":"2024-09-05T07:57:10.356926+0000","last_fullsized":"2024-09-05T07:57:10.356926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:53:14.516901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":3092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"24'51","reported_seq":78,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.338096+0000","last_change":"2024-09-05T07:29:30.659266+0000","last_active":"2024-09-05T07:57:10.338096+0000","last_peered":"2024-09-05T07:57:10.338096+0000","last_clean":"2024-09-05T07:57:10.338096+0000","last_became_active":"2024-09-05T07:29:30.658981+0000","last_became_peered":"2024-09-05T07:29:30.658981+0000","last_unstale":"2024-09-05T07:57:10.338096+0000","last_undegraded":"2024-09-05T07:57:10.338096+0000","last_fullsized":"2024-09-05T07:57:10.338096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:34:49.879681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":3119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"24'102","reported_seq":129,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.347508+0000","last_change":"2024-09-05T07:29:30.641512+0000","last_active":"2024-09-05T07:57:10.347508+0000","last_peered":"2024-09-05T07:57:10.347508+0000","last_clean":"2024-09-05T07:57:10.347508+0000","last_became_active":"2024-09-05T07:29:30.641255+0000","last_became_peered":"2024-09-05T07:29:30.641255+0000","last_unstale":"2024-09-05T07:57:10.347508+0000","last_undegraded":"2024-09-05T07:57:10.347508+0000","last_fullsized":"2024-09-05T07:57:10.347508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:42.938157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":5219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"24'87","reported_seq":114,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.330915+0000","last_change":"2024-09-05T07:29:30.556064+0000","last_active":"2024-09-05T07:57:10.330915+0000","last_peered":"2024-09-05T07:57:10.330915+0000","last_clean":"2024-09-05T07:57:10.330915+0000","last_became_active":"2024-09-05T07:29:30.555796+0000","last_became_peered":"2024-09-05T07:29:30.555796+0000","last_unstale":"2024-09-05T07:57:10.330915+0000","last_undegraded":"2024-09-05T07:57:10.330915+0000","last_fullsized":"2024-09-05T07:57:10.330915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:37:28.088603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":6302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"24'64","reported_seq":91,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.319405+0000","last_change":"2024-09-05T07:29:30.659561+0000","last_active":"2024-09-05T07:57:10.319405+0000","last_peered":"2024-09-05T07:57:10.319405+0000","last_clean":"2024-09-05T07:57:10.319405+0000","last_became_active":"2024-09-05T07:29:30.659070+0000","last_became_peered":"2024-09-05T07:29:30.659070+0000","last_unstale":"2024-09-05T07:57:10.319405+0000","last_undegraded":"2024-09-05T07:57:10.319405+0000","last_fullsized":"2024-09-05T07:57:10.319405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:13:33.902479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"24'73","reported_seq":100,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.317525+0000","last_change":"2024-09-05T07:29:30.565653+0000","last_active":"2024-09-05T07:57:10.317525+0000","last_peered":"2024-09-05T07:57:10.317525+0000","last_clean":"2024-09-05T07:57:10.317525+0000","last_became_active":"2024-09-05T07:29:30.565408+0000","last_became_peered":"2024-09-05T07:29:30.565408+0000","last_unstale":"2024-09-05T07:57:10.317525+0000","last_undegraded":"2024-09-05T07:57:10.317525+0000","last_fullsized":"2024-09-05T07:57:10.317525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:42.938157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":5244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"24'70","reported_seq":97,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.351153+0000","last_change":"2024-09-05T07:29:30.643865+0000","last_active":"2024-09-05T07:57:10.351153+0000","last_peered":"2024-09-05T07:57:10.351153+0000","last_clean":"2024-09-05T07:57:10.351153+0000","last_became_active":"2024-09-05T07:29:30.643587+0000","last_became_peered":"2024-09-05T07:29:30.643587+0000","last_unstale":"2024-09-05T07:57:10.351153+0000","last_undegraded":"2024-09-05T07:57:10.351153+0000","last_fullsized":"2024-09-05T07:57:10.351153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:37:46.507371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":1781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"24'68","reported_seq":95,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.344205+0000","last_change":"2024-09-05T07:29:30.557314+0000","last_active":"2024-09-05T07:57:10.344205+0000","last_peered":"2024-09-05T07:57:10.344205+0000","last_clean":"2024-09-05T07:57:10.344205+0000","last_became_active":"2024-09-05T07:29:30.557039+0000","last_became_peered":"2024-09-05T07:29:30.557039+0000","last_unstale":"2024-09-05T07:57:10.344205+0000","last_undegraded":"2024-09-05T07:57:10.344205+0000","last_fullsized":"2024-09-05T07:57:10.344205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:08:39.718764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"24'49","reported_seq":76,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.348843+0000","last_change":"2024-09-05T07:29:30.564518+0000","last_active":"2024-09-05T07:57:10.348843+0000","last_peered":"2024-09-05T07:57:10.348843+0000","last_clean":"2024-09-05T07:57:10.348843+0000","last_became_active":"2024-09-05T07:29:30.564271+0000","last_became_peered":"2024-09-05T07:29:30.564271+0000","last_unstale":"2024-09-05T07:57:10.348843+0000","last_undegraded":"2024-09-05T07:57:10.348843+0000","last_fullsized":"2024-09-05T07:57:10.348843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:09:22.026287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":2250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"24'77","reported_seq":104,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.296011+0000","last_change":"2024-09-05T07:29:30.631857+0000","last_active":"2024-09-05T07:57:10.296011+0000","last_peered":"2024-09-05T07:57:10.296011+0000","last_clean":"2024-09-05T07:57:10.296011+0000","last_became_active":"2024-09-05T07:29:30.631588+0000","last_became_peered":"2024-09-05T07:29:30.631588+0000","last_unstale":"2024-09-05T07:57:10.296011+0000","last_undegraded":"2024-09-05T07:57:10.296011+0000","last_fullsized":"2024-09-05T07:57:10.296011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:41:25.696697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"24'67","reported_seq":94,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.297577+0000","last_change":"2024-09-05T07:29:30.632829+0000","last_active":"2024-09-05T07:57:10.297577+0000","last_peered":"2024-09-05T07:57:10.297577+0000","last_clean":"2024-09-05T07:57:10.297577+0000","last_became_active":"2024-09-05T07:29:30.632528+0000","last_became_peered":"2024-09-05T07:29:30.632528+0000","last_unstale":"2024-09-05T07:57:10.297577+0000","last_undegraded":"2024-09-05T07:57:10.297577+0000","last_fullsized":"2024-09-05T07:57:10.297577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:22:35.613478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":4207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"24'87","reported_seq":114,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.313845+0000","last_change":"2024-09-05T07:29:30.657306+0000","last_active":"2024-09-05T07:57:10.313845+0000","last_peered":"2024-09-05T07:57:10.313845+0000","last_clean":"2024-09-05T07:57:10.313845+0000","last_became_active":"2024-09-05T07:29:30.656997+0000","last_became_peered":"2024-09-05T07:29:30.656997+0000","last_unstale":"2024-09-05T07:57:10.313845+0000","last_undegraded":"2024-09-05T07:57:10.313845+0000","last_fullsized":"2024-09-05T07:57:10.313845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:15:28.381136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"24'76","reported_seq":103,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.293131+0000","last_change":"2024-09-05T07:29:30.641543+0000","last_active":"2024-09-05T07:57:10.293131+0000","last_peered":"2024-09-05T07:57:10.293131+0000","last_clean":"2024-09-05T07:57:10.293131+0000","last_became_active":"2024-09-05T07:29:30.641283+0000","last_became_peered":"2024-09-05T07:29:30.641283+0000","last_unstale":"2024-09-05T07:57:10.293131+0000","last_undegraded":"2024-09-05T07:57:10.293131+0000","last_fullsized":"2024-09-05T07:57:10.293131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:36:59.967135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"24'92","reported_seq":119,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.291737+0000","last_change":"2024-09-05T07:29:30.558414+0000","last_active":"2024-09-05T07:57:10.291737+0000","last_peered":"2024-09-05T07:57:10.291737+0000","last_clean":"2024-09-05T07:57:10.291737+0000","last_became_active":"2024-09-05T07:29:30.558105+0000","last_became_peered":"2024-09-05T07:29:30.558105+0000","last_unstale":"2024-09-05T07:57:10.291737+0000","last_undegraded":"2024-09-05T07:57:10.291737+0000","last_fullsized":"2024-09-05T07:57:10.291737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:55:31.494616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":4227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"24'95","reported_seq":122,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.326590+0000","last_change":"2024-09-05T07:29:30.643169+0000","last_active":"2024-09-05T07:57:10.326590+0000","last_peered":"2024-09-05T07:57:10.326590+0000","last_clean":"2024-09-05T07:57:10.326590+0000","last_became_active":"2024-09-05T07:29:30.642876+0000","last_became_peered":"2024-09-05T07:29:30.642876+0000","last_unstale":"2024-09-05T07:57:10.326590+0000","last_undegraded":"2024-09-05T07:57:10.326590+0000","last_fullsized":"2024-09-05T07:57:10.326590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:40.101513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":9001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"24'66","reported_seq":94,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.288476+0000","last_change":"2024-09-05T07:29:30.557239+0000","last_active":"2024-09-05T07:57:10.288476+0000","last_peered":"2024-09-05T07:57:10.288476+0000","last_clean":"2024-09-05T07:57:10.288476+0000","last_became_active":"2024-09-05T07:29:30.556969+0000","last_became_peered":"2024-09-05T07:29:30.556969+0000","last_unstale":"2024-09-05T07:57:10.288476+0000","last_undegraded":"2024-09-05T07:57:10.288476+0000","last_fullsized":"2024-09-05T07:57:10.288476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:47:29.801348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":2884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"24'78","reported_seq":106,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.347143+0000","last_change":"2024-09-05T07:29:30.564077+0000","last_active":"2024-09-05T07:57:10.347143+0000","last_peered":"2024-09-05T07:57:10.347143+0000","last_clean":"2024-09-05T07:57:10.347143+0000","last_became_active":"2024-09-05T07:29:30.563808+0000","last_became_peered":"2024-09-05T07:29:30.563808+0000","last_unstale":"2024-09-05T07:57:10.347143+0000","last_undegraded":"2024-09-05T07:57:10.347143+0000","last_fullsized":"2024-09-05T07:57:10.347143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:00:35.625571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":5103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"24'109","reported_seq":137,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.356586+0000","last_change":"2024-09-05T07:29:30.643879+0000","last_active":"2024-09-05T07:57:10.356586+0000","last_peered":"2024-09-05T07:57:10.356586+0000","last_clean":"2024-09-05T07:57:10.356586+0000","last_became_active":"2024-09-05T07:29:30.643559+0000","last_became_peered":"2024-09-05T07:29:30.643559+0000","last_unstale":"2024-09-05T07:57:10.356586+0000","last_undegraded":"2024-09-05T07:57:10.356586+0000","last_fullsized":"2024-09-05T07:57:10.356586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:52:56.756904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":8204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"24'68","reported_seq":96,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.320057+0000","last_change":"2024-09-05T07:29:30.564954+0000","last_active":"2024-09-05T07:57:10.320057+0000","last_peered":"2024-09-05T07:57:10.320057+0000","last_clean":"2024-09-05T07:57:10.320057+0000","last_became_active":"2024-09-05T07:29:30.564669+0000","last_became_peered":"2024-09-05T07:29:30.564669+0000","last_unstale":"2024-09-05T07:57:10.320057+0000","last_undegraded":"2024-09-05T07:57:10.320057+0000","last_fullsized":"2024-09-05T07:57:10.320057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:53:40.150507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":2069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"24'75","reported_seq":103,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.315721+0000","last_change":"2024-09-05T07:29:30.656718+0000","last_active":"2024-09-05T07:57:10.315721+0000","last_peered":"2024-09-05T07:57:10.315721+0000","last_clean":"2024-09-05T07:57:10.315721+0000","last_became_active":"2024-09-05T07:29:30.656451+0000","last_became_peered":"2024-09-05T07:29:30.656451+0000","last_unstale":"2024-09-05T07:57:10.315721+0000","last_undegraded":"2024-09-05T07:57:10.315721+0000","last_fullsized":"2024-09-05T07:57:10.315721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:38:11.961137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":3632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"24'60","reported_seq":88,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.291730+0000","last_change":"2024-09-05T07:29:30.658481+0000","last_active":"2024-09-05T07:57:10.291730+0000","last_peered":"2024-09-05T07:57:10.291730+0000","last_clean":"2024-09-05T07:57:10.291730+0000","last_became_active":"2024-09-05T07:29:30.658207+0000","last_became_peered":"2024-09-05T07:29:30.658207+0000","last_unstale":"2024-09-05T07:57:10.291730+0000","last_undegraded":"2024-09-05T07:57:10.291730+0000","last_fullsized":"2024-09-05T07:57:10.291730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:23:04.483495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":3656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"24'76","reported_seq":104,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.312991+0000","last_change":"2024-09-05T07:29:30.657936+0000","last_active":"2024-09-05T07:57:10.312991+0000","last_peered":"2024-09-05T07:57:10.312991+0000","last_clean":"2024-09-05T07:57:10.312991+0000","last_became_active":"2024-09-05T07:29:30.657177+0000","last_became_peered":"2024-09-05T07:29:30.657177+0000","last_unstale":"2024-09-05T07:57:10.312991+0000","last_undegraded":"2024-09-05T07:57:10.312991+0000","last_fullsized":"2024-09-05T07:57:10.312991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:01:34.217228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":7413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"24'76","reported_seq":104,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.352634+0000","last_change":"2024-09-05T07:29:30.642790+0000","last_active":"2024-09-05T07:57:10.352634+0000","last_peered":"2024-09-05T07:57:10.352634+0000","last_clean":"2024-09-05T07:57:10.352634+0000","last_became_active":"2024-09-05T07:29:30.641834+0000","last_became_peered":"2024-09-05T07:29:30.641834+0000","last_unstale":"2024-09-05T07:57:10.352634+0000","last_undegraded":"2024-09-05T07:57:10.352634+0000","last_fullsized":"2024-09-05T07:57:10.352634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:34:17.448981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":3360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"24'83","reported_seq":111,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.297659+0000","last_change":"2024-09-05T07:29:30.633776+0000","last_active":"2024-09-05T07:57:10.297659+0000","last_peered":"2024-09-05T07:57:10.297659+0000","last_clean":"2024-09-05T07:57:10.297659+0000","last_became_active":"2024-09-05T07:29:30.633507+0000","last_became_peered":"2024-09-05T07:29:30.633507+0000","last_unstale":"2024-09-05T07:57:10.297659+0000","last_undegraded":"2024-09-05T07:57:10.297659+0000","last_fullsized":"2024-09-05T07:57:10.297659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:34:54.335152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":5040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"24'50","reported_seq":78,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.296242+0000","last_change":"2024-09-05T07:29:30.632558+0000","last_active":"2024-09-05T07:57:10.296242+0000","last_peered":"2024-09-05T07:57:10.296242+0000","last_clean":"2024-09-05T07:57:10.296242+0000","last_became_active":"2024-09-05T07:29:30.632269+0000","last_became_peered":"2024-09-05T07:29:30.632269+0000","last_unstale":"2024-09-05T07:57:10.296242+0000","last_undegraded":"2024-09-05T07:57:10.296242+0000","last_fullsized":"2024-09-05T07:57:10.296242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:35:18.927192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":6253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"24'73","reported_seq":102,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.312088+0000","last_change":"2024-09-05T07:29:30.656638+0000","last_active":"2024-09-05T07:57:10.312088+0000","last_peered":"2024-09-05T07:57:10.312088+0000","last_clean":"2024-09-05T07:57:10.312088+0000","last_became_active":"2024-09-05T07:29:30.656382+0000","last_became_peered":"2024-09-05T07:29:30.656382+0000","last_unstale":"2024-09-05T07:57:10.312088+0000","last_undegraded":"2024-09-05T07:57:10.312088+0000","last_fullsized":"2024-09-05T07:57:10.312088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:34:49.879681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":7725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"24'117","reported_seq":146,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.285819+0000","last_change":"2024-09-05T07:29:30.657421+0000","last_active":"2024-09-05T07:57:10.285819+0000","last_peered":"2024-09-05T07:57:10.285819+0000","last_clean":"2024-09-05T07:57:10.285819+0000","last_became_active":"2024-09-05T07:29:30.657159+0000","last_became_peered":"2024-09-05T07:29:30.657159+0000","last_unstale":"2024-09-05T07:57:10.285819+0000","last_undegraded":"2024-09-05T07:57:10.285819+0000","last_fullsized":"2024-09-05T07:57:10.285819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:13:05.334750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":4986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"24'92","reported_seq":121,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.327999+0000","last_change":"2024-09-05T07:29:30.624866+0000","last_active":"2024-09-05T07:57:10.327999+0000","last_peered":"2024-09-05T07:57:10.327999+0000","last_clean":"2024-09-05T07:57:10.327999+0000","last_became_active":"2024-09-05T07:29:30.624605+0000","last_became_peered":"2024-09-05T07:29:30.624605+0000","last_unstale":"2024-09-05T07:57:10.327999+0000","last_undegraded":"2024-09-05T07:57:10.327999+0000","last_fullsized":"2024-09-05T07:57:10.327999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:42.938157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":7891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"24'80","reported_seq":109,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.355465+0000","last_change":"2024-09-05T07:29:30.642514+0000","last_active":"2024-09-05T07:57:10.355465+0000","last_peered":"2024-09-05T07:57:10.355465+0000","last_clean":"2024-09-05T07:57:10.355465+0000","last_became_active":"2024-09-05T07:29:30.642084+0000","last_became_peered":"2024-09-05T07:29:30.642084+0000","last_unstale":"2024-09-05T07:57:10.355465+0000","last_undegraded":"2024-09-05T07:57:10.355465+0000","last_fullsized":"2024-09-05T07:57:10.355465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:40.101513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":4235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"24'60","reported_seq":87,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.320160+0000","last_change":"2024-09-05T07:29:30.657456+0000","last_active":"2024-09-05T07:57:10.320160+0000","last_peered":"2024-09-05T07:57:10.320160+0000","last_clean":"2024-09-05T07:57:10.320160+0000","last_became_active":"2024-09-05T07:29:30.657117+0000","last_became_peered":"2024-09-05T07:29:30.657117+0000","last_unstale":"2024-09-05T07:57:10.320160+0000","last_undegraded":"2024-09-05T07:57:10.320160+0000","last_fullsized":"2024-09-05T07:57:10.320160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:40.101513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":3534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"24'647","reported_seq":676,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:05.043520+0000","last_change":"2024-09-05T07:29:29.568126+0000","last_active":"2024-09-05T07:57:05.043520+0000","last_peered":"2024-09-05T07:57:05.043520+0000","last_clean":"2024-09-05T07:57:05.043520+0000","last_became_active":"2024-09-05T07:29:29.567846+0000","last_became_peered":"2024-09-05T07:29:29.567846+0000","last_unstale":"2024-09-05T07:57:05.043520+0000","last_undegraded":"2024-09-05T07:57:05.043520+0000","last_fullsized":"2024-09-05T07:57:05.043520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:48:25.900221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195510,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":639,"num_write_kb":4403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"24'89","reported_seq":116,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.358386+0000","last_change":"2024-09-05T07:29:30.557504+0000","last_active":"2024-09-05T07:57:10.358386+0000","last_peered":"2024-09-05T07:57:10.358386+0000","last_clean":"2024-09-05T07:57:10.358386+0000","last_became_active":"2024-09-05T07:29:30.557203+0000","last_became_peered":"2024-09-05T07:29:30.557203+0000","last_unstale":"2024-09-05T07:57:10.358386+0000","last_undegraded":"2024-09-05T07:57:10.358386+0000","last_fullsized":"2024-09-05T07:57:10.358386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:55:13.742728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":6286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"24'598","reported_seq":627,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:54:31.541138+0000","last_change":"2024-09-05T07:29:29.524587+0000","last_active":"2024-09-05T07:54:31.541138+0000","last_peered":"2024-09-05T07:54:31.541138+0000","last_clean":"2024-09-05T07:54:31.541138+0000","last_became_active":"2024-09-05T07:29:29.524321+0000","last_became_peered":"2024-09-05T07:29:29.524321+0000","last_unstale":"2024-09-05T07:54:31.541138+0000","last_undegraded":"2024-09-05T07:54:31.541138+0000","last_fullsized":"2024-09-05T07:54:31.541138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":598,"log_dups_size":0,"ondisk_log_size":598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:53:13.376716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"24'6","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:56:53.384231+0000","last_change":"2024-09-05T07:29:29.570879+0000","last_active":"2024-09-05T07:56:53.384231+0000","last_peered":"2024-09-05T07:56:53.384231+0000","last_clean":"2024-09-05T07:56:53.384231+0000","last_became_active":"2024-09-05T07:29:29.570456+0000","last_became_peered":"2024-09-05T07:29:29.570456+0000","last_unstale":"2024-09-05T07:56:53.384231+0000","last_undegraded":"2024-09-05T07:56:53.384231+0000","last_fullsized":"2024-09-05T07:56:53.384231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:52:54.638586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"24'84","reported_seq":111,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.318416+0000","last_change":"2024-09-05T07:29:30.657364+0000","last_active":"2024-09-05T07:57:10.318416+0000","last_peered":"2024-09-05T07:57:10.318416+0000","last_clean":"2024-09-05T07:57:10.318416+0000","last_became_active":"2024-09-05T07:29:30.657008+0000","last_became_peered":"2024-09-05T07:29:30.657008+0000","last_unstale":"2024-09-05T07:57:10.318416+0000","last_undegraded":"2024-09-05T07:57:10.318416+0000","last_fullsized":"2024-09-05T07:57:10.318416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:36:59.967135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":7830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"24'7","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:56:49.948482+0000","last_change":"2024-09-05T07:29:29.562802+0000","last_active":"2024-09-05T07:56:49.948482+0000","last_peered":"2024-09-05T07:56:49.948482+0000","last_clean":"2024-09-05T07:56:49.948482+0000","last_became_active":"2024-09-05T07:29:29.562520+0000","last_became_peered":"2024-09-05T07:29:29.562520+0000","last_unstale":"2024-09-05T07:56:49.948482+0000","last_undegraded":"2024-09-05T07:56:49.948482+0000","last_fullsized":"2024-09-05T07:56:49.948482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:34:16.308797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"24'88","reported_seq":115,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.358272+0000","last_change":"2024-09-05T07:29:30.563197+0000","last_active":"2024-09-05T07:57:10.358272+0000","last_peered":"2024-09-05T07:57:10.358272+0000","last_clean":"2024-09-05T07:57:10.358272+0000","last_became_active":"2024-09-05T07:29:30.562945+0000","last_became_peered":"2024-09-05T07:29:30.562945+0000","last_unstale":"2024-09-05T07:57:10.358272+0000","last_undegraded":"2024-09-05T07:57:10.358272+0000","last_fullsized":"2024-09-05T07:57:10.358272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:31:37.754325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"24'14","reported_seq":43,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.079133+0000","last_change":"2024-09-05T07:29:29.559012+0000","last_active":"2024-09-05T07:57:10.079133+0000","last_peered":"2024-09-05T07:57:10.079133+0000","last_clean":"2024-09-05T07:57:10.079133+0000","last_became_active":"2024-09-05T07:29:29.558744+0000","last_became_peered":"2024-09-05T07:29:29.558744+0000","last_unstale":"2024-09-05T07:57:10.079133+0000","last_undegraded":"2024-09-05T07:57:10.079133+0000","last_fullsized":"2024-09-05T07:57:10.079133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:28:41.630593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"24'98","reported_seq":125,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.357735+0000","last_change":"2024-09-05T07:29:30.641594+0000","last_active":"2024-09-05T07:57:10.357735+0000","last_peered":"2024-09-05T07:57:10.357735+0000","last_clean":"2024-09-05T07:57:10.357735+0000","last_became_active":"2024-09-05T07:29:30.641360+0000","last_became_peered":"2024-09-05T07:29:30.641360+0000","last_unstale":"2024-09-05T07:57:10.357735+0000","last_undegraded":"2024-09-05T07:57:10.357735+0000","last_fullsized":"2024-09-05T07:57:10.357735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:49:40.327718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":5807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"24'8","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:02.687264+0000","last_change":"2024-09-05T07:29:29.559998+0000","last_active":"2024-09-05T07:57:02.687264+0000","last_peered":"2024-09-05T07:57:02.687264+0000","last_clean":"2024-09-05T07:57:02.687264+0000","last_became_active":"2024-09-05T07:29:29.559717+0000","last_became_peered":"2024-09-05T07:29:29.559717+0000","last_unstale":"2024-09-05T07:57:02.687264+0000","last_undegraded":"2024-09-05T07:57:02.687264+0000","last_fullsized":"2024-09-05T07:57:02.687264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:58.513308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"24'57","reported_seq":84,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.314763+0000","last_change":"2024-09-05T07:29:30.657727+0000","last_active":"2024-09-05T07:57:10.314763+0000","last_peered":"2024-09-05T07:57:10.314763+0000","last_clean":"2024-09-05T07:57:10.314763+0000","last_became_active":"2024-09-05T07:29:30.657038+0000","last_became_peered":"2024-09-05T07:29:30.657038+0000","last_unstale":"2024-09-05T07:57:10.314763+0000","last_undegraded":"2024-09-05T07:57:10.314763+0000","last_fullsized":"2024-09-05T07:57:10.314763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:00:35.625571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":3450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"24'613","reported_seq":642,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:09.740261+0000","last_change":"2024-09-05T07:29:29.566840+0000","last_active":"2024-09-05T07:57:09.740261+0000","last_peered":"2024-09-05T07:57:09.740261+0000","last_clean":"2024-09-05T07:57:09.740261+0000","last_became_active":"2024-09-05T07:29:29.566501+0000","last_became_peered":"2024-09-05T07:29:29.566501+0000","last_unstale":"2024-09-05T07:57:09.740261+0000","last_undegraded":"2024-09-05T07:57:09.740261+0000","last_fullsized":"2024-09-05T07:57:09.740261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:47:57.187710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":613,"num_write_kb":614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"24'72","reported_seq":99,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.303889+0000","last_change":"2024-09-05T07:29:30.642252+0000","last_active":"2024-09-05T07:57:10.303889+0000","last_peered":"2024-09-05T07:57:10.303889+0000","last_clean":"2024-09-05T07:57:10.303889+0000","last_became_active":"2024-09-05T07:29:30.641991+0000","last_became_peered":"2024-09-05T07:29:30.641991+0000","last_unstale":"2024-09-05T07:57:10.303889+0000","last_undegraded":"2024-09-05T07:57:10.303889+0000","last_fullsized":"2024-09-05T07:57:10.303889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:42:04.216273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":2982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"24'832","reported_seq":861,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:00.513516+0000","last_change":"2024-09-05T07:29:29.562441+0000","last_active":"2024-09-05T07:57:00.513516+0000","last_peered":"2024-09-05T07:57:00.513516+0000","last_clean":"2024-09-05T07:57:00.513516+0000","last_became_active":"2024-09-05T07:29:29.562136+0000","last_became_peered":"2024-09-05T07:29:29.562136+0000","last_unstale":"2024-09-05T07:57:00.513516+0000","last_undegraded":"2024-09-05T07:57:00.513516+0000","last_fullsized":"2024-09-05T07:57:00.513516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:06:20.633881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":830,"num_write_kb":4536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"24'66","reported_seq":93,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.339442+0000","last_change":"2024-09-05T07:29:30.633033+0000","last_active":"2024-09-05T07:57:10.339442+0000","last_peered":"2024-09-05T07:57:10.339442+0000","last_clean":"2024-09-05T07:57:10.339442+0000","last_became_active":"2024-09-05T07:29:30.632784+0000","last_became_peered":"2024-09-05T07:29:30.632784+0000","last_unstale":"2024-09-05T07:57:10.339442+0000","last_undegraded":"2024-09-05T07:57:10.339442+0000","last_fullsized":"2024-09-05T07:57:10.339442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:03:07.788844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":3605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'14","reported_seq":43,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:02.687518+0000","last_change":"2024-09-05T07:29:29.567195+0000","last_active":"2024-09-05T07:57:02.687518+0000","last_peered":"2024-09-05T07:57:02.687518+0000","last_clean":"2024-09-05T07:57:02.687518+0000","last_became_active":"2024-09-05T07:29:29.566934+0000","last_became_peered":"2024-09-05T07:29:29.566934+0000","last_unstale":"2024-09-05T07:57:02.687518+0000","last_undegraded":"2024-09-05T07:57:02.687518+0000","last_fullsized":"2024-09-05T07:57:02.687518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:10:28.438071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"24'76","reported_seq":103,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.298339+0000","last_change":"2024-09-05T07:29:30.632260+0000","last_active":"2024-09-05T07:57:10.298339+0000","last_peered":"2024-09-05T07:57:10.298339+0000","last_clean":"2024-09-05T07:57:10.298339+0000","last_became_active":"2024-09-05T07:29:30.631974+0000","last_became_peered":"2024-09-05T07:29:30.631974+0000","last_unstale":"2024-09-05T07:57:10.298339+0000","last_undegraded":"2024-09-05T07:57:10.298339+0000","last_fullsized":"2024-09-05T07:57:10.298339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:45:00.967978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"24'10","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:09.707101+0000","last_change":"2024-09-05T07:29:29.567028+0000","last_active":"2024-09-05T07:57:09.707101+0000","last_peered":"2024-09-05T07:57:09.707101+0000","last_clean":"2024-09-05T07:57:09.707101+0000","last_became_active":"2024-09-05T07:29:29.566754+0000","last_became_peered":"2024-09-05T07:29:29.566754+0000","last_unstale":"2024-09-05T07:57:09.707101+0000","last_undegraded":"2024-09-05T07:57:09.707101+0000","last_fullsized":"2024-09-05T07:57:09.707101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:49:13.565181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"24'97","reported_seq":124,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.302295+0000","last_change":"2024-09-05T07:29:30.558658+0000","last_active":"2024-09-05T07:57:10.302295+0000","last_peered":"2024-09-05T07:57:10.302295+0000","last_clean":"2024-09-05T07:57:10.302295+0000","last_became_active":"2024-09-05T07:29:30.558179+0000","last_became_peered":"2024-09-05T07:29:30.558179+0000","last_unstale":"2024-09-05T07:57:10.302295+0000","last_undegraded":"2024-09-05T07:57:10.302295+0000","last_fullsized":"2024-09-05T07:57:10.302295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:44:13.003367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":15470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"24'10","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:07.727452+0000","last_change":"2024-09-05T07:29:29.525420+0000","last_active":"2024-09-05T07:57:07.727452+0000","last_peered":"2024-09-05T07:57:07.727452+0000","last_clean":"2024-09-05T07:57:07.727452+0000","last_became_active":"2024-09-05T07:29:29.525139+0000","last_became_peered":"2024-09-05T07:29:29.525139+0000","last_unstale":"2024-09-05T07:57:07.727452+0000","last_undegraded":"2024-09-05T07:57:07.727452+0000","last_fullsized":"2024-09-05T07:57:07.727452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:54:00.339029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1172,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"24'53","reported_seq":80,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.316662+0000","last_change":"2024-09-05T07:29:30.659606+0000","last_active":"2024-09-05T07:57:10.316662+0000","last_peered":"2024-09-05T07:57:10.316662+0000","last_clean":"2024-09-05T07:57:10.316662+0000","last_became_active":"2024-09-05T07:29:30.659311+0000","last_became_peered":"2024-09-05T07:29:30.659311+0000","last_unstale":"2024-09-05T07:57:10.316662+0000","last_undegraded":"2024-09-05T07:57:10.316662+0000","last_fullsized":"2024-09-05T07:57:10.316662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:54:01.479214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":2804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"24'22","reported_seq":51,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:07.724968+0000","last_change":"2024-09-05T07:29:29.566784+0000","last_active":"2024-09-05T07:57:07.724968+0000","last_peered":"2024-09-05T07:57:07.724968+0000","last_clean":"2024-09-05T07:57:07.724968+0000","last_became_active":"2024-09-05T07:29:29.566503+0000","last_became_peered":"2024-09-05T07:29:29.566503+0000","last_unstale":"2024-09-05T07:57:07.724968+0000","last_undegraded":"2024-09-05T07:57:07.724968+0000","last_fullsized":"2024-09-05T07:57:07.724968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:35:54.465221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"24'65","reported_seq":92,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.290685+0000","last_change":"2024-09-05T07:29:30.641565+0000","last_active":"2024-09-05T07:57:10.290685+0000","last_peered":"2024-09-05T07:57:10.290685+0000","last_clean":"2024-09-05T07:57:10.290685+0000","last_became_active":"2024-09-05T07:29:30.641309+0000","last_became_peered":"2024-09-05T07:29:30.641309+0000","last_unstale":"2024-09-05T07:57:10.290685+0000","last_undegraded":"2024-09-05T07:57:10.290685+0000","last_fullsized":"2024-09-05T07:57:10.290685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:37:28.088603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":5311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"24'6","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:00.512888+0000","last_change":"2024-09-05T07:29:29.524793+0000","last_active":"2024-09-05T07:57:00.512888+0000","last_peered":"2024-09-05T07:57:00.512888+0000","last_clean":"2024-09-05T07:57:00.512888+0000","last_became_active":"2024-09-05T07:29:29.524522+0000","last_became_peered":"2024-09-05T07:29:29.524522+0000","last_unstale":"2024-09-05T07:57:00.512888+0000","last_undegraded":"2024-09-05T07:57:00.512888+0000","last_fullsized":"2024-09-05T07:57:00.512888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:41.797972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"24'36","reported_seq":64,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.348352+0000","last_change":"2024-09-05T07:29:30.642565+0000","last_active":"2024-09-05T07:57:10.348352+0000","last_peered":"2024-09-05T07:57:10.348352+0000","last_clean":"2024-09-05T07:57:10.348352+0000","last_became_active":"2024-09-05T07:29:30.641774+0000","last_became_peered":"2024-09-05T07:29:30.641774+0000","last_unstale":"2024-09-05T07:57:10.348352+0000","last_undegraded":"2024-09-05T07:57:10.348352+0000","last_fullsized":"2024-09-05T07:57:10.348352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:09:36.911425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"24'7","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:04.683555+0000","last_change":"2024-09-05T07:29:29.525374+0000","last_active":"2024-09-05T07:57:04.683555+0000","last_peered":"2024-09-05T07:57:04.683555+0000","last_clean":"2024-09-05T07:57:04.683555+0000","last_became_active":"2024-09-05T07:29:29.525044+0000","last_became_peered":"2024-09-05T07:29:29.525044+0000","last_unstale":"2024-09-05T07:57:04.683555+0000","last_undegraded":"2024-09-05T07:57:04.683555+0000","last_fullsized":"2024-09-05T07:57:04.683555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:25:35.862773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"24'52","reported_seq":80,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.346677+0000","last_change":"2024-09-05T07:29:30.563669+0000","last_active":"2024-09-05T07:57:10.346677+0000","last_peered":"2024-09-05T07:57:10.346677+0000","last_clean":"2024-09-05T07:57:10.346677+0000","last_became_active":"2024-09-05T07:29:30.563408+0000","last_became_peered":"2024-09-05T07:29:30.563408+0000","last_unstale":"2024-09-05T07:57:10.346677+0000","last_undegraded":"2024-09-05T07:57:10.346677+0000","last_fullsized":"2024-09-05T07:57:10.346677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:42:04.216273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":3705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'6","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:56:58.387111+0000","last_change":"2024-09-05T07:29:29.559111+0000","last_active":"2024-09-05T07:56:58.387111+0000","last_peered":"2024-09-05T07:56:58.387111+0000","last_clean":"2024-09-05T07:56:58.387111+0000","last_became_active":"2024-09-05T07:29:29.558856+0000","last_became_peered":"2024-09-05T07:29:29.558856+0000","last_unstale":"2024-09-05T07:56:58.387111+0000","last_undegraded":"2024-09-05T07:56:58.387111+0000","last_fullsized":"2024-09-05T07:56:58.387111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:47:57.187710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"24'61","reported_seq":89,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.339287+0000","last_change":"2024-09-05T07:29:30.624401+0000","last_active":"2024-09-05T07:57:10.339287+0000","last_peered":"2024-09-05T07:57:10.339287+0000","last_clean":"2024-09-05T07:57:10.339287+0000","last_became_active":"2024-09-05T07:29:30.624057+0000","last_became_peered":"2024-09-05T07:29:30.624057+0000","last_unstale":"2024-09-05T07:57:10.339287+0000","last_undegraded":"2024-09-05T07:57:10.339287+0000","last_fullsized":"2024-09-05T07:57:10.339287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:36:59.967135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":4070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"24'14","reported_seq":44,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:09.732085+0000","last_change":"2024-09-05T07:29:29.570940+0000","last_active":"2024-09-05T07:57:09.732085+0000","last_peered":"2024-09-05T07:57:09.732085+0000","last_clean":"2024-09-05T07:57:09.732085+0000","last_became_active":"2024-09-05T07:29:29.570478+0000","last_became_peered":"2024-09-05T07:29:29.570478+0000","last_unstale":"2024-09-05T07:57:09.732085+0000","last_undegraded":"2024-09-05T07:57:09.732085+0000","last_fullsized":"2024-09-05T07:57:09.732085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:35:54.465221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1754,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"24'65","reported_seq":93,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.298478+0000","last_change":"2024-09-05T07:29:30.563109+0000","last_active":"2024-09-05T07:57:10.298478+0000","last_peered":"2024-09-05T07:57:10.298478+0000","last_clean":"2024-09-05T07:57:10.298478+0000","last_became_active":"2024-09-05T07:29:30.562824+0000","last_became_peered":"2024-09-05T07:29:30.562824+0000","last_unstale":"2024-09-05T07:57:10.298478+0000","last_undegraded":"2024-09-05T07:57:10.298478+0000","last_fullsized":"2024-09-05T07:57:10.298478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:42:02.212868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":2542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":189,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:55:16.582147+0000","last_change":"2024-09-05T07:29:13.366600+0000","last_active":"2024-09-05T07:55:16.582147+0000","last_peered":"2024-09-05T07:55:16.582147+0000","last_clean":"2024-09-05T07:55:16.582147+0000","last_became_active":"2024-09-05T07:29:13.365841+0000","last_became_peered":"2024-09-05T07:29:13.365841+0000","last_unstale":"2024-09-05T07:55:16.582147+0000","last_undegraded":"2024-09-05T07:55:16.582147+0000","last_fullsized":"2024-09-05T07:55:16.582147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:10.874807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:10.874807+0000","last_clean_scrub_stamp":"2024-09-05T07:29:10.874807+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:21:17.673107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"22'6","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:54:31.541160+0000","last_change":"2024-09-05T07:29:29.563604+0000","last_active":"2024-09-05T07:54:31.541160+0000","last_peered":"2024-09-05T07:54:31.541160+0000","last_clean":"2024-09-05T07:54:31.541160+0000","last_became_active":"2024-09-05T07:29:29.562956+0000","last_became_peered":"2024-09-05T07:29:29.562956+0000","last_unstale":"2024-09-05T07:54:31.541160+0000","last_undegraded":"2024-09-05T07:54:31.541160+0000","last_fullsized":"2024-09-05T07:54:31.541160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:41.797972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"24'54","reported_seq":83,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.355759+0000","last_change":"2024-09-05T07:29:30.641543+0000","last_active":"2024-09-05T07:57:10.355759+0000","last_peered":"2024-09-05T07:57:10.355759+0000","last_clean":"2024-09-05T07:57:10.355759+0000","last_became_active":"2024-09-05T07:29:30.641243+0000","last_became_peered":"2024-09-05T07:29:30.641243+0000","last_unstale":"2024-09-05T07:57:10.355759+0000","last_undegraded":"2024-09-05T07:57:10.355759+0000","last_fullsized":"2024-09-05T07:57:10.355759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:34:54.335152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":3733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"24'325","reported_seq":356,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:13.252744+0000","last_change":"2024-09-05T07:29:29.479329+0000","last_active":"2024-09-05T07:57:13.252744+0000","last_peered":"2024-09-05T07:57:13.252744+0000","last_clean":"2024-09-05T07:57:13.252744+0000","last_became_active":"2024-09-05T07:29:29.479005+0000","last_became_peered":"2024-09-05T07:29:29.479005+0000","last_unstale":"2024-09-05T07:57:13.252744+0000","last_undegraded":"2024-09-05T07:57:13.252744+0000","last_fullsized":"2024-09-05T07:57:13.252744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:49:39.187534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3481379,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":316,"num_write_kb":3556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"24'55","reported_seq":84,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.295183+0000","last_change":"2024-09-05T07:29:30.641557+0000","last_active":"2024-09-05T07:57:10.295183+0000","last_peered":"2024-09-05T07:57:10.295183+0000","last_clean":"2024-09-05T07:57:10.295183+0000","last_became_active":"2024-09-05T07:29:30.641269+0000","last_became_peered":"2024-09-05T07:29:30.641269+0000","last_unstale":"2024-09-05T07:57:10.295183+0000","last_undegraded":"2024-09-05T07:57:10.295183+0000","last_fullsized":"2024-09-05T07:57:10.295183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:32:30.263430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":2599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"24'880","reported_seq":1780,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.687136+0000","last_change":"2024-09-05T07:29:29.568835+0000","last_active":"2024-09-05T07:57:10.687136+0000","last_peered":"2024-09-05T07:57:10.687136+0000","last_clean":"2024-09-05T07:57:10.687136+0000","last_became_active":"2024-09-05T07:29:29.568576+0000","last_became_peered":"2024-09-05T07:29:29.568576+0000","last_unstale":"2024-09-05T07:57:10.687136+0000","last_undegraded":"2024-09-05T07:57:10.687136+0000","last_fullsized":"2024-09-05T07:57:10.687136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:05:05.417016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182215,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":869,"num_read_kb":916,"num_write":877,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"24'71","reported_seq":100,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.317538+0000","last_change":"2024-09-05T07:29:30.660008+0000","last_active":"2024-09-05T07:57:10.317538+0000","last_peered":"2024-09-05T07:57:10.317538+0000","last_clean":"2024-09-05T07:57:10.317538+0000","last_became_active":"2024-09-05T07:29:30.659720+0000","last_became_peered":"2024-09-05T07:29:30.659720+0000","last_unstale":"2024-09-05T07:57:10.317538+0000","last_undegraded":"2024-09-05T07:57:10.317538+0000","last_fullsized":"2024-09-05T07:57:10.317538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:42:04.216273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":2450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"24'8","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:00.601508+0000","last_change":"2024-09-05T07:29:29.568569+0000","last_active":"2024-09-05T07:57:00.601508+0000","last_peered":"2024-09-05T07:57:00.601508+0000","last_clean":"2024-09-05T07:57:00.601508+0000","last_became_active":"2024-09-05T07:29:29.568307+0000","last_became_peered":"2024-09-05T07:29:29.568307+0000","last_unstale":"2024-09-05T07:57:00.601508+0000","last_undegraded":"2024-09-05T07:57:00.601508+0000","last_fullsized":"2024-09-05T07:57:00.601508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:12:38.814463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"24'89","reported_seq":118,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.332346+0000","last_change":"2024-09-05T07:29:30.642687+0000","last_active":"2024-09-05T07:57:10.332346+0000","last_peered":"2024-09-05T07:57:10.332346+0000","last_clean":"2024-09-05T07:57:10.332346+0000","last_became_active":"2024-09-05T07:29:30.642414+0000","last_became_peered":"2024-09-05T07:29:30.642414+0000","last_unstale":"2024-09-05T07:57:10.332346+0000","last_undegraded":"2024-09-05T07:57:10.332346+0000","last_fullsized":"2024-09-05T07:57:10.332346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:01:34.217228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":7430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"24'5","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:02.684653+0000","last_change":"2024-09-05T07:29:29.568739+0000","last_active":"2024-09-05T07:57:02.684653+0000","last_peered":"2024-09-05T07:57:02.684653+0000","last_clean":"2024-09-05T07:57:02.684653+0000","last_became_active":"2024-09-05T07:29:29.568499+0000","last_became_peered":"2024-09-05T07:29:29.568499+0000","last_unstale":"2024-09-05T07:57:02.684653+0000","last_undegraded":"2024-09-05T07:57:02.684653+0000","last_fullsized":"2024-09-05T07:57:02.684653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:05:05.417016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"24'66","reported_seq":95,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.351595+0000","last_change":"2024-09-05T07:29:30.641340+0000","last_active":"2024-09-05T07:57:10.351595+0000","last_peered":"2024-09-05T07:57:10.351595+0000","last_clean":"2024-09-05T07:57:10.351595+0000","last_became_active":"2024-09-05T07:29:30.640805+0000","last_became_peered":"2024-09-05T07:29:30.640805+0000","last_unstale":"2024-09-05T07:57:10.351595+0000","last_undegraded":"2024-09-05T07:57:10.351595+0000","last_fullsized":"2024-09-05T07:57:10.351595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:59.653492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":1781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"24'8","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:04.908697+0000","last_change":"2024-09-05T07:29:29.525212+0000","last_active":"2024-09-05T07:57:04.908697+0000","last_peered":"2024-09-05T07:57:04.908697+0000","last_clean":"2024-09-05T07:57:04.908697+0000","last_became_active":"2024-09-05T07:29:29.524918+0000","last_became_peered":"2024-09-05T07:29:29.524918+0000","last_unstale":"2024-09-05T07:57:04.908697+0000","last_undegraded":"2024-09-05T07:57:04.908697+0000","last_fullsized":"2024-09-05T07:57:04.908697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:09:35.771241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"24'64","reported_seq":93,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.294385+0000","last_change":"2024-09-05T07:29:30.658407+0000","last_active":"2024-09-05T07:57:10.294385+0000","last_peered":"2024-09-05T07:57:10.294385+0000","last_clean":"2024-09-05T07:57:10.294385+0000","last_became_active":"2024-09-05T07:29:30.658155+0000","last_became_peered":"2024-09-05T07:29:30.658155+0000","last_unstale":"2024-09-05T07:57:10.294385+0000","last_undegraded":"2024-09-05T07:57:10.294385+0000","last_fullsized":"2024-09-05T07:57:10.294385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:52:56.756904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":2545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"24'1349","reported_seq":1379,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:09.621151+0000","last_change":"2024-09-05T07:29:29.526674+0000","last_active":"2024-09-05T07:57:09.621151+0000","last_peered":"2024-09-05T07:57:09.621151+0000","last_clean":"2024-09-05T07:57:09.621151+0000","last_became_active":"2024-09-05T07:29:29.526421+0000","last_became_peered":"2024-09-05T07:29:29.526421+0000","last_unstale":"2024-09-05T07:57:09.621151+0000","last_undegraded":"2024-09-05T07:57:09.621151+0000","last_fullsized":"2024-09-05T07:57:09.621151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":1349,"log_dups_size":0,"ondisk_log_size":1349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:52:13.496606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3429,"num_write_kb":1221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"24'72","reported_seq":100,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.357110+0000","last_change":"2024-09-05T07:29:30.633806+0000","last_active":"2024-09-05T07:57:10.357110+0000","last_peered":"2024-09-05T07:57:10.357110+0000","last_clean":"2024-09-05T07:57:10.357110+0000","last_became_active":"2024-09-05T07:29:30.633535+0000","last_became_peered":"2024-09-05T07:29:30.633535+0000","last_unstale":"2024-09-05T07:57:10.357110+0000","last_undegraded":"2024-09-05T07:57:10.357110+0000","last_fullsized":"2024-09-05T07:57:10.357110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:40:35.334862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"24'12","reported_seq":42,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:04.909123+0000","last_change":"2024-09-05T07:29:29.524532+0000","last_active":"2024-09-05T07:57:04.909123+0000","last_peered":"2024-09-05T07:57:04.909123+0000","last_clean":"2024-09-05T07:57:04.909123+0000","last_became_active":"2024-09-05T07:29:29.524268+0000","last_became_peered":"2024-09-05T07:29:29.524268+0000","last_unstale":"2024-09-05T07:57:04.909123+0000","last_undegraded":"2024-09-05T07:57:04.909123+0000","last_fullsized":"2024-09-05T07:57:04.909123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:58.513308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'84","reported_seq":112,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.357971+0000","last_change":"2024-09-05T07:29:30.624431+0000","last_active":"2024-09-05T07:57:10.357971+0000","last_peered":"2024-09-05T07:57:10.357971+0000","last_clean":"2024-09-05T07:57:10.357971+0000","last_became_active":"2024-09-05T07:29:30.624117+0000","last_became_peered":"2024-09-05T07:29:30.624117+0000","last_unstale":"2024-09-05T07:57:10.357971+0000","last_undegraded":"2024-09-05T07:57:10.357971+0000","last_fullsized":"2024-09-05T07:57:10.357971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:10:00.845713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":5195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'9","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:07.727533+0000","last_change":"2024-09-05T07:29:29.561285+0000","last_active":"2024-09-05T07:57:07.727533+0000","last_peered":"2024-09-05T07:57:07.727533+0000","last_clean":"2024-09-05T07:57:07.727533+0000","last_became_active":"2024-09-05T07:29:29.561026+0000","last_became_peered":"2024-09-05T07:29:29.561026+0000","last_unstale":"2024-09-05T07:57:07.727533+0000","last_undegraded":"2024-09-05T07:57:07.727533+0000","last_fullsized":"2024-09-05T07:57:07.727533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:48:25.900221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"24'80","reported_seq":108,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:56:44.931312+0000","last_change":"2024-09-05T07:29:30.556889+0000","last_active":"2024-09-05T07:56:44.931312+0000","last_peered":"2024-09-05T07:56:44.931312+0000","last_clean":"2024-09-05T07:56:44.931312+0000","last_became_active":"2024-09-05T07:29:30.556627+0000","last_became_peered":"2024-09-05T07:29:30.556627+0000","last_unstale":"2024-09-05T07:56:44.931312+0000","last_undegraded":"2024-09-05T07:56:44.931312+0000","last_fullsized":"2024-09-05T07:56:44.931312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:20:01.152157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":7503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"24'11","reported_seq":41,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:56:58.431425+0000","last_change":"2024-09-05T07:29:29.526873+0000","last_active":"2024-09-05T07:56:58.431425+0000","last_peered":"2024-09-05T07:56:58.431425+0000","last_clean":"2024-09-05T07:56:58.431425+0000","last_became_active":"2024-09-05T07:29:29.526572+0000","last_became_peered":"2024-09-05T07:29:29.526572+0000","last_unstale":"2024-09-05T07:56:58.431425+0000","last_undegraded":"2024-09-05T07:56:58.431425+0000","last_fullsized":"2024-09-05T07:56:58.431425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:33:14.122911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"24'71","reported_seq":99,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.357807+0000","last_change":"2024-09-05T07:29:30.624592+0000","last_active":"2024-09-05T07:57:10.357807+0000","last_peered":"2024-09-05T07:57:10.357807+0000","last_clean":"2024-09-05T07:57:10.357807+0000","last_became_active":"2024-09-05T07:29:30.624109+0000","last_became_peered":"2024-09-05T07:29:30.624109+0000","last_unstale":"2024-09-05T07:57:10.357807+0000","last_undegraded":"2024-09-05T07:57:10.357807+0000","last_fullsized":"2024-09-05T07:57:10.357807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:22:35.613478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":2208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"24'5","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:56:47.894301+0000","last_change":"2024-09-05T07:29:29.569816+0000","last_active":"2024-09-05T07:56:47.894301+0000","last_peered":"2024-09-05T07:56:47.894301+0000","last_clean":"2024-09-05T07:56:47.894301+0000","last_became_active":"2024-09-05T07:29:29.569536+0000","last_became_peered":"2024-09-05T07:29:29.569536+0000","last_unstale":"2024-09-05T07:56:47.894301+0000","last_undegraded":"2024-09-05T07:56:47.894301+0000","last_fullsized":"2024-09-05T07:56:47.894301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:59:18.418220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"24'86","reported_seq":114,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.326387+0000","last_change":"2024-09-05T07:29:30.632805+0000","last_active":"2024-09-05T07:57:10.326387+0000","last_peered":"2024-09-05T07:57:10.326387+0000","last_clean":"2024-09-05T07:57:10.326387+0000","last_became_active":"2024-09-05T07:29:30.632502+0000","last_became_peered":"2024-09-05T07:29:30.632502+0000","last_unstale":"2024-09-05T07:57:10.326387+0000","last_undegraded":"2024-09-05T07:57:10.326387+0000","last_fullsized":"2024-09-05T07:57:10.326387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:59.653492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":4049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"24'545","reported_seq":575,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:02.691674+0000","last_change":"2024-09-05T07:29:29.563821+0000","last_active":"2024-09-05T07:57:02.691674+0000","last_peered":"2024-09-05T07:57:02.691674+0000","last_clean":"2024-09-05T07:57:02.691674+0000","last_became_active":"2024-09-05T07:29:29.563316+0000","last_became_peered":"2024-09-05T07:29:29.563316+0000","last_unstale":"2024-09-05T07:57:02.691674+0000","last_undegraded":"2024-09-05T07:57:02.691674+0000","last_fullsized":"2024-09-05T07:57:02.691674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:38.961328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":542,"num_write_kb":4368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"24'76","reported_seq":104,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.303070+0000","last_change":"2024-09-05T07:29:30.563106+0000","last_active":"2024-09-05T07:57:10.303070+0000","last_peered":"2024-09-05T07:57:10.303070+0000","last_clean":"2024-09-05T07:57:10.303070+0000","last_became_active":"2024-09-05T07:29:30.562776+0000","last_became_peered":"2024-09-05T07:29:30.562776+0000","last_unstale":"2024-09-05T07:57:10.303070+0000","last_undegraded":"2024-09-05T07:57:10.303070+0000","last_fullsized":"2024-09-05T07:57:10.303070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:37:16.174244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":1880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"24'79","reported_seq":106,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.297970+0000","last_change":"2024-09-05T07:29:30.558029+0000","last_active":"2024-09-05T07:57:10.297970+0000","last_peered":"2024-09-05T07:57:10.297970+0000","last_clean":"2024-09-05T07:57:10.297970+0000","last_became_active":"2024-09-05T07:29:30.557747+0000","last_became_peered":"2024-09-05T07:29:30.557747+0000","last_unstale":"2024-09-05T07:57:10.297970+0000","last_undegraded":"2024-09-05T07:57:10.297970+0000","last_fullsized":"2024-09-05T07:57:10.297970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:55:28.983976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":6364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"24'9","reported_seq":38,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:02.742338+0000","last_change":"2024-09-05T07:29:29.561333+0000","last_active":"2024-09-05T07:57:02.742338+0000","last_peered":"2024-09-05T07:57:02.742338+0000","last_clean":"2024-09-05T07:57:02.742338+0000","last_became_active":"2024-09-05T07:29:29.561065+0000","last_became_peered":"2024-09-05T07:29:29.561065+0000","last_unstale":"2024-09-05T07:57:02.742338+0000","last_undegraded":"2024-09-05T07:57:02.742338+0000","last_fullsized":"2024-09-05T07:57:02.742338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:38.961328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"24'45","reported_seq":72,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.321239+0000","last_change":"2024-09-05T07:29:30.566028+0000","last_active":"2024-09-05T07:57:10.321239+0000","last_peered":"2024-09-05T07:57:10.321239+0000","last_clean":"2024-09-05T07:57:10.321239+0000","last_became_active":"2024-09-05T07:29:30.565787+0000","last_became_peered":"2024-09-05T07:29:30.565787+0000","last_unstale":"2024-09-05T07:57:10.321239+0000","last_undegraded":"2024-09-05T07:57:10.321239+0000","last_fullsized":"2024-09-05T07:57:10.321239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:59.653492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":3021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"24'1204","reported_seq":1233,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:02.679237+0000","last_change":"2024-09-05T07:29:29.559969+0000","last_active":"2024-09-05T07:57:02.679237+0000","last_peered":"2024-09-05T07:57:02.679237+0000","last_clean":"2024-09-05T07:57:02.679237+0000","last_became_active":"2024-09-05T07:29:29.559675+0000","last_became_peered":"2024-09-05T07:29:29.559675+0000","last_unstale":"2024-09-05T07:57:02.679237+0000","last_undegraded":"2024-09-05T07:57:02.679237+0000","last_fullsized":"2024-09-05T07:57:02.679237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":1204,"log_dups_size":0,"ondisk_log_size":1204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:53:39.010323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1200,"num_write_kb":8869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"24'101","reported_seq":130,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.316956+0000","last_change":"2024-09-05T07:29:30.657369+0000","last_active":"2024-09-05T07:57:10.316956+0000","last_peered":"2024-09-05T07:57:10.316956+0000","last_clean":"2024-09-05T07:57:10.316956+0000","last_became_active":"2024-09-05T07:29:30.656876+0000","last_became_peered":"2024-09-05T07:29:30.656876+0000","last_unstale":"2024-09-05T07:57:10.316956+0000","last_undegraded":"2024-09-05T07:57:10.316956+0000","last_fullsized":"2024-09-05T07:57:10.316956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:09:22.026287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":8259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"24'716","reported_seq":747,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:56:58.419911+0000","last_change":"2024-09-05T07:29:29.567440+0000","last_active":"2024-09-05T07:56:58.419911+0000","last_peered":"2024-09-05T07:56:58.419911+0000","last_clean":"2024-09-05T07:56:58.419911+0000","last_became_active":"2024-09-05T07:29:29.567129+0000","last_became_peered":"2024-09-05T07:29:29.567129+0000","last_unstale":"2024-09-05T07:56:58.419911+0000","last_undegraded":"2024-09-05T07:56:58.419911+0000","last_fullsized":"2024-09-05T07:56:58.419911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":716,"log_dups_size":0,"ondisk_log_size":716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:54:00.339029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":711,"num_write_kb":4517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"24'60","reported_seq":89,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.313108+0000","last_change":"2024-09-05T07:29:30.657929+0000","last_active":"2024-09-05T07:57:10.313108+0000","last_peered":"2024-09-05T07:57:10.313108+0000","last_clean":"2024-09-05T07:57:10.313108+0000","last_became_active":"2024-09-05T07:29:30.657625+0000","last_became_peered":"2024-09-05T07:29:30.657625+0000","last_unstale":"2024-09-05T07:57:10.313108+0000","last_undegraded":"2024-09-05T07:57:10.313108+0000","last_fullsized":"2024-09-05T07:57:10.313108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:37:46.507371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":2166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"24'587","reported_seq":618,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:56:53.509229+0000","last_change":"2024-09-05T07:29:29.526099+0000","last_active":"2024-09-05T07:56:53.509229+0000","last_peered":"2024-09-05T07:56:53.509229+0000","last_clean":"2024-09-05T07:56:53.509229+0000","last_became_active":"2024-09-05T07:29:29.525832+0000","last_became_peered":"2024-09-05T07:29:29.525832+0000","last_unstale":"2024-09-05T07:56:53.509229+0000","last_undegraded":"2024-09-05T07:56:53.509229+0000","last_fullsized":"2024-09-05T07:56:53.509229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:44:32.741898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3789,"num_write_kb":295314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4716,"ondisk_log_size":4716,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":37226760,"num_objects":107,"num_object_clones":0,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":869,"num_read_kb":916,"num_write":10472,"num_write_kb":41821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":74694656,"data_stored":74453520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8493,"ondisk_log_size":8493,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719477079,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61848,"kb_used_data":12616,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94309992,"statfs":{"total":96636764160,"available":96573431808,"internally_reserved":0,"allocated":12918784,"data_stored":12732533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509782,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35736,"kb_used_data":4552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94336104,"statfs":{"total":96636764160,"available":96600170496,"internally_reserved":0,"allocated":4661248,"data_stored":4466126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509782,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47156,"kb_used_data":15972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94324684,"statfs":{"total":96636764160,"available":96588476416,"internally_reserved":0,"allocated":16355328,"data_stored":16156262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509782,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47952,"kb_used_data":8448,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323888,"statfs":{"total":96636764160,"available":96587661312,"internally_reserved":0,"allocated":8650752,"data_stored":8478013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509781,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48536,"kb_used_data":9032,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323304,"statfs":{"total":96636764160,"available":96587063296,"internally_reserved":0,"allocated":9248768,"data_stored":9069055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509781,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47908,"kb_used_data":12564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323932,"statfs":{"total":96636764160,"available":96587706368,"internally_reserved":0,"allocated":12865536,"data_stored":12675287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542486,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43860,"kb_used_data":4356,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327980,"statfs":{"total":96636764160,"available":96591851520,"internally_reserved":0,"allocated":4460544,"data_stored":4286517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542485,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43828,"kb_used_data":8484,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94328012,"statfs":{"total":96636764160,"available":96591884288,"internally_reserved":0,"allocated":8687616,"data_stored":8479783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12619776,"data_stored":12586622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8409088,"data_stored":8390022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16109568,"data_stored":16067597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8441856,"data_stored":8391118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12079104,"data_stored":12053500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4214784,"data_stored":4197852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4415488,"data_stored":4377461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T07:57:18.286 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-05T07:57:18.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.420+0000 7f4535853640 1 Processor -- start 2024-09-05T07:57:18.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.421+0000 7f4535853640 1 -- start start 2024-09-05T07:57:18.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.421+0000 7f4535853640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45300cabe0 0x7f453015a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:18.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.421+0000 7f4535853640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f45300cafc0 0x7f453015dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:18.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.421+0000 7f4535853640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45300c8020 con 0x7f453015e2c0 2024-09-05T07:57:18.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.421+0000 7f4535853640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f45300c3bd0 con 0x7f45300cafc0 2024-09-05T07:57:18.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.421+0000 7f4535853640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f453015e7a0 con 0x7f45300cabe0 2024-09-05T07:57:18.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.422+0000 7f452effd640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45300cabe0 0x7f453015a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:18.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.422+0000 7f452e7fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f45300cafc0 0x7f453015dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:18.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.423+0000 7f452effd640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45300cabe0 0x7f453015a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:51024/0 (socket says 172.21.15.17:51024) 2024-09-05T07:57:18.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.423+0000 7f452effd640 1 -- 172.21.15.17:0/129504200 learned_addr learned my addr 172.21.15.17:0/129504200 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:18.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.425+0000 7f452effd640 1 -- 172.21.15.17:0/129504200 >> v2:172.21.15.26:3300/0 conn(0x7f45300cafc0 msgr2=0x7f453015dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:57:18.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.425+0000 7f452effd640 1 --2- 172.21.15.17:0/129504200 >> v2:172.21.15.26:3300/0 conn(0x7f45300cafc0 0x7f453015dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:18.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.425+0000 7f452effd640 1 -- 172.21.15.17:0/129504200 >> v1:172.21.15.26:6789/0 conn(0x7f453015e2c0 legacy=0x7f45300c4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:18.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.425+0000 7f452effd640 1 -- 172.21.15.17:0/129504200 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f453015ea60 con 0x7f45300cabe0 2024-09-05T07:57:18.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.427+0000 7f452effd640 1 --2- 172.21.15.17:0/129504200 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45300cabe0 0x7f453015a790 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4520009e50 tx=0x7f452002a7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=549840b8dd22bdd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:18.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.431+0000 7f452dffb640 1 -- 172.21.15.17:0/129504200 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4520036070 con 0x7f45300cabe0 2024-09-05T07:57:18.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.431+0000 7f452dffb640 1 -- 172.21.15.17:0/129504200 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4520031600 con 0x7f45300cabe0 2024-09-05T07:57:18.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.431+0000 7f452dffb640 1 -- 172.21.15.17:0/129504200 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45200319d0 con 0x7f45300cabe0 2024-09-05T07:57:18.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.431+0000 7f4535853640 1 -- 172.21.15.17:0/129504200 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45300cabe0 msgr2=0x7f453015a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:18.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.431+0000 7f4535853640 1 --2- 172.21.15.17:0/129504200 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45300cabe0 0x7f453015a790 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4520009e50 tx=0x7f452002a7a0 comp rx=0 tx=0).stop 2024-09-05T07:57:18.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.432+0000 7f4535853640 1 -- 172.21.15.17:0/129504200 shutdown_connections 2024-09-05T07:57:18.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.432+0000 7f4535853640 1 --2- 172.21.15.17:0/129504200 >> v2:172.21.15.26:3300/0 conn(0x7f45300cafc0 0x7f453015dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:18.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.432+0000 7f4535853640 1 --2- 172.21.15.17:0/129504200 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45300cabe0 0x7f453015a790 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:18.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.432+0000 7f4535853640 1 -- 172.21.15.17:0/129504200 >> 172.21.15.17:0/129504200 conn(0x7f45300715f0 msgr2=0x7f45300719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:18.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.432+0000 7f4535853640 1 -- 172.21.15.17:0/129504200 shutdown_connections 2024-09-05T07:57:18.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.432+0000 7f4535853640 1 -- 172.21.15.17:0/129504200 wait complete. 2024-09-05T07:57:18.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.433+0000 7f4535853640 1 Processor -- start 2024-09-05T07:57:18.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.433+0000 7f4535853640 1 -- start start 2024-09-05T07:57:18.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.434+0000 7f4535853640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45300cabe0 0x7f45300c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:18.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.434+0000 7f4535853640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45300cafc0 0x7f453014f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:18.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.434+0000 7f4535853640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f453015e2c0 0x7f453014f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:18.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.434+0000 7f4535853640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f45300cb3c0 con 0x7f45300cabe0 2024-09-05T07:57:18.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.434+0000 7f4535853640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f45300c3860 con 0x7f453015e2c0 2024-09-05T07:57:18.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.434+0000 7f4535853640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f4530154aa0 con 0x7f45300cafc0 2024-09-05T07:57:18.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.434+0000 7f452e7fc640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45300cafc0 0x7f453014f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:18.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.434+0000 7f452f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f453015e2c0 0x7f453014f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:18.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.434+0000 7f452e7fc640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45300cafc0 0x7f453014f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:51036/0 (socket says 172.21.15.17:51036) 2024-09-05T07:57:18.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.434+0000 7f452e7fc640 1 -- 172.21.15.17:0/548466000 learned_addr learned my addr 172.21.15.17:0/548466000 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:18.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.437+0000 7f452effd640 1 --2- 172.21.15.17:0/548466000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45300cabe0 0x7f45300c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:18.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.438+0000 7f452e7fc640 1 -- 172.21.15.17:0/548466000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f453015e2c0 msgr2=0x7f453014f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:18.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.438+0000 7f452e7fc640 1 --2- 172.21.15.17:0/548466000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f453015e2c0 0x7f453014f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:18.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.438+0000 7f452e7fc640 1 -- 172.21.15.17:0/548466000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45300cabe0 msgr2=0x7f45300c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:18.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.438+0000 7f452e7fc640 1 --2- 172.21.15.17:0/548466000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45300cabe0 0x7f45300c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:18.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.438+0000 7f452e7fc640 1 -- 172.21.15.17:0/548466000 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45300ce830 con 0x7f45300cafc0 2024-09-05T07:57:18.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.441+0000 7f452e7fc640 1 --2- 172.21.15.17:0/548466000 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45300cafc0 0x7f453014f480 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f451800e9b0 tx=0x7f451800ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:18.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.446+0000 7f4527fff640 1 -- 172.21.15.17:0/548466000 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4518017070 con 0x7f45300cafc0 2024-09-05T07:57:18.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.446+0000 7f4527fff640 1 -- 172.21.15.17:0/548466000 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f451800c9a0 con 0x7f45300cafc0 2024-09-05T07:57:18.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.446+0000 7f4527fff640 1 -- 172.21.15.17:0/548466000 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f451800cd70 con 0x7f45300cafc0 2024-09-05T07:57:18.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.446+0000 7f4535853640 1 -- 172.21.15.17:0/548466000 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45300ce2b0 con 0x7f45300cafc0 2024-09-05T07:57:18.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.446+0000 7f4535853640 1 -- 172.21.15.17:0/548466000 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f453014e9a0 con 0x7f45300cafc0 2024-09-05T07:57:18.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.447+0000 7f4535853640 1 -- 172.21.15.17:0/548466000 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f453015dd80 con 0x7f45300cafc0 2024-09-05T07:57:18.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.720+0000 7f4527fff640 1 -- 172.21.15.17:0/548466000 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f451801a070 con 0x7f45300cafc0 2024-09-05T07:57:18.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.720+0000 7f4527fff640 1 --2- 172.21.15.17:0/548466000 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f451006beb0 0x7f451006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:18.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.721+0000 7f452effd640 1 --2- 172.21.15.17:0/548466000 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f451006beb0 0x7f451006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:18.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.721+0000 7f452effd640 1 --2- 172.21.15.17:0/548466000 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f451006beb0 0x7f451006e370 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4520033000 tx=0x7f4520009000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:18.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.727+0000 7f4527fff640 1 -- 172.21.15.17:0/548466000 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f4518057900 con 0x7f45300cafc0 2024-09-05T07:57:18.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.744+0000 7f4527fff640 1 -- 172.21.15.17:0/548466000 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4518059860 con 0x7f45300cafc0 2024-09-05T07:57:18.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.926+0000 7f4535853640 1 -- 172.21.15.17:0/548466000 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f453006ef00 con 0x7f45300cafc0 2024-09-05T07:57:18.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.968+0000 7f4527fff640 1 -- 172.21.15.17:0/548466000 <== mon.2 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+16670 (secure 0 0 0) 0x7f451805db60 con 0x7f45300cafc0 2024-09-05T07:57:18.969 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:57:18.969 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":24,"fsid":"848dac54-74f8-48f3-8686-c6495dcb972b","created":"2024-09-05T07:28:54.070215+0000","modified":"2024-09-05T07:30:02.065968+0000","last_up_change":"2024-09-05T07:29:11.992790+0000","last_in_change":"2024-09-05T07:29:00.001829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T07:29:10.227047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T07:29:27.905154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T07:29:29.039672+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f01a8b4-dc10-4cdf-a65e-b7f96de4e2b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2731314060},{"type":"v1","addr":"172.21.15.17:6825","nonce":2731314060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2731314060},{"type":"v1","addr":"172.21.15.17:6827","nonce":2731314060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2731314060},{"type":"v1","addr":"172.21.15.17:6831","nonce":2731314060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2731314060},{"type":"v1","addr":"172.21.15.17:6829","nonce":2731314060}]},"public_addr":"172.21.15.17:6825/2731314060","cluster_addr":"172.21.15.17:6827/2731314060","heartbeat_back_addr":"172.21.15.17:6831/2731314060","heartbeat_front_addr":"172.21.15.17:6829/2731314060","state":["exists","up"]},{"osd":1,"uuid":"d16867fb-2290-486c-9ac8-327ca54326d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3327408852},{"type":"v1","addr":"172.21.15.17:6817","nonce":3327408852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3327408852},{"type":"v1","addr":"172.21.15.17:6819","nonce":3327408852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3327408852},{"type":"v1","addr":"172.21.15.17:6823","nonce":3327408852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3327408852},{"type":"v1","addr":"172.21.15.17:6821","nonce":3327408852}]},"public_addr":"172.21.15.17:6817/3327408852","cluster_addr":"172.21.15.17:6819/3327408852","heartbeat_back_addr":"172.21.15.17:6823/3327408852","heartbeat_front_addr":"172.21.15.17:6821/3327408852","state":["exists","up"]},{"osd":2,"uuid":"632ad558-bd14-4240-a8f1-5beda951b3b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":363420609},{"type":"v1","addr":"172.21.15.17:6809","nonce":363420609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":363420609},{"type":"v1","addr":"172.21.15.17:6811","nonce":363420609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":363420609},{"type":"v1","addr":"172.21.15.17:6815","nonce":363420609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":363420609},{"type":"v1","addr":"172.21.15.17:6813","nonce":363420609}]},"public_addr":"172.21.15.17:6809/363420609","cluster_addr":"172.21.15.17:6811/363420609","heartbeat_back_addr":"172.21.15.17:6815/363420609","heartbeat_front_addr":"172.21.15.17:6813/363420609","state":["exists","up"]},{"osd":3,"uuid":"9727a970-8f98-45b9-8eca-62da1f28ff17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":3512342499},{"type":"v1","addr":"172.21.15.17:6801","nonce":3512342499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":3512342499},{"type":"v1","addr":"172.21.15.17:6803","nonce":3512342499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":3512342499},{"type":"v1","addr":"172.21.15.17:6807","nonce":3512342499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":3512342499},{"type":"v1","addr":"172.21.15.17:6805","nonce":3512342499}]},"public_addr":"172.21.15.17:6801/3512342499","cluster_addr":"172.21.15.17:6803/3512342499","heartbeat_back_addr":"172.21.15.17:6807/3512342499","heartbeat_front_addr":"172.21.15.17:6805/3512342499","state":["exists","up"]},{"osd":4,"uuid":"0e0141e0-51f1-4229-861f-1992afe70c96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6803","nonce":3740556509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6805","nonce":3740556509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6809","nonce":3740556509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6807","nonce":3740556509}]},"public_addr":"172.21.15.26:6803/3740556509","cluster_addr":"172.21.15.26:6805/3740556509","heartbeat_back_addr":"172.21.15.26:6809/3740556509","heartbeat_front_addr":"172.21.15.26:6807/3740556509","state":["exists","up"]},{"osd":5,"uuid":"5603d79b-fcf8-45aa-a1db-96918af450be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3020770750},{"type":"v1","addr":"172.21.15.26:6819","nonce":3020770750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3020770750},{"type":"v1","addr":"172.21.15.26:6821","nonce":3020770750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3020770750},{"type":"v1","addr":"172.21.15.26:6825","nonce":3020770750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3020770750},{"type":"v1","addr":"172.21.15.26:6823","nonce":3020770750}]},"public_addr":"172.21.15.26:6819/3020770750","cluster_addr":"172.21.15.26:6821/3020770750","heartbeat_back_addr":"172.21.15.26:6825/3020770750","heartbeat_front_addr":"172.21.15.26:6823/3020770750","state":["exists","up"]},{"osd":6,"uuid":"14f3b696-1b3c-4749-8f61-ac10edbb5b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6811","nonce":158775588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6813","nonce":158775588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6817","nonce":158775588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6815","nonce":158775588}]},"public_addr":"172.21.15.26:6811/158775588","cluster_addr":"172.21.15.26:6813/158775588","heartbeat_back_addr":"172.21.15.26:6817/158775588","heartbeat_front_addr":"172.21.15.26:6815/158775588","state":["exists","up"]},{"osd":7,"uuid":"be7b4121-c71b-4908-ba4a-9c4389423201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":4176189153},{"type":"v1","addr":"172.21.15.26:6827","nonce":4176189153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":4176189153},{"type":"v1","addr":"172.21.15.26:6829","nonce":4176189153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":4176189153},{"type":"v1","addr":"172.21.15.26:6833","nonce":4176189153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":4176189153},{"type":"v1","addr":"172.21.15.26:6831","nonce":4176189153}]},"public_addr":"172.21.15.26:6827/4176189153","cluster_addr":"172.21.15.26:6829/4176189153","heartbeat_back_addr":"172.21.15.26:6833/4176189153","heartbeat_front_addr":"172.21.15.26:6831/4176189153","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.923722+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.404043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.275202+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.434925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.159606+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.379036+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.196000+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.387333+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T07:57:18.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.970+0000 7f4535853640 1 -- 172.21.15.17:0/548466000 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f451006beb0 msgr2=0x7f451006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:18.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.970+0000 7f4535853640 1 --2- 172.21.15.17:0/548466000 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f451006beb0 0x7f451006e370 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4520033000 tx=0x7f4520009000 comp rx=0 tx=0).stop 2024-09-05T07:57:18.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.970+0000 7f4535853640 1 -- 172.21.15.17:0/548466000 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45300cafc0 msgr2=0x7f453014f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:18.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.970+0000 7f4535853640 1 --2- 172.21.15.17:0/548466000 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45300cafc0 0x7f453014f480 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f451800e9b0 tx=0x7f451800ee70 comp rx=0 tx=0).stop 2024-09-05T07:57:18.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.970+0000 7f4535853640 1 -- 172.21.15.17:0/548466000 shutdown_connections 2024-09-05T07:57:18.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.970+0000 7f4535853640 1 --2- 172.21.15.17:0/548466000 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f451006beb0 0x7f451006e370 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:18.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.970+0000 7f4535853640 1 --2- 172.21.15.17:0/548466000 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45300cafc0 0x7f453014f480 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:18.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.970+0000 7f4535853640 1 --2- 172.21.15.17:0/548466000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f453015e2c0 0x7f453014f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:18.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.970+0000 7f4535853640 1 --2- 172.21.15.17:0/548466000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45300cabe0 0x7f45300c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:18.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.970+0000 7f4535853640 1 -- 172.21.15.17:0/548466000 >> 172.21.15.17:0/548466000 conn(0x7f45300715f0 msgr2=0x7f453006e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:18.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.970+0000 7f4535853640 1 -- 172.21.15.17:0/548466000 shutdown_connections 2024-09-05T07:57:18.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:18.970+0000 7f4535853640 1 -- 172.21.15.17:0/548466000 wait complete. 2024-09-05T07:57:19.983 INFO:tasks.ceph:Scrubbing osd.0 2024-09-05T07:57:19.984 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-05T07:57:20.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.092+0000 7f54053fd640 1 Processor -- start 2024-09-05T07:57:20.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.092+0000 7f54053fd640 1 -- start start 2024-09-05T07:57:20.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.093+0000 7f54053fd640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f54000cabd0 0x7f54000c9b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:20.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.093+0000 7f54053fd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f540006d8f0 0x7f540015a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:20.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.093+0000 7f54053fd640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54000c8e80 con 0x7f54000cafb0 2024-09-05T07:57:20.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.093+0000 7f54053fd640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f540015b930 con 0x7f540006d8f0 2024-09-05T07:57:20.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.093+0000 7f54053fd640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f54000c96c0 con 0x7f54000cabd0 2024-09-05T07:57:20.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.093+0000 7f53f67fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f540006d8f0 0x7f540015a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:20.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.094+0000 7f53feffd640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f54000cabd0 0x7f54000c9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:20.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.094+0000 7f53f67fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f540006d8f0 0x7f540015a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51674/0 (socket says 172.21.15.17:51674) 2024-09-05T07:57:20.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.094+0000 7f53feffd640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f54000cabd0 0x7f54000c9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:54116/0 (socket says 172.21.15.17:54116) 2024-09-05T07:57:20.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.094+0000 7f53f67fc640 1 -- 172.21.15.17:0/1650176343 learned_addr learned my addr 172.21.15.17:0/1650176343 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:20.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.096+0000 7f53feffd640 1 -- 172.21.15.17:0/1650176343 >> v2:172.21.15.17:3300/0 conn(0x7f540006d8f0 msgr2=0x7f540015a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:57:20.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.096+0000 7f53feffd640 1 --2- 172.21.15.17:0/1650176343 >> v2:172.21.15.17:3300/0 conn(0x7f540006d8f0 0x7f540015a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:20.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.096+0000 7f53feffd640 1 -- 172.21.15.17:0/1650176343 >> v1:172.21.15.17:6789/0 conn(0x7f54000cafb0 legacy=0x7f540015dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:20.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.096+0000 7f53feffd640 1 -- 172.21.15.17:0/1650176343 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f540006bd40 con 0x7f54000cabd0 2024-09-05T07:57:20.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.098+0000 7f53feffd640 1 --2- 172.21.15.17:0/1650176343 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f54000cabd0 0x7f54000c9b50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f53f00097a0 tx=0x7f53f002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f25620569f756737 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:20.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.103+0000 7f53fe7fc640 1 -- 172.21.15.17:0/1650176343 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f0037070 con 0x7f54000cabd0 2024-09-05T07:57:20.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.103+0000 7f53fe7fc640 1 -- 172.21.15.17:0/1650176343 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53f002ae50 con 0x7f54000cabd0 2024-09-05T07:57:20.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.103+0000 7f53fe7fc640 1 -- 172.21.15.17:0/1650176343 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f0032660 con 0x7f54000cabd0 2024-09-05T07:57:20.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.103+0000 7f54053fd640 1 -- 172.21.15.17:0/1650176343 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f54000cabd0 msgr2=0x7f54000c9b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:20.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.103+0000 7f54053fd640 1 --2- 172.21.15.17:0/1650176343 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f54000cabd0 0x7f54000c9b50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f53f00097a0 tx=0x7f53f002a100 comp rx=0 tx=0).stop 2024-09-05T07:57:20.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.103+0000 7f54053fd640 1 -- 172.21.15.17:0/1650176343 shutdown_connections 2024-09-05T07:57:20.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.103+0000 7f54053fd640 1 --2- 172.21.15.17:0/1650176343 >> v2:172.21.15.17:3300/0 conn(0x7f540006d8f0 0x7f540015a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:20.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.103+0000 7f54053fd640 1 --2- 172.21.15.17:0/1650176343 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f54000cabd0 0x7f54000c9b50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:20.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.103+0000 7f54053fd640 1 -- 172.21.15.17:0/1650176343 >> 172.21.15.17:0/1650176343 conn(0x7f5400071500 msgr2=0x7f5400071910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:20.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.103+0000 7f54053fd640 1 -- 172.21.15.17:0/1650176343 shutdown_connections 2024-09-05T07:57:20.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.103+0000 7f54053fd640 1 -- 172.21.15.17:0/1650176343 wait complete. 2024-09-05T07:57:20.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.104+0000 7f54053fd640 1 Processor -- start 2024-09-05T07:57:20.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.105+0000 7f54053fd640 1 -- start start 2024-09-05T07:57:20.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.105+0000 7f54053fd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f540006d8f0 0x7f540015cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:20.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.105+0000 7f54053fd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54000cabd0 0x7f54000c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:20.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.105+0000 7f54053fd640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f54000cafb0 0x7f54001f4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:20.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.105+0000 7f54053fd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f54000cdd60 con 0x7f54000cabd0 2024-09-05T07:57:20.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.105+0000 7f54053fd640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f54000c9350 con 0x7f540006d8f0 2024-09-05T07:57:20.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.105+0000 7f54053fd640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f54000c8b40 con 0x7f54000cafb0 2024-09-05T07:57:20.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.106+0000 7f53f67fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54000cabd0 0x7f54000c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:20.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.106+0000 7f53feffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f540006d8f0 0x7f540015cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:20.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.106+0000 7f53ff7fe640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f54000cafb0 0x7f54001f4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:20.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.106+0000 7f53f67fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54000cabd0 0x7f54000c7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51680/0 (socket says 172.21.15.17:51680) 2024-09-05T07:57:20.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.106+0000 7f53f67fc640 1 -- 172.21.15.17:0/4288646894 learned_addr learned my addr 172.21.15.17:0/4288646894 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:20.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.110+0000 7f53f67fc640 1 -- 172.21.15.17:0/4288646894 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f54000cafb0 msgr2=0x7f54001f4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:20.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.110+0000 7f53f67fc640 1 --2- 172.21.15.17:0/4288646894 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f54000cafb0 0x7f54001f4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:20.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.110+0000 7f53f67fc640 1 -- 172.21.15.17:0/4288646894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f540006d8f0 msgr2=0x7f540015cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:20.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.110+0000 7f53f67fc640 1 --2- 172.21.15.17:0/4288646894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f540006d8f0 0x7f540015cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:20.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.110+0000 7f53f67fc640 1 -- 172.21.15.17:0/4288646894 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5400157e10 con 0x7f54000cabd0 2024-09-05T07:57:20.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.112+0000 7f53f67fc640 1 --2- 172.21.15.17:0/4288646894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54000cabd0 0x7f54000c7d00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f53e800e8a0 tx=0x7f53e800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:20.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.116+0000 7f53f7fff640 1 -- 172.21.15.17:0/4288646894 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e8017070 con 0x7f54000cabd0 2024-09-05T07:57:20.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.116+0000 7f53f7fff640 1 -- 172.21.15.17:0/4288646894 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53e800c8e0 con 0x7f54000cabd0 2024-09-05T07:57:20.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.116+0000 7f53f7fff640 1 -- 172.21.15.17:0/4288646894 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e800cc90 con 0x7f54000cabd0 2024-09-05T07:57:20.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.116+0000 7f54053fd640 1 -- 172.21.15.17:0/4288646894 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54001580f0 con 0x7f54000cabd0 2024-09-05T07:57:20.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.116+0000 7f54053fd640 1 -- 172.21.15.17:0/4288646894 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54001586b0 con 0x7f54000cabd0 2024-09-05T07:57:20.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.117+0000 7f54053fd640 1 -- 172.21.15.17:0/4288646894 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f54000b2d90 con 0x7f54000cabd0 2024-09-05T07:57:20.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.136+0000 7f53f7fff640 1 -- 172.21.15.17:0/4288646894 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f53e801a070 con 0x7f54000cabd0 2024-09-05T07:57:20.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.136+0000 7f53f7fff640 1 --2- 172.21.15.17:0/4288646894 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f53e006beb0 0x7f53e006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:20.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.137+0000 7f53feffd640 1 --2- 172.21.15.17:0/4288646894 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f53e006beb0 0x7f53e006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:20.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.137+0000 7f53feffd640 1 --2- 172.21.15.17:0/4288646894 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f53e006beb0 0x7f53e006e370 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f53f0034000 tx=0x7f53f002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:20.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.140+0000 7f53f7fff640 1 -- 172.21.15.17:0/4288646894 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f53e800ce30 con 0x7f54000cabd0 2024-09-05T07:57:20.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.140+0000 7f53f7fff640 1 --2- 172.21.15.17:0/4288646894 >> [v2:172.21.15.17:6824/2731314060,v1:172.21.15.17:6825/2731314060] conn(0x7f53e00740b0 0x7f53e00764d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:20.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.140+0000 7f53f7fff640 1 -- 172.21.15.17:0/4288646894 --> [v2:172.21.15.17:6824/2731314060,v1:172.21.15.17:6825/2731314060] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f53e8013e50 con 0x7f53e00740b0 2024-09-05T07:57:20.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.140+0000 7f53ff7fe640 1 --2- 172.21.15.17:0/4288646894 >> [v2:172.21.15.17:6824/2731314060,v1:172.21.15.17:6825/2731314060] conn(0x7f53e00740b0 0x7f53e00764d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:20.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.140+0000 7f53ff7fe640 1 --2- 172.21.15.17:0/4288646894 >> [v2:172.21.15.17:6824/2731314060,v1:172.21.15.17:6825/2731314060] conn(0x7f53e00740b0 0x7f53e00764d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:20.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.141+0000 7f53f7fff640 1 -- 172.21.15.17:0/4288646894 <== osd.0 v2:172.21.15.17:6824/2731314060 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f53e8013e50 con 0x7f53e00740b0 2024-09-05T07:57:20.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.153+0000 7f54053fd640 1 -- 172.21.15.17:0/4288646894 --> [v2:172.21.15.17:6824/2731314060,v1:172.21.15.17:6825/2731314060] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f540006c2c0 con 0x7f53e00740b0 2024-09-05T07:57:20.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.154+0000 7f53f7fff640 1 -- 172.21.15.17:0/4288646894 <== osd.0 v2:172.21.15.17:6824/2731314060 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f540006c2c0 con 0x7f53e00740b0 2024-09-05T07:57:20.154 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-05T07:57:20.155 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-05T07:57:20.155 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-05T07:57:20.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.154+0000 7f54053fd640 1 -- 172.21.15.17:0/4288646894 >> [v2:172.21.15.17:6824/2731314060,v1:172.21.15.17:6825/2731314060] conn(0x7f53e00740b0 msgr2=0x7f53e00764d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:20.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.154+0000 7f54053fd640 1 --2- 172.21.15.17:0/4288646894 >> [v2:172.21.15.17:6824/2731314060,v1:172.21.15.17:6825/2731314060] conn(0x7f53e00740b0 0x7f53e00764d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:20.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.154+0000 7f54053fd640 1 -- 172.21.15.17:0/4288646894 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f53e006beb0 msgr2=0x7f53e006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:20.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.154+0000 7f54053fd640 1 --2- 172.21.15.17:0/4288646894 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f53e006beb0 0x7f53e006e370 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f53f0034000 tx=0x7f53f002e000 comp rx=0 tx=0).stop 2024-09-05T07:57:20.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.154+0000 7f54053fd640 1 -- 172.21.15.17:0/4288646894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54000cabd0 msgr2=0x7f54000c7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:20.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.154+0000 7f54053fd640 1 --2- 172.21.15.17:0/4288646894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54000cabd0 0x7f54000c7d00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f53e800e8a0 tx=0x7f53e800ed60 comp rx=0 tx=0).stop 2024-09-05T07:57:20.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.154+0000 7f53ff7fe640 1 -- 172.21.15.17:0/4288646894 reap_dead start 2024-09-05T07:57:20.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.154+0000 7f54053fd640 1 -- 172.21.15.17:0/4288646894 shutdown_connections 2024-09-05T07:57:20.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.154+0000 7f54053fd640 1 -- 172.21.15.17:0/4288646894 >> 172.21.15.17:0/4288646894 conn(0x7f5400071500 msgr2=0x7f540006f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:20.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.154+0000 7f54053fd640 1 -- 172.21.15.17:0/4288646894 shutdown_connections 2024-09-05T07:57:20.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.154+0000 7f54053fd640 1 -- 172.21.15.17:0/4288646894 wait complete. 2024-09-05T07:57:20.165 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-05T07:57:20.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.266+0000 7f310ab18640 1 Processor -- start 2024-09-05T07:57:20.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.266+0000 7f310ab18640 1 -- start start 2024-09-05T07:57:20.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.266+0000 7f310ab18640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f31040c8bb0 0x7f3104159020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:20.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.266+0000 7f310ab18640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f31040c8280 0x7f31040c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:20.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.266+0000 7f310ab18640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31040c9120 con 0x7f3104152a10 2024-09-05T07:57:20.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.266+0000 7f310ab18640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f3104159560 con 0x7f31040c8bb0 2024-09-05T07:57:20.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.266+0000 7f310ab18640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f31040c3160 con 0x7f31040c8280 2024-09-05T07:57:20.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.267+0000 7f3103fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f31040c8bb0 0x7f3104159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:20.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.267+0000 7f31088b4640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3104152a10 0x7f31040cabd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.17:56574/0 (socket says 172.21.15.17:56574) 2024-09-05T07:57:20.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.267+0000 7f31088b4640 1 -- 172.21.15.17:0/2225598296 learned_addr learned my addr 172.21.15.17:0/2225598296 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:57:20.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.268+0000 7f31090b5640 1 --2- 172.21.15.17:0/2225598296 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f31040c8280 0x7f31040c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:20.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.270+0000 7f3103fff640 1 -- 172.21.15.17:0/2225598296 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f31040c8280 msgr2=0x7f31040c95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:57:20.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.270+0000 7f3103fff640 1 --2- 172.21.15.17:0/2225598296 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f31040c8280 0x7f31040c95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:20.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.270+0000 7f3103fff640 1 -- 172.21.15.17:0/2225598296 >> v1:172.21.15.26:6789/0 conn(0x7f3104152a10 legacy=0x7f31040cabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:20.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.270+0000 7f3103fff640 1 -- 172.21.15.17:0/2225598296 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31040c4ee0 con 0x7f31040c8bb0 2024-09-05T07:57:20.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.272+0000 7f3103fff640 1 --2- 172.21.15.17:0/2225598296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31040c8bb0 0x7f3104159020 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f30f4009d90 tx=0x7f30f402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72821546aa7ef794 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:20.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.275+0000 7f31037fe640 1 -- 172.21.15.17:0/2225598296 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f4031600 con 0x7f31040c8bb0 2024-09-05T07:57:20.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.275+0000 7f31037fe640 1 -- 172.21.15.17:0/2225598296 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f40317a0 con 0x7f31040c8bb0 2024-09-05T07:57:20.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.275+0000 7f31037fe640 1 -- 172.21.15.17:0/2225598296 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f4031b70 con 0x7f31040c8bb0 2024-09-05T07:57:20.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.276+0000 7f310ab18640 1 -- 172.21.15.17:0/2225598296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31040c8bb0 msgr2=0x7f3104159020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:20.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.276+0000 7f310ab18640 1 --2- 172.21.15.17:0/2225598296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31040c8bb0 0x7f3104159020 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f30f4009d90 tx=0x7f30f402a5d0 comp rx=0 tx=0).stop 2024-09-05T07:57:20.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.276+0000 7f310ab18640 1 -- 172.21.15.17:0/2225598296 shutdown_connections 2024-09-05T07:57:20.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.276+0000 7f310ab18640 1 --2- 172.21.15.17:0/2225598296 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f31040c8280 0x7f31040c95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:20.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.276+0000 7f310ab18640 1 --2- 172.21.15.17:0/2225598296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31040c8bb0 0x7f3104159020 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:20.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.276+0000 7f310ab18640 1 -- 172.21.15.17:0/2225598296 >> 172.21.15.17:0/2225598296 conn(0x7f3104071500 msgr2=0x7f3104071910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:20.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.276+0000 7f310ab18640 1 -- 172.21.15.17:0/2225598296 shutdown_connections 2024-09-05T07:57:20.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.276+0000 7f310ab18640 1 -- 172.21.15.17:0/2225598296 wait complete. 2024-09-05T07:57:20.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.277+0000 7f310ab18640 1 Processor -- start 2024-09-05T07:57:20.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.277+0000 7f310ab18640 1 -- start start 2024-09-05T07:57:20.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.278+0000 7f310ab18640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31040c8280 0x7f31041542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:20.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.278+0000 7f310ab18640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f31040c8bb0 0x7f3104153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:20.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.278+0000 7f310ab18640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3104152a10 0x7f31040c6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:20.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.278+0000 7f310ab18640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f31040c3690 con 0x7f31040c8280 2024-09-05T07:57:20.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.278+0000 7f310ab18640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f31040c33b0 con 0x7f3104152a10 2024-09-05T07:57:20.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.278+0000 7f310ab18640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f31040cb2e0 con 0x7f31040c8bb0 2024-09-05T07:57:20.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.278+0000 7f31088b4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31040c8280 0x7f31041542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:20.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.279+0000 7f31090b5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3104152a10 0x7f31040c6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:20.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.279+0000 7f3103fff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f31040c8bb0 0x7f3104153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:20.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.279+0000 7f31088b4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31040c8280 0x7f31041542a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51706/0 (socket says 172.21.15.17:51706) 2024-09-05T07:57:20.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.279+0000 7f31088b4640 1 -- 172.21.15.17:0/2655491683 learned_addr learned my addr 172.21.15.17:0/2655491683 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:20.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.282+0000 7f31088b4640 1 -- 172.21.15.17:0/2655491683 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f31040c8bb0 msgr2=0x7f3104153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:20.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.282+0000 7f31088b4640 1 --2- 172.21.15.17:0/2655491683 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f31040c8bb0 0x7f3104153180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:20.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.282+0000 7f31088b4640 1 -- 172.21.15.17:0/2655491683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3104152a10 msgr2=0x7f31040c6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:20.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.282+0000 7f31088b4640 1 --2- 172.21.15.17:0/2655491683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3104152a10 0x7f31040c6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:20.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.282+0000 7f31088b4640 1 -- 172.21.15.17:0/2655491683 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31040c5620 con 0x7f31040c8280 2024-09-05T07:57:20.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.284+0000 7f31088b4640 1 --2- 172.21.15.17:0/2655491683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31040c8280 0x7f31041542a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f30fc00c3f0 tx=0x7f30fc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:20.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.288+0000 7f31017fa640 1 -- 172.21.15.17:0/2655491683 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30fc017070 con 0x7f31040c8280 2024-09-05T07:57:20.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.288+0000 7f31017fa640 1 -- 172.21.15.17:0/2655491683 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30fc005ce0 con 0x7f31040c8280 2024-09-05T07:57:20.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.288+0000 7f310ab18640 1 -- 172.21.15.17:0/2655491683 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31040c5900 con 0x7f31040c8280 2024-09-05T07:57:20.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.288+0000 7f31017fa640 1 -- 172.21.15.17:0/2655491683 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30fc0072f0 con 0x7f31040c8280 2024-09-05T07:57:20.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.288+0000 7f310ab18640 1 -- 172.21.15.17:0/2655491683 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31041e39c0 con 0x7f31040c8280 2024-09-05T07:57:20.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.289+0000 7f310ab18640 1 -- 172.21.15.17:0/2655491683 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3104159020 con 0x7f31040c8280 2024-09-05T07:57:20.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.309+0000 7f31017fa640 1 -- 172.21.15.17:0/2655491683 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f30fc01a070 con 0x7f31040c8280 2024-09-05T07:57:20.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.309+0000 7f31017fa640 1 --2- 172.21.15.17:0/2655491683 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f30e406be80 0x7f30e406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:20.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.310+0000 7f3103fff640 1 --2- 172.21.15.17:0/2655491683 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f30e406be80 0x7f30e406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:20.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.310+0000 7f3103fff640 1 --2- 172.21.15.17:0/2655491683 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f30e406be80 0x7f30e406e340 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f30f4034000 tx=0x7f30f402f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:20.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.584+0000 7f31017fa640 1 -- 172.21.15.17:0/2655491683 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f30fc056970 con 0x7f31040c8280 2024-09-05T07:57:20.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.584+0000 7f31017fa640 1 -- 172.21.15.17:0/2655491683 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f30fc021020 con 0x7f31040c8280 2024-09-05T07:57:20.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.765+0000 7f310ab18640 1 -- 172.21.15.17:0/2655491683 --> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f31041e3d20 con 0x7f30e406be80 2024-09-05T07:57:20.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.765+0000 7f31017fa640 1 -- 172.21.15.17:0/2655491683 <== mgr.4099 v2:172.21.15.26:6800/2736912541 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f31041e3d20 con 0x7f30e406be80 2024-09-05T07:57:20.766 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 0 to deep-scrub 2024-09-05T07:57:20.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.768+0000 7f310ab18640 1 -- 172.21.15.17:0/2655491683 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f30e406be80 msgr2=0x7f30e406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:20.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.768+0000 7f310ab18640 1 --2- 172.21.15.17:0/2655491683 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f30e406be80 0x7f30e406e340 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f30f4034000 tx=0x7f30f402f000 comp rx=0 tx=0).stop 2024-09-05T07:57:20.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.768+0000 7f310ab18640 1 -- 172.21.15.17:0/2655491683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31040c8280 msgr2=0x7f31041542a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:20.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.768+0000 7f310ab18640 1 --2- 172.21.15.17:0/2655491683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31040c8280 0x7f31041542a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f30fc00c3f0 tx=0x7f30fc00c8b0 comp rx=0 tx=0).stop 2024-09-05T07:57:20.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.768+0000 7f310ab18640 1 -- 172.21.15.17:0/2655491683 shutdown_connections 2024-09-05T07:57:20.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.768+0000 7f310ab18640 1 --2- 172.21.15.17:0/2655491683 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f30e406be80 0x7f30e406e340 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:20.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.768+0000 7f310ab18640 1 --2- 172.21.15.17:0/2655491683 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f31040c8bb0 0x7f3104153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:20.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.768+0000 7f310ab18640 1 --2- 172.21.15.17:0/2655491683 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3104152a10 0x7f31040c6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:20.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.768+0000 7f310ab18640 1 --2- 172.21.15.17:0/2655491683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31040c8280 0x7f31041542a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:20.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.768+0000 7f310ab18640 1 -- 172.21.15.17:0/2655491683 >> 172.21.15.17:0/2655491683 conn(0x7f3104071500 msgr2=0x7f310406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:20.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.768+0000 7f310ab18640 1 -- 172.21.15.17:0/2655491683 shutdown_connections 2024-09-05T07:57:20.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.768+0000 7f310ab18640 1 -- 172.21.15.17:0/2655491683 wait complete. 2024-09-05T07:57:20.780 INFO:tasks.ceph:Scrubbing osd.1 2024-09-05T07:57:20.780 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-05T07:57:20.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.886+0000 7f043cb91640 1 Processor -- start 2024-09-05T07:57:20.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.886+0000 7f043cb91640 1 -- start start 2024-09-05T07:57:20.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.887+0000 7f043cb91640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0438154b60 0x7f04380aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:20.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.887+0000 7f043cb91640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0438067950 0x7f0438067d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:20.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.887+0000 7f043cb91640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f043815b1d0 con 0x7f04380afc80 2024-09-05T07:57:20.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.887+0000 7f043cb91640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f0438072f60 con 0x7f0438154b60 2024-09-05T07:57:20.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.887+0000 7f043cb91640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f043806bc10 con 0x7f0438067950 2024-09-05T07:57:20.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.887+0000 7f0436d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0438067950 0x7f0438067d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:20.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.888+0000 7f0436d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0438067950 0x7f0438067d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:58336/0 (socket says 172.21.15.17:58336) 2024-09-05T07:57:20.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.888+0000 7f0436d9d640 1 -- 172.21.15.17:0/2016078298 learned_addr learned my addr 172.21.15.17:0/2016078298 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:20.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.891+0000 7f0436d9d640 1 -- 172.21.15.17:0/2016078298 >> v2:172.21.15.17:3300/0 conn(0x7f0438154b60 msgr2=0x7f04380aebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:57:20.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.891+0000 7f0436d9d640 1 --2- 172.21.15.17:0/2016078298 >> v2:172.21.15.17:3300/0 conn(0x7f0438154b60 0x7f04380aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:20.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.891+0000 7f0436d9d640 1 -- 172.21.15.17:0/2016078298 >> v1:172.21.15.17:6789/0 conn(0x7f04380afc80 legacy=0x7f043806ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:57:20.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.891+0000 7f0436d9d640 1 -- 172.21.15.17:0/2016078298 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f043815b470 con 0x7f0438067950 2024-09-05T07:57:20.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.893+0000 7f0436d9d640 1 --2- 172.21.15.17:0/2016078298 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0438067950 0x7f0438067d30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f04380ce0e0 tx=0x7f043002a760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19407d58ccc92248 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:20.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.897+0000 7f043559a640 1 -- 172.21.15.17:0/2016078298 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0430036070 con 0x7f0438067950 2024-09-05T07:57:20.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.897+0000 7f043559a640 1 -- 172.21.15.17:0/2016078298 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0430031600 con 0x7f0438067950 2024-09-05T07:57:20.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.897+0000 7f043559a640 1 -- 172.21.15.17:0/2016078298 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04300319d0 con 0x7f0438067950 2024-09-05T07:57:20.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.898+0000 7f043cb91640 1 -- 172.21.15.17:0/2016078298 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0438067950 msgr2=0x7f0438067d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:20.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.898+0000 7f043cb91640 1 --2- 172.21.15.17:0/2016078298 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0438067950 0x7f0438067d30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f04380ce0e0 tx=0x7f043002a760 comp rx=0 tx=0).stop 2024-09-05T07:57:20.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.898+0000 7f043cb91640 1 -- 172.21.15.17:0/2016078298 shutdown_connections 2024-09-05T07:57:20.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.898+0000 7f043cb91640 1 --2- 172.21.15.17:0/2016078298 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0438067950 0x7f0438067d30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:20.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.898+0000 7f043cb91640 1 --2- 172.21.15.17:0/2016078298 >> v2:172.21.15.17:3300/0 conn(0x7f0438154b60 0x7f04380aebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:20.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.898+0000 7f043cb91640 1 -- 172.21.15.17:0/2016078298 >> 172.21.15.17:0/2016078298 conn(0x7f04380cd260 msgr2=0x7f04380cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:20.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.898+0000 7f043cb91640 1 -- 172.21.15.17:0/2016078298 shutdown_connections 2024-09-05T07:57:20.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.898+0000 7f043cb91640 1 -- 172.21.15.17:0/2016078298 wait complete. 2024-09-05T07:57:20.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.900+0000 7f043cb91640 1 Processor -- start 2024-09-05T07:57:20.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.900+0000 7f043cb91640 1 -- start start 2024-09-05T07:57:20.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.901+0000 7f043cb91640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0438067950 0x7f04380b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:20.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.901+0000 7f043cb91640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f04380afc80 0x7f043806c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:20.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.901+0000 7f043cb91640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0438154b60 0x7f04381f08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:20.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.901+0000 7f043cb91640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f043806ead0 con 0x7f0438067950 2024-09-05T07:57:20.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.901+0000 7f043cb91640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f043806e7f0 con 0x7f0438154b60 2024-09-05T07:57:20.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.901+0000 7f043cb91640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f0438072c80 con 0x7f04380afc80 2024-09-05T07:57:20.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.903+0000 7f043659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0438067950 0x7f04380b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:20.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.904+0000 7f043659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0438067950 0x7f04380b0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51724/0 (socket says 172.21.15.17:51724) 2024-09-05T07:57:20.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.904+0000 7f043659c640 1 -- 172.21.15.17:0/1281241113 learned_addr learned my addr 172.21.15.17:0/1281241113 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.908+0000 7f043659c640 1 -- 172.21.15.17:0/1281241113 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f04380afc80 msgr2=0x7f043806c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.908+0000 7f043659c640 1 --2- 172.21.15.17:0/1281241113 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f04380afc80 0x7f043806c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.908+0000 7f043659c640 1 -- 172.21.15.17:0/1281241113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0438154b60 msgr2=0x7f04381f08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.908+0000 7f043659c640 1 --2- 172.21.15.17:0/1281241113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0438154b60 0x7f04381f08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.908+0000 7f043659c640 1 -- 172.21.15.17:0/1281241113 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04380b1710 con 0x7f0438067950 2024-09-05T07:57:20.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.910+0000 7f043659c640 1 --2- 172.21.15.17:0/1281241113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0438067950 0x7f04380b0d90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f042800b440 tx=0x7f042800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:20.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.914+0000 7f0426ffd640 1 -- 172.21.15.17:0/1281241113 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0428011830 con 0x7f0438067950 2024-09-05T07:57:20.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.914+0000 7f0426ffd640 1 -- 172.21.15.17:0/1281241113 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0428016070 con 0x7f0438067950 2024-09-05T07:57:20.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.914+0000 7f043cb91640 1 -- 172.21.15.17:0/1281241113 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04380b19f0 con 0x7f0438067950 2024-09-05T07:57:20.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.914+0000 7f0426ffd640 1 -- 172.21.15.17:0/1281241113 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0428011c10 con 0x7f0438067950 2024-09-05T07:57:20.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.915+0000 7f043cb91640 1 -- 172.21.15.17:0/1281241113 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04380b1fb0 con 0x7f0438067950 2024-09-05T07:57:20.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.915+0000 7f043cb91640 1 -- 172.21.15.17:0/1281241113 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f04380af200 con 0x7f0438067950 2024-09-05T07:57:20.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.935+0000 7f0426ffd640 1 -- 172.21.15.17:0/1281241113 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f042801b460 con 0x7f0438067950 2024-09-05T07:57:20.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.935+0000 7f0426ffd640 1 --2- 172.21.15.17:0/1281241113 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f041806be80 0x7f041806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:20.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.935+0000 7f0435d9b640 1 --2- 172.21.15.17:0/1281241113 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f041806be80 0x7f041806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:20.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.936+0000 7f0435d9b640 1 --2- 172.21.15.17:0/1281241113 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f041806be80 0x7f041806e340 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f04381e6520 tx=0x7f042c007990 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:20.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.940+0000 7f0426ffd640 1 -- 172.21.15.17:0/1281241113 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f04280577f0 con 0x7f0438067950 2024-09-05T07:57:20.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.940+0000 7f0426ffd640 1 --2- 172.21.15.17:0/1281241113 >> [v2:172.21.15.17:6816/3327408852,v1:172.21.15.17:6817/3327408852] conn(0x7f0418074080 0x7f04180764a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:20.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.941+0000 7f0426ffd640 1 -- 172.21.15.17:0/1281241113 --> [v2:172.21.15.17:6816/3327408852,v1:172.21.15.17:6817/3327408852] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0418076b70 con 0x7f0418074080 2024-09-05T07:57:20.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.941+0000 7f0426ffd640 1 -- 172.21.15.17:0/1281241113 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f04280559f0 con 0x7f0438067950 2024-09-05T07:57:20.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.941+0000 7f0436d9d640 1 --2- 172.21.15.17:0/1281241113 >> [v2:172.21.15.17:6816/3327408852,v1:172.21.15.17:6817/3327408852] conn(0x7f0418074080 0x7f04180764a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:20.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.941+0000 7f0436d9d640 1 --2- 172.21.15.17:0/1281241113 >> [v2:172.21.15.17:6816/3327408852,v1:172.21.15.17:6817/3327408852] conn(0x7f0418074080 0x7f04180764a0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:20.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.942+0000 7f0426ffd640 1 -- 172.21.15.17:0/1281241113 <== osd.1 v2:172.21.15.17:6816/3327408852 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0418076b70 con 0x7f0418074080 2024-09-05T07:57:20.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.954+0000 7f043cb91640 1 -- 172.21.15.17:0/1281241113 --> [v2:172.21.15.17:6816/3327408852,v1:172.21.15.17:6817/3327408852] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f04380af510 con 0x7f0418074080 2024-09-05T07:57:20.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.954+0000 7f0426ffd640 1 -- 172.21.15.17:0/1281241113 <== osd.1 v2:172.21.15.17:6816/3327408852 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f04380af510 con 0x7f0418074080 2024-09-05T07:57:20.955 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-05T07:57:20.955 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-05T07:57:20.955 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-05T07:57:20.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.955+0000 7f043cb91640 1 -- 172.21.15.17:0/1281241113 >> [v2:172.21.15.17:6816/3327408852,v1:172.21.15.17:6817/3327408852] conn(0x7f0418074080 msgr2=0x7f04180764a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:20.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.955+0000 7f043cb91640 1 --2- 172.21.15.17:0/1281241113 >> [v2:172.21.15.17:6816/3327408852,v1:172.21.15.17:6817/3327408852] conn(0x7f0418074080 0x7f04180764a0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:20.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.955+0000 7f043cb91640 1 -- 172.21.15.17:0/1281241113 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f041806be80 msgr2=0x7f041806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:20.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.955+0000 7f043cb91640 1 --2- 172.21.15.17:0/1281241113 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f041806be80 0x7f041806e340 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f04381e6520 tx=0x7f042c007990 comp rx=0 tx=0).stop 2024-09-05T07:57:20.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.955+0000 7f043cb91640 1 -- 172.21.15.17:0/1281241113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0438067950 msgr2=0x7f04380b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:20.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.955+0000 7f043cb91640 1 --2- 172.21.15.17:0/1281241113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0438067950 0x7f04380b0d90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f042800b440 tx=0x7f042800b900 comp rx=0 tx=0).stop 2024-09-05T07:57:20.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.955+0000 7f0436d9d640 1 -- 172.21.15.17:0/1281241113 reap_dead start 2024-09-05T07:57:20.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.955+0000 7f043cb91640 1 -- 172.21.15.17:0/1281241113 shutdown_connections 2024-09-05T07:57:20.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.955+0000 7f043cb91640 1 -- 172.21.15.17:0/1281241113 >> 172.21.15.17:0/1281241113 conn(0x7f04380cd260 msgr2=0x7f04380cc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:20.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.955+0000 7f043cb91640 1 -- 172.21.15.17:0/1281241113 shutdown_connections 2024-09-05T07:57:20.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:20.955+0000 7f043cb91640 1 -- 172.21.15.17:0/1281241113 wait complete. 2024-09-05T07:57:20.966 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-05T07:57:21.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.067+0000 7fdb97480640 1 Processor -- start 2024-09-05T07:57:21.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.067+0000 7fdb97480640 1 -- start start 2024-09-05T07:57:21.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.068+0000 7fdb97480640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fdb900c7fa0 0x7fdb9006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:21.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.068+0000 7fdb97480640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb900c89f0 con 0x7fdb90157f70 2024-09-05T07:57:21.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.068+0000 7fdb97480640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb900c3100 con 0x7fdb90158350 2024-09-05T07:57:21.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.068+0000 7fdb97480640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fdb900c72f0 con 0x7fdb900c7fa0 2024-09-05T07:57:21.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.069+0000 7fdb95a1d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fdb90158350 0x7fdb90161eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.17:56580/0 (socket says 172.21.15.17:56580) 2024-09-05T07:57:21.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.069+0000 7fdb94a1b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fdb900c7fa0 0x7fdb9006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:21.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.069+0000 7fdb95a1d640 1 -- 172.21.15.17:0/1146085324 learned_addr learned my addr 172.21.15.17:0/1146085324 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:57:21.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.071+0000 7fdb8ffff640 1 -- 172.21.15.17:0/1146085324 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1840148852 0 0) 0x7fdb900c3100 con 0x7fdb90158350 2024-09-05T07:57:21.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.071+0000 7fdb8ffff640 1 -- 172.21.15.17:0/1146085324 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb78005730 con 0x7fdb90158350 2024-09-05T07:57:21.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.073+0000 7fdb94a1b640 1 -- 172.21.15.17:0/1146085324 >> v1:172.21.15.26:6789/0 conn(0x7fdb90158350 legacy=0x7fdb90161eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:21.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.073+0000 7fdb94a1b640 1 -- 172.21.15.17:0/1146085324 >> v1:172.21.15.17:6789/0 conn(0x7fdb90157f70 legacy=0x7fdb900c6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:21.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.073+0000 7fdb94a1b640 1 -- 172.21.15.17:0/1146085324 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb90073ab0 con 0x7fdb900c7fa0 2024-09-05T07:57:21.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.076+0000 7fdb94a1b640 1 --2- 172.21.15.17:0/1146085324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb900c7fa0 0x7fdb9006bc10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdb840097a0 tx=0x7fdb8402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f744b568a2b4b97a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:21.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.081+0000 7fdb8ffff640 1 -- 172.21.15.17:0/1146085324 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb84037070 con 0x7fdb900c7fa0 2024-09-05T07:57:21.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.081+0000 7fdb8ffff640 1 -- 172.21.15.17:0/1146085324 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb84032440 con 0x7fdb900c7fa0 2024-09-05T07:57:21.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.081+0000 7fdb8ffff640 1 -- 172.21.15.17:0/1146085324 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb84032810 con 0x7fdb900c7fa0 2024-09-05T07:57:21.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.081+0000 7fdb97480640 1 -- 172.21.15.17:0/1146085324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb900c7fa0 msgr2=0x7fdb9006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:21.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.081+0000 7fdb97480640 1 --2- 172.21.15.17:0/1146085324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb900c7fa0 0x7fdb9006bc10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdb840097a0 tx=0x7fdb8402a230 comp rx=0 tx=0).stop 2024-09-05T07:57:21.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.081+0000 7fdb97480640 1 -- 172.21.15.17:0/1146085324 shutdown_connections 2024-09-05T07:57:21.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.081+0000 7fdb97480640 1 --2- 172.21.15.17:0/1146085324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb900c7fa0 0x7fdb9006bc10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:21.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.081+0000 7fdb97480640 1 -- 172.21.15.17:0/1146085324 >> 172.21.15.17:0/1146085324 conn(0x7fdb900cc1e0 msgr2=0x7fdb900cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:21.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.081+0000 7fdb97480640 1 -- 172.21.15.17:0/1146085324 shutdown_connections 2024-09-05T07:57:21.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.081+0000 7fdb97480640 1 -- 172.21.15.17:0/1146085324 wait complete. 2024-09-05T07:57:21.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.083+0000 7fdb97480640 1 Processor -- start 2024-09-05T07:57:21.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.083+0000 7fdb97480640 1 -- start start 2024-09-05T07:57:21.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.083+0000 7fdb97480640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb900c7fa0 0x7fdb9014da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:21.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.083+0000 7fdb97480640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb90157f70 0x7fdb901f0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:21.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.083+0000 7fdb97480640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb90158350 0x7fdb901e1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:21.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.083+0000 7fdb97480640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdb9006ee40 con 0x7fdb90158350 2024-09-05T07:57:21.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.083+0000 7fdb97480640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fdb90074070 con 0x7fdb900c7fa0 2024-09-05T07:57:21.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.083+0000 7fdb97480640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fdb9006efc0 con 0x7fdb90157f70 2024-09-05T07:57:21.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.084+0000 7fdb95a1d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb90158350 0x7fdb901e1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:21.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.084+0000 7fdb95a1d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb90158350 0x7fdb901e1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51742/0 (socket says 172.21.15.17:51742) 2024-09-05T07:57:21.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.084+0000 7fdb95a1d640 1 -- 172.21.15.17:0/2035741122 learned_addr learned my addr 172.21.15.17:0/2035741122 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:21.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.084+0000 7fdb9521c640 1 --2- 172.21.15.17:0/2035741122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb900c7fa0 0x7fdb9014da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:21.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.084+0000 7fdb94a1b640 1 --2- 172.21.15.17:0/2035741122 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb90157f70 0x7fdb901f0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:21.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.088+0000 7fdb95a1d640 1 -- 172.21.15.17:0/2035741122 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb90157f70 msgr2=0x7fdb901f0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:21.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.088+0000 7fdb95a1d640 1 --2- 172.21.15.17:0/2035741122 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb90157f70 0x7fdb901f0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:21.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.088+0000 7fdb95a1d640 1 -- 172.21.15.17:0/2035741122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb900c7fa0 msgr2=0x7fdb9014da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:21.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.088+0000 7fdb95a1d640 1 --2- 172.21.15.17:0/2035741122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb900c7fa0 0x7fdb9014da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:21.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.088+0000 7fdb95a1d640 1 -- 172.21.15.17:0/2035741122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb901e0a70 con 0x7fdb90158350 2024-09-05T07:57:21.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.090+0000 7fdb95a1d640 1 --2- 172.21.15.17:0/2035741122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb90158350 0x7fdb901e1fa0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdb8000caa0 tx=0x7fdb8000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:21.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.093+0000 7fdb8dffb640 1 -- 172.21.15.17:0/2035741122 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb80017070 con 0x7fdb90158350 2024-09-05T07:57:21.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.093+0000 7fdb8dffb640 1 -- 172.21.15.17:0/2035741122 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb8000ac00 con 0x7fdb90158350 2024-09-05T07:57:21.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.093+0000 7fdb97480640 1 -- 172.21.15.17:0/2035741122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb901e0d10 con 0x7fdb90158350 2024-09-05T07:57:21.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.093+0000 7fdb8dffb640 1 -- 172.21.15.17:0/2035741122 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb80012400 con 0x7fdb90158350 2024-09-05T07:57:21.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.093+0000 7fdb97480640 1 -- 172.21.15.17:0/2035741122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb901f0a20 con 0x7fdb90158350 2024-09-05T07:57:21.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.094+0000 7fdb97480640 1 -- 172.21.15.17:0/2035741122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb901e1230 con 0x7fdb90158350 2024-09-05T07:57:21.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.367+0000 7fdb8dffb640 1 -- 172.21.15.17:0/2035741122 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdb8001a070 con 0x7fdb90158350 2024-09-05T07:57:21.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.367+0000 7fdb8dffb640 1 --2- 172.21.15.17:0/2035741122 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fdb7c06beb0 0x7fdb7c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:21.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.367+0000 7fdb9521c640 1 --2- 172.21.15.17:0/2035741122 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fdb7c06beb0 0x7fdb7c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:21.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.368+0000 7fdb9521c640 1 --2- 172.21.15.17:0/2035741122 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fdb7c06beb0 0x7fdb7c06e370 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdb88000f60 tx=0x7fdb88009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:21.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.382+0000 7fdb8dffb640 1 -- 172.21.15.17:0/2035741122 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7fdb80057370 con 0x7fdb90158350 2024-09-05T07:57:21.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.382+0000 7fdb8dffb640 1 -- 172.21.15.17:0/2035741122 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdb901e1230 con 0x7fdb90158350 2024-09-05T07:57:21.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.559+0000 7fdb97480640 1 -- 172.21.15.17:0/2035741122 --> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fdb90156690 con 0x7fdb7c06beb0 2024-09-05T07:57:21.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.560+0000 7fdb8dffb640 1 -- 172.21.15.17:0/2035741122 <== mgr.4099 v2:172.21.15.26:6800/2736912541 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fdb90156690 con 0x7fdb7c06beb0 2024-09-05T07:57:21.560 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 1 to deep-scrub 2024-09-05T07:57:21.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.562+0000 7fdb97480640 1 -- 172.21.15.17:0/2035741122 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fdb7c06beb0 msgr2=0x7fdb7c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:21.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.562+0000 7fdb97480640 1 --2- 172.21.15.17:0/2035741122 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fdb7c06beb0 0x7fdb7c06e370 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdb88000f60 tx=0x7fdb88009040 comp rx=0 tx=0).stop 2024-09-05T07:57:21.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.562+0000 7fdb97480640 1 -- 172.21.15.17:0/2035741122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb90158350 msgr2=0x7fdb901e1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:21.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.562+0000 7fdb97480640 1 --2- 172.21.15.17:0/2035741122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb90158350 0x7fdb901e1fa0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdb8000caa0 tx=0x7fdb8000cf60 comp rx=0 tx=0).stop 2024-09-05T07:57:21.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.562+0000 7fdb97480640 1 -- 172.21.15.17:0/2035741122 shutdown_connections 2024-09-05T07:57:21.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.562+0000 7fdb97480640 1 --2- 172.21.15.17:0/2035741122 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fdb7c06beb0 0x7fdb7c06e370 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:21.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.562+0000 7fdb97480640 1 --2- 172.21.15.17:0/2035741122 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb90157f70 0x7fdb901f0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:21.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.562+0000 7fdb97480640 1 --2- 172.21.15.17:0/2035741122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb90158350 0x7fdb901e1fa0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:21.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.562+0000 7fdb97480640 1 --2- 172.21.15.17:0/2035741122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb900c7fa0 0x7fdb9014da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:21.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.562+0000 7fdb97480640 1 -- 172.21.15.17:0/2035741122 >> 172.21.15.17:0/2035741122 conn(0x7fdb900cc1e0 msgr2=0x7fdb9006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:21.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.562+0000 7fdb97480640 1 -- 172.21.15.17:0/2035741122 shutdown_connections 2024-09-05T07:57:21.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.562+0000 7fdb97480640 1 -- 172.21.15.17:0/2035741122 wait complete. 2024-09-05T07:57:21.573 INFO:tasks.ceph:Scrubbing osd.2 2024-09-05T07:57:21.574 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-05T07:57:21.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.677+0000 7f3d1cfbd640 1 Processor -- start 2024-09-05T07:57:21.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.677+0000 7f3d1cfbd640 1 -- start start 2024-09-05T07:57:21.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.678+0000 7f3d1cfbd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3d18157f10 0x7f3d1815a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:21.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.678+0000 7f3d1cfbd640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d180b3b20 con 0x7f3d180cd2d0 2024-09-05T07:57:21.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.678+0000 7f3d1cfbd640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d1815b590 con 0x7f3d180ccef0 2024-09-05T07:57:21.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.678+0000 7f3d1cfbd640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f3d180b2d60 con 0x7f3d18157f10 2024-09-05T07:57:21.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.679+0000 7f3d15d9b640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f3d180cd2d0 0x7f3d18157800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:38232/0 (socket says 172.21.15.17:38232) 2024-09-05T07:57:21.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.679+0000 7f3d15d9b640 1 -- 172.21.15.17:0/2105515538 learned_addr learned my addr 172.21.15.17:0/2105515538 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:57:21.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.679+0000 7f3d16d9d640 1 --2- 172.21.15.17:0/2105515538 >> v2:172.21.15.26:3300/0 conn(0x7f3d18157f10 0x7f3d1815a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:21.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.681+0000 7f3d1559a640 1 -- 172.21.15.17:0/2105515538 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1899502416 0 0) 0x7f3d180b3b20 con 0x7f3d180cd2d0 2024-09-05T07:57:21.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.681+0000 7f3d1559a640 1 -- 172.21.15.17:0/2105515538 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d04003520 con 0x7f3d180cd2d0 2024-09-05T07:57:21.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.683+0000 7f3d16d9d640 1 -- 172.21.15.17:0/2105515538 >> v1:172.21.15.26:6789/0 conn(0x7f3d180ccef0 legacy=0x7f3d180b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:21.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.683+0000 7f3d16d9d640 1 -- 172.21.15.17:0/2105515538 >> v1:172.21.15.17:6789/0 conn(0x7f3d180cd2d0 legacy=0x7f3d18157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:21.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.683+0000 7f3d16d9d640 1 -- 172.21.15.17:0/2105515538 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d180b3040 con 0x7f3d18157f10 2024-09-05T07:57:21.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.687+0000 7f3d16d9d640 1 --2- 172.21.15.17:0/2105515538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d18157f10 0x7f3d1815a820 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3d08009dc0 tx=0x7f3d0802a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=222276d180c4335f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:21.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.691+0000 7f3d1559a640 1 -- 172.21.15.17:0/2105515538 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d08007740 con 0x7f3d18157f10 2024-09-05T07:57:21.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.691+0000 7f3d1559a640 1 -- 172.21.15.17:0/2105515538 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d080078e0 con 0x7f3d18157f10 2024-09-05T07:57:21.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.691+0000 7f3d1559a640 1 -- 172.21.15.17:0/2105515538 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d08007cb0 con 0x7f3d18157f10 2024-09-05T07:57:21.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.692+0000 7f3d1cfbd640 1 -- 172.21.15.17:0/2105515538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d18157f10 msgr2=0x7f3d1815a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:21.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.692+0000 7f3d1cfbd640 1 --2- 172.21.15.17:0/2105515538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d18157f10 0x7f3d1815a820 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3d08009dc0 tx=0x7f3d0802a730 comp rx=0 tx=0).stop 2024-09-05T07:57:21.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.692+0000 7f3d1cfbd640 1 -- 172.21.15.17:0/2105515538 shutdown_connections 2024-09-05T07:57:21.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.692+0000 7f3d1cfbd640 1 --2- 172.21.15.17:0/2105515538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d18157f10 0x7f3d1815a820 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:21.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.692+0000 7f3d1cfbd640 1 -- 172.21.15.17:0/2105515538 >> 172.21.15.17:0/2105515538 conn(0x7f3d18072230 msgr2=0x7f3d18072640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:21.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.692+0000 7f3d1cfbd640 1 -- 172.21.15.17:0/2105515538 shutdown_connections 2024-09-05T07:57:21.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.692+0000 7f3d1cfbd640 1 -- 172.21.15.17:0/2105515538 wait complete. 2024-09-05T07:57:21.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.693+0000 7f3d1cfbd640 1 Processor -- start 2024-09-05T07:57:21.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.693+0000 7f3d1cfbd640 1 -- start start 2024-09-05T07:57:21.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.694+0000 7f3d1cfbd640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d180ccef0 0x7f3d180c38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:21.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.694+0000 7f3d1cfbd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d180cd2d0 0x7f3d181f37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:21.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.694+0000 7f3d1cfbd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d18157f10 0x7f3d180c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:21.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.694+0000 7f3d1cfbd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3d180b4580 con 0x7f3d18157f10 2024-09-05T07:57:21.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.694+0000 7f3d1cfbd640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f3d180b3600 con 0x7f3d180cd2d0 2024-09-05T07:57:21.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.694+0000 7f3d1cfbd640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f3d1815dee0 con 0x7f3d180ccef0 2024-09-05T07:57:21.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.694+0000 7f3d16d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d18157f10 0x7f3d180c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:21.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.695+0000 7f3d1659c640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d180ccef0 0x7f3d180c38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:21.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.695+0000 7f3d16d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d18157f10 0x7f3d180c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51746/0 (socket says 172.21.15.17:51746) 2024-09-05T07:57:21.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.695+0000 7f3d15d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d180cd2d0 0x7f3d181f37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:21.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.695+0000 7f3d16d9d640 1 -- 172.21.15.17:0/2026165411 learned_addr learned my addr 172.21.15.17:0/2026165411 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:21.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.698+0000 7f3d16d9d640 1 -- 172.21.15.17:0/2026165411 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d180ccef0 msgr2=0x7f3d180c38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:21.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.698+0000 7f3d16d9d640 1 --2- 172.21.15.17:0/2026165411 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3d180ccef0 0x7f3d180c38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:21.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.698+0000 7f3d16d9d640 1 -- 172.21.15.17:0/2026165411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d180cd2d0 msgr2=0x7f3d181f37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:21.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.698+0000 7f3d16d9d640 1 --2- 172.21.15.17:0/2026165411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d180cd2d0 0x7f3d181f37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:21.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.698+0000 7f3d16d9d640 1 -- 172.21.15.17:0/2026165411 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d180cb590 con 0x7f3d18157f10 2024-09-05T07:57:21.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.701+0000 7f3d16d9d640 1 --2- 172.21.15.17:0/2026165411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d18157f10 0x7f3d180c5c60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3d08009ee0 tx=0x7f3d08004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:21.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.705+0000 7f3d0effd640 1 -- 172.21.15.17:0/2026165411 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d08040070 con 0x7f3d18157f10 2024-09-05T07:57:21.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.705+0000 7f3d0effd640 1 -- 172.21.15.17:0/2026165411 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d08031b40 con 0x7f3d18157f10 2024-09-05T07:57:21.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.705+0000 7f3d0effd640 1 -- 172.21.15.17:0/2026165411 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d08045460 con 0x7f3d18157f10 2024-09-05T07:57:21.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.705+0000 7f3d1cfbd640 1 -- 172.21.15.17:0/2026165411 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d181f4210 con 0x7f3d18157f10 2024-09-05T07:57:21.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.705+0000 7f3d1cfbd640 1 -- 172.21.15.17:0/2026165411 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d180c4a40 con 0x7f3d18157f10 2024-09-05T07:57:21.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.705+0000 7f3d1cfbd640 1 -- 172.21.15.17:0/2026165411 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3d18069220 con 0x7f3d18157f10 2024-09-05T07:57:21.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.726+0000 7f3d0effd640 1 -- 172.21.15.17:0/2026165411 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d08039040 con 0x7f3d18157f10 2024-09-05T07:57:21.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.727+0000 7f3d0effd640 1 --2- 172.21.15.17:0/2026165411 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f3cf806be80 0x7f3cf806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:21.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.727+0000 7f3d1659c640 1 --2- 172.21.15.17:0/2026165411 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f3cf806be80 0x7f3cf806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:21.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.728+0000 7f3d1659c640 1 --2- 172.21.15.17:0/2026165411 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f3cf806be80 0x7f3cf806e340 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3d100016e0 tx=0x7f3d10009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:21.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.730+0000 7f3d0effd640 1 -- 172.21.15.17:0/2026165411 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f3d08078e70 con 0x7f3d18157f10 2024-09-05T07:57:21.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.730+0000 7f3d0effd640 1 --2- 172.21.15.17:0/2026165411 >> [v2:172.21.15.17:6808/363420609,v1:172.21.15.17:6809/363420609] conn(0x7f3cf80740e0 0x7f3cf8076500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:21.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.730+0000 7f3d0effd640 1 -- 172.21.15.17:0/2026165411 --> [v2:172.21.15.17:6808/363420609,v1:172.21.15.17:6809/363420609] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d08043e50 con 0x7f3cf80740e0 2024-09-05T07:57:21.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.730+0000 7f3d0effd640 1 -- 172.21.15.17:0/2026165411 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3d08077070 con 0x7f3d18157f10 2024-09-05T07:57:21.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.730+0000 7f3d15d9b640 1 --2- 172.21.15.17:0/2026165411 >> [v2:172.21.15.17:6808/363420609,v1:172.21.15.17:6809/363420609] conn(0x7f3cf80740e0 0x7f3cf8076500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:21.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.731+0000 7f3d15d9b640 1 --2- 172.21.15.17:0/2026165411 >> [v2:172.21.15.17:6808/363420609,v1:172.21.15.17:6809/363420609] conn(0x7f3cf80740e0 0x7f3cf8076500 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:21.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.731+0000 7f3d0effd640 1 -- 172.21.15.17:0/2026165411 <== osd.2 v2:172.21.15.17:6808/363420609 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3d08043e50 con 0x7f3cf80740e0 2024-09-05T07:57:21.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.744+0000 7f3d1cfbd640 1 -- 172.21.15.17:0/2026165411 --> [v2:172.21.15.17:6808/363420609,v1:172.21.15.17:6809/363420609] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3d180b3e70 con 0x7f3cf80740e0 2024-09-05T07:57:21.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.744+0000 7f3d0effd640 1 -- 172.21.15.17:0/2026165411 <== osd.2 v2:172.21.15.17:6808/363420609 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3d180b3e70 con 0x7f3cf80740e0 2024-09-05T07:57:21.745 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-05T07:57:21.745 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-05T07:57:21.746 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-05T07:57:21.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.745+0000 7f3d1cfbd640 1 -- 172.21.15.17:0/2026165411 >> [v2:172.21.15.17:6808/363420609,v1:172.21.15.17:6809/363420609] conn(0x7f3cf80740e0 msgr2=0x7f3cf8076500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:21.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.745+0000 7f3d1cfbd640 1 --2- 172.21.15.17:0/2026165411 >> [v2:172.21.15.17:6808/363420609,v1:172.21.15.17:6809/363420609] conn(0x7f3cf80740e0 0x7f3cf8076500 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:21.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.745+0000 7f3d1cfbd640 1 -- 172.21.15.17:0/2026165411 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f3cf806be80 msgr2=0x7f3cf806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:21.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.745+0000 7f3d1cfbd640 1 --2- 172.21.15.17:0/2026165411 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f3cf806be80 0x7f3cf806e340 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3d100016e0 tx=0x7f3d10009040 comp rx=0 tx=0).stop 2024-09-05T07:57:21.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.745+0000 7f3d1cfbd640 1 -- 172.21.15.17:0/2026165411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d18157f10 msgr2=0x7f3d180c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:21.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.745+0000 7f3d1cfbd640 1 --2- 172.21.15.17:0/2026165411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d18157f10 0x7f3d180c5c60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3d08009ee0 tx=0x7f3d08004a40 comp rx=0 tx=0).stop 2024-09-05T07:57:21.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.745+0000 7f3d16d9d640 1 -- 172.21.15.17:0/2026165411 reap_dead start 2024-09-05T07:57:21.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.745+0000 7f3d1cfbd640 1 -- 172.21.15.17:0/2026165411 shutdown_connections 2024-09-05T07:57:21.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.745+0000 7f3d1cfbd640 1 -- 172.21.15.17:0/2026165411 >> 172.21.15.17:0/2026165411 conn(0x7f3d18072230 msgr2=0x7f3d18072610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:21.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.745+0000 7f3d1cfbd640 1 -- 172.21.15.17:0/2026165411 shutdown_connections 2024-09-05T07:57:21.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.745+0000 7f3d1cfbd640 1 -- 172.21.15.17:0/2026165411 wait complete. 2024-09-05T07:57:21.757 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-05T07:57:21.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.859+0000 7f89324c9640 1 Processor -- start 2024-09-05T07:57:21.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.859+0000 7f89324c9640 1 -- start start 2024-09-05T07:57:21.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.860+0000 7f89324c9640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f892c151720 0x7f892c06d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:21.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.860+0000 7f89324c9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f892c0c3c30 0x7f892c0c9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:21.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.860+0000 7f89324c9640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f892c06d8b0 con 0x7f892c0c9e90 2024-09-05T07:57:21.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.860+0000 7f89324c9640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f892c0ca340 con 0x7f892c0c3c30 2024-09-05T07:57:21.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.860+0000 7f89324c9640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f892c1582c0 con 0x7f892c151720 2024-09-05T07:57:21.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.861+0000 7f892bfff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f892c151720 0x7f892c06d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:21.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.861+0000 7f892b7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f892c0c3c30 0x7f892c0c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:21.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.861+0000 7f892bfff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f892c151720 0x7f892c06d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:54168/0 (socket says 172.21.15.17:54168) 2024-09-05T07:57:21.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.861+0000 7f892bfff640 1 -- 172.21.15.17:0/866567087 learned_addr learned my addr 172.21.15.17:0/866567087 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:21.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.864+0000 7f892bfff640 1 -- 172.21.15.17:0/866567087 >> v2:172.21.15.26:3300/0 conn(0x7f892c0c3c30 msgr2=0x7f892c0c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:57:21.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.864+0000 7f892bfff640 1 --2- 172.21.15.17:0/866567087 >> v2:172.21.15.26:3300/0 conn(0x7f892c0c3c30 0x7f892c0c9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:21.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.864+0000 7f892bfff640 1 -- 172.21.15.17:0/866567087 >> v1:172.21.15.17:6789/0 conn(0x7f892c0c9e90 legacy=0x7f892c0c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:57:21.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.864+0000 7f892bfff640 1 -- 172.21.15.17:0/866567087 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f892c1576f0 con 0x7f892c151720 2024-09-05T07:57:21.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.866+0000 7f892bfff640 1 --2- 172.21.15.17:0/866567087 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f892c151720 0x7f892c06d200 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f891c009870 tx=0x7f891c02a2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=564b32c4ecb8db0f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:21.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.870+0000 7f892affd640 1 -- 172.21.15.17:0/866567087 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891c037070 con 0x7f892c151720 2024-09-05T07:57:21.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.870+0000 7f892affd640 1 -- 172.21.15.17:0/866567087 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f891c032440 con 0x7f892c151720 2024-09-05T07:57:21.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.870+0000 7f892affd640 1 -- 172.21.15.17:0/866567087 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891c032810 con 0x7f892c151720 2024-09-05T07:57:21.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.870+0000 7f89324c9640 1 -- 172.21.15.17:0/866567087 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f892c151720 msgr2=0x7f892c06d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:21.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.870+0000 7f89324c9640 1 --2- 172.21.15.17:0/866567087 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f892c151720 0x7f892c06d200 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f891c009870 tx=0x7f891c02a2a0 comp rx=0 tx=0).stop 2024-09-05T07:57:21.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.871+0000 7f89324c9640 1 -- 172.21.15.17:0/866567087 shutdown_connections 2024-09-05T07:57:21.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.871+0000 7f89324c9640 1 --2- 172.21.15.17:0/866567087 >> v2:172.21.15.26:3300/0 conn(0x7f892c0c3c30 0x7f892c0c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:21.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.871+0000 7f89324c9640 1 --2- 172.21.15.17:0/866567087 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f892c151720 0x7f892c06d200 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:21.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.871+0000 7f89324c9640 1 -- 172.21.15.17:0/866567087 >> 172.21.15.17:0/866567087 conn(0x7f892c070250 msgr2=0x7f892c070630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:21.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.871+0000 7f89324c9640 1 -- 172.21.15.17:0/866567087 shutdown_connections 2024-09-05T07:57:21.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.871+0000 7f89324c9640 1 -- 172.21.15.17:0/866567087 wait complete. 2024-09-05T07:57:21.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.872+0000 7f89324c9640 1 Processor -- start 2024-09-05T07:57:21.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.872+0000 7f89324c9640 1 -- start start 2024-09-05T07:57:21.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.873+0000 7f89324c9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f892c0c3c30 0x7f892c156540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:21.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.873+0000 7f89324c9640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f892c0c9e90 0x7f892c145df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:21.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.873+0000 7f89324c9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f892c151720 0x7f892c13d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:21.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.873+0000 7f89324c9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f892c157c70 con 0x7f892c151720 2024-09-05T07:57:21.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.873+0000 7f89324c9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f892c157990 con 0x7f892c0c3c30 2024-09-05T07:57:21.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.873+0000 7f89324c9640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f892c157f50 con 0x7f892c0c9e90 2024-09-05T07:57:21.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.874+0000 7f892bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f892c0c3c30 0x7f892c156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:21.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.874+0000 7f892b7fe640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f892c0c9e90 0x7f892c145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:21.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.874+0000 7f892bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f892c0c3c30 0x7f892c156540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:58390/0 (socket says 172.21.15.17:58390) 2024-09-05T07:57:21.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.874+0000 7f892bfff640 1 -- 172.21.15.17:0/1386476703 learned_addr learned my addr 172.21.15.17:0/1386476703 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:21.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.875+0000 7f8930a66640 1 --2- 172.21.15.17:0/1386476703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f892c151720 0x7f892c13d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:21.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.878+0000 7f892bfff640 1 -- 172.21.15.17:0/1386476703 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f892c0c9e90 msgr2=0x7f892c145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:21.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.878+0000 7f892bfff640 1 --2- 172.21.15.17:0/1386476703 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f892c0c9e90 0x7f892c145df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:21.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.878+0000 7f892bfff640 1 -- 172.21.15.17:0/1386476703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f892c151720 msgr2=0x7f892c13d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:21.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.878+0000 7f892bfff640 1 --2- 172.21.15.17:0/1386476703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f892c151720 0x7f892c13d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:21.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.878+0000 7f892bfff640 1 -- 172.21.15.17:0/1386476703 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f892c150ad0 con 0x7f892c0c3c30 2024-09-05T07:57:21.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.880+0000 7f892bfff640 1 --2- 172.21.15.17:0/1386476703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f892c0c3c30 0x7f892c156540 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f891c009990 tx=0x7f891c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:21.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.884+0000 7f8928ff9640 1 -- 172.21.15.17:0/1386476703 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891c037040 con 0x7f892c0c3c30 2024-09-05T07:57:21.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.884+0000 7f8928ff9640 1 -- 172.21.15.17:0/1386476703 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f891c042070 con 0x7f892c0c3c30 2024-09-05T07:57:21.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.885+0000 7f89324c9640 1 -- 172.21.15.17:0/1386476703 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f892c150db0 con 0x7f892c0c3c30 2024-09-05T07:57:21.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.885+0000 7f8928ff9640 1 -- 172.21.15.17:0/1386476703 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891c030940 con 0x7f892c0c3c30 2024-09-05T07:57:21.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.885+0000 7f89324c9640 1 -- 172.21.15.17:0/1386476703 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f892c1f0a80 con 0x7f892c0c3c30 2024-09-05T07:57:21.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:21.886+0000 7f89324c9640 1 -- 172.21.15.17:0/1386476703 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f892c0c79e0 con 0x7f892c0c3c30 2024-09-05T07:57:22.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.165+0000 7f8928ff9640 1 -- 172.21.15.17:0/1386476703 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f891c030ae0 con 0x7f892c0c3c30 2024-09-05T07:57:22.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.166+0000 7f8928ff9640 1 --2- 172.21.15.17:0/1386476703 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f891806be80 0x7f891806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:22.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.166+0000 7f892b7fe640 1 --2- 172.21.15.17:0/1386476703 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f891806be80 0x7f891806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:22.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.166+0000 7f892b7fe640 1 --2- 172.21.15.17:0/1386476703 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f891806be80 0x7f891806e340 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f892c1503b0 tx=0x7f8920009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:22.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.170+0000 7f8928ff9640 1 -- 172.21.15.17:0/1386476703 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f891c030dd0 con 0x7f892c0c3c30 2024-09-05T07:57:22.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.183+0000 7f8928ff9640 1 -- 172.21.15.17:0/1386476703 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f891c07a3f0 con 0x7f892c0c3c30 2024-09-05T07:57:22.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.362+0000 7f89324c9640 1 -- 172.21.15.17:0/1386476703 --> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f892c068390 con 0x7f891806be80 2024-09-05T07:57:22.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.362+0000 7f8928ff9640 1 -- 172.21.15.17:0/1386476703 <== mgr.4099 v2:172.21.15.26:6800/2736912541 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f892c068390 con 0x7f891806be80 2024-09-05T07:57:22.363 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 2 to deep-scrub 2024-09-05T07:57:22.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.365+0000 7f89324c9640 1 -- 172.21.15.17:0/1386476703 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f891806be80 msgr2=0x7f891806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:22.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.365+0000 7f89324c9640 1 --2- 172.21.15.17:0/1386476703 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f891806be80 0x7f891806e340 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f892c1503b0 tx=0x7f8920009190 comp rx=0 tx=0).stop 2024-09-05T07:57:22.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.365+0000 7f89324c9640 1 -- 172.21.15.17:0/1386476703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f892c0c3c30 msgr2=0x7f892c156540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:22.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.365+0000 7f89324c9640 1 --2- 172.21.15.17:0/1386476703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f892c0c3c30 0x7f892c156540 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f891c009990 tx=0x7f891c0046c0 comp rx=0 tx=0).stop 2024-09-05T07:57:22.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.365+0000 7f89324c9640 1 -- 172.21.15.17:0/1386476703 shutdown_connections 2024-09-05T07:57:22.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.365+0000 7f89324c9640 1 --2- 172.21.15.17:0/1386476703 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f891806be80 0x7f891806e340 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:22.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.365+0000 7f89324c9640 1 --2- 172.21.15.17:0/1386476703 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f892c0c9e90 0x7f892c145df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:22.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.365+0000 7f89324c9640 1 --2- 172.21.15.17:0/1386476703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f892c151720 0x7f892c13d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:22.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.365+0000 7f89324c9640 1 --2- 172.21.15.17:0/1386476703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f892c0c3c30 0x7f892c156540 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:22.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.365+0000 7f89324c9640 1 -- 172.21.15.17:0/1386476703 >> 172.21.15.17:0/1386476703 conn(0x7f892c070250 msgr2=0x7f892c06c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:22.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.365+0000 7f89324c9640 1 -- 172.21.15.17:0/1386476703 shutdown_connections 2024-09-05T07:57:22.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.365+0000 7f89324c9640 1 -- 172.21.15.17:0/1386476703 wait complete. 2024-09-05T07:57:22.377 INFO:tasks.ceph:Scrubbing osd.3 2024-09-05T07:57:22.377 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-05T07:57:22.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.484+0000 7f43bd001640 1 Processor -- start 2024-09-05T07:57:22.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.484+0000 7f43bd001640 1 -- start start 2024-09-05T07:57:22.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.485+0000 7f43bd001640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f43b8154a10 0x7f43b815e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:22.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.485+0000 7f43bd001640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f43b80c5210 0x7f43b80cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:22.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.485+0000 7f43bd001640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43b815ebd0 con 0x7f43b80c5610 2024-09-05T07:57:22.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.485+0000 7f43bd001640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f43b80cda40 con 0x7f43b80c5210 2024-09-05T07:57:22.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.485+0000 7f43bd001640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f43b806c5e0 con 0x7f43b8154a10 2024-09-05T07:57:22.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.485+0000 7f43b659c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f43b80c5210 0x7f43b80cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:22.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.486+0000 7f43b6d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f43b8154a10 0x7f43b815e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:22.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.486+0000 7f43b6d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f43b8154a10 0x7f43b815e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:58392/0 (socket says 172.21.15.17:58392) 2024-09-05T07:57:22.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.486+0000 7f43b6d9d640 1 -- 172.21.15.17:0/2875975383 learned_addr learned my addr 172.21.15.17:0/2875975383 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:22.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.488+0000 7f43b6d9d640 1 -- 172.21.15.17:0/2875975383 >> v2:172.21.15.17:3300/0 conn(0x7f43b80c5210 msgr2=0x7f43b80cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:57:22.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.488+0000 7f43b6d9d640 1 --2- 172.21.15.17:0/2875975383 >> v2:172.21.15.17:3300/0 conn(0x7f43b80c5210 0x7f43b80cbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:22.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.488+0000 7f43b6d9d640 1 -- 172.21.15.17:0/2875975383 >> v1:172.21.15.17:6789/0 conn(0x7f43b80c5610 legacy=0x7f43b80cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:22.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.488+0000 7f43b6d9d640 1 -- 172.21.15.17:0/2875975383 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b806d880 con 0x7f43b8154a10 2024-09-05T07:57:22.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.490+0000 7f43b6d9d640 1 --2- 172.21.15.17:0/2875975383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43b8154a10 0x7f43b815e690 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f43b806c760 tx=0x7f43a802a7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55230631884c7cbc server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:22.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.494+0000 7f43b5d9b640 1 -- 172.21.15.17:0/2875975383 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a8036070 con 0x7f43b8154a10 2024-09-05T07:57:22.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.494+0000 7f43b5d9b640 1 -- 172.21.15.17:0/2875975383 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43a8031600 con 0x7f43b8154a10 2024-09-05T07:57:22.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.494+0000 7f43b5d9b640 1 -- 172.21.15.17:0/2875975383 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a80319f0 con 0x7f43b8154a10 2024-09-05T07:57:22.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.494+0000 7f43bd001640 1 -- 172.21.15.17:0/2875975383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43b8154a10 msgr2=0x7f43b815e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:22.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.494+0000 7f43bd001640 1 --2- 172.21.15.17:0/2875975383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43b8154a10 0x7f43b815e690 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f43b806c760 tx=0x7f43a802a7c0 comp rx=0 tx=0).stop 2024-09-05T07:57:22.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.494+0000 7f43bd001640 1 -- 172.21.15.17:0/2875975383 shutdown_connections 2024-09-05T07:57:22.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.494+0000 7f43bd001640 1 --2- 172.21.15.17:0/2875975383 >> v2:172.21.15.17:3300/0 conn(0x7f43b80c5210 0x7f43b80cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:22.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.494+0000 7f43bd001640 1 --2- 172.21.15.17:0/2875975383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43b8154a10 0x7f43b815e690 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:22.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.494+0000 7f43bd001640 1 -- 172.21.15.17:0/2875975383 >> 172.21.15.17:0/2875975383 conn(0x7f43b80ccbd0 msgr2=0x7f43b80ccfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:22.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.494+0000 7f43bd001640 1 -- 172.21.15.17:0/2875975383 shutdown_connections 2024-09-05T07:57:22.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.494+0000 7f43bd001640 1 -- 172.21.15.17:0/2875975383 wait complete. 2024-09-05T07:57:22.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.496+0000 7f43bd001640 1 Processor -- start 2024-09-05T07:57:22.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.496+0000 7f43bd001640 1 -- start start 2024-09-05T07:57:22.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.497+0000 7f43bd001640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43b80c5210 0x7f43b80c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:22.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.497+0000 7f43bd001640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43b80c5610 0x7f43b814b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:22.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.497+0000 7f43bd001640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43b8154a10 0x7f43b8157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:22.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.497+0000 7f43bd001640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f43b806c270 con 0x7f43b80c5210 2024-09-05T07:57:22.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.497+0000 7f43bd001640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f43b806bf90 con 0x7f43b8154a10 2024-09-05T07:57:22.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.497+0000 7f43bd001640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f43b8154df0 con 0x7f43b80c5610 2024-09-05T07:57:22.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.497+0000 7f43b6d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43b80c5210 0x7f43b80c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:22.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.497+0000 7f43b759e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43b8154a10 0x7f43b8157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:22.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.497+0000 7f43b659c640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43b80c5610 0x7f43b814b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:22.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.498+0000 7f43b759e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43b8154a10 0x7f43b8157120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:58408/0 (socket says 172.21.15.17:58408) 2024-09-05T07:57:22.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.498+0000 7f43b759e640 1 -- 172.21.15.17:0/1304514361 learned_addr learned my addr 172.21.15.17:0/1304514361 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:22.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.501+0000 7f43b6d9d640 1 -- 172.21.15.17:0/1304514361 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43b80c5610 msgr2=0x7f43b814b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:22.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.501+0000 7f43b6d9d640 1 --2- 172.21.15.17:0/1304514361 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43b80c5610 0x7f43b814b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:22.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.501+0000 7f43b6d9d640 1 -- 172.21.15.17:0/1304514361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43b8154a10 msgr2=0x7f43b8157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:22.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.501+0000 7f43b6d9d640 1 --2- 172.21.15.17:0/1304514361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43b8154a10 0x7f43b8157120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:22.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.501+0000 7f43b6d9d640 1 -- 172.21.15.17:0/1304514361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b814bf20 con 0x7f43b80c5210 2024-09-05T07:57:22.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.503+0000 7f43b6d9d640 1 --2- 172.21.15.17:0/1304514361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43b80c5210 0x7f43b80c7a00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f43a8030000 tx=0x7f43a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:22.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.507+0000 7f43af7fe640 1 -- 172.21.15.17:0/1304514361 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a803f020 con 0x7f43b80c5210 2024-09-05T07:57:22.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.507+0000 7f43af7fe640 1 -- 172.21.15.17:0/1304514361 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43a8003e50 con 0x7f43b80c5210 2024-09-05T07:57:22.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.507+0000 7f43af7fe640 1 -- 172.21.15.17:0/1304514361 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a8036040 con 0x7f43b80c5210 2024-09-05T07:57:22.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.507+0000 7f43bd001640 1 -- 172.21.15.17:0/1304514361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43b814e1f0 con 0x7f43b80c5210 2024-09-05T07:57:22.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.507+0000 7f43bd001640 1 -- 172.21.15.17:0/1304514361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43b81f3f40 con 0x7f43b80c5210 2024-09-05T07:57:22.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.508+0000 7f43bd001640 1 -- 172.21.15.17:0/1304514361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f43b8069600 con 0x7f43b80c5210 2024-09-05T07:57:22.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.528+0000 7f43af7fe640 1 -- 172.21.15.17:0/1304514361 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f43a8042020 con 0x7f43b80c5210 2024-09-05T07:57:22.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.528+0000 7f43af7fe640 1 --2- 172.21.15.17:0/1304514361 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f439806be80 0x7f439806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:22.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.529+0000 7f43b659c640 1 --2- 172.21.15.17:0/1304514361 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f439806be80 0x7f439806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:22.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.529+0000 7f43b659c640 1 --2- 172.21.15.17:0/1304514361 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f439806be80 0x7f439806e340 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f43b80c6cb0 tx=0x7f43a0009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:22.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.533+0000 7f43af7fe640 1 -- 172.21.15.17:0/1304514361 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f43a80778d0 con 0x7f43b80c5210 2024-09-05T07:57:22.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.533+0000 7f43af7fe640 1 --2- 172.21.15.17:0/1304514361 >> [v2:172.21.15.17:6800/3512342499,v1:172.21.15.17:6801/3512342499] conn(0x7f4398074080 0x7f43980764a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:22.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.533+0000 7f43af7fe640 1 -- 172.21.15.17:0/1304514361 --> [v2:172.21.15.17:6800/3512342499,v1:172.21.15.17:6801/3512342499] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4398076b70 con 0x7f4398074080 2024-09-05T07:57:22.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.533+0000 7f43af7fe640 1 -- 172.21.15.17:0/1304514361 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f43a8075ad0 con 0x7f43b80c5210 2024-09-05T07:57:22.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.533+0000 7f43b759e640 1 --2- 172.21.15.17:0/1304514361 >> [v2:172.21.15.17:6800/3512342499,v1:172.21.15.17:6801/3512342499] conn(0x7f4398074080 0x7f43980764a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:22.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.533+0000 7f43b759e640 1 --2- 172.21.15.17:0/1304514361 >> [v2:172.21.15.17:6800/3512342499,v1:172.21.15.17:6801/3512342499] conn(0x7f4398074080 0x7f43980764a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:22.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.534+0000 7f43af7fe640 1 -- 172.21.15.17:0/1304514361 <== osd.3 v2:172.21.15.17:6800/3512342499 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4398076b70 con 0x7f4398074080 2024-09-05T07:57:22.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.548+0000 7f43bd001640 1 -- 172.21.15.17:0/1304514361 --> [v2:172.21.15.17:6800/3512342499,v1:172.21.15.17:6801/3512342499] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f43b806d540 con 0x7f4398074080 2024-09-05T07:57:22.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.549+0000 7f43af7fe640 1 -- 172.21.15.17:0/1304514361 <== osd.3 v2:172.21.15.17:6800/3512342499 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f43b806d540 con 0x7f4398074080 2024-09-05T07:57:22.550 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-05T07:57:22.550 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-05T07:57:22.550 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-05T07:57:22.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.549+0000 7f43bd001640 1 -- 172.21.15.17:0/1304514361 >> [v2:172.21.15.17:6800/3512342499,v1:172.21.15.17:6801/3512342499] conn(0x7f4398074080 msgr2=0x7f43980764a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:22.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.549+0000 7f43bd001640 1 --2- 172.21.15.17:0/1304514361 >> [v2:172.21.15.17:6800/3512342499,v1:172.21.15.17:6801/3512342499] conn(0x7f4398074080 0x7f43980764a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:22.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.549+0000 7f43bd001640 1 -- 172.21.15.17:0/1304514361 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f439806be80 msgr2=0x7f439806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:22.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.549+0000 7f43bd001640 1 --2- 172.21.15.17:0/1304514361 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f439806be80 0x7f439806e340 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f43b80c6cb0 tx=0x7f43a0009190 comp rx=0 tx=0).stop 2024-09-05T07:57:22.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.549+0000 7f43bd001640 1 -- 172.21.15.17:0/1304514361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43b80c5210 msgr2=0x7f43b80c7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:22.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.549+0000 7f43bd001640 1 --2- 172.21.15.17:0/1304514361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43b80c5210 0x7f43b80c7a00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f43a8030000 tx=0x7f43a8004a40 comp rx=0 tx=0).stop 2024-09-05T07:57:22.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.549+0000 7f43b759e640 1 -- 172.21.15.17:0/1304514361 reap_dead start 2024-09-05T07:57:22.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.549+0000 7f43bd001640 1 -- 172.21.15.17:0/1304514361 shutdown_connections 2024-09-05T07:57:22.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.549+0000 7f43bd001640 1 -- 172.21.15.17:0/1304514361 >> 172.21.15.17:0/1304514361 conn(0x7f43b80ccbd0 msgr2=0x7f43b80b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:22.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.549+0000 7f43bd001640 1 -- 172.21.15.17:0/1304514361 shutdown_connections 2024-09-05T07:57:22.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.549+0000 7f43bd001640 1 -- 172.21.15.17:0/1304514361 wait complete. 2024-09-05T07:57:22.562 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-05T07:57:22.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.662+0000 7fed6290a640 1 Processor -- start 2024-09-05T07:57:22.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.662+0000 7fed6290a640 1 -- start start 2024-09-05T07:57:22.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.662+0000 7fed6290a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fed5c0c8bb0 0x7fed5c159020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:22.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.662+0000 7fed6290a640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fed5c0c8280 0x7fed5c0c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:22.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.662+0000 7fed6290a640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed5c0c9120 con 0x7fed5c152a10 2024-09-05T07:57:22.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.662+0000 7fed6290a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fed5c159560 con 0x7fed5c0c8bb0 2024-09-05T07:57:22.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.662+0000 7fed6290a640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fed5c0c3160 con 0x7fed5c0c8280 2024-09-05T07:57:22.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.663+0000 7fed5bfff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fed5c152a10 0x7fed5c0cabd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:38258/0 (socket says 172.21.15.17:38258) 2024-09-05T07:57:22.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.663+0000 7fed5bfff640 1 -- 172.21.15.17:0/2872814703 learned_addr learned my addr 172.21.15.17:0/2872814703 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:57:22.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.663+0000 7fed5b7fe640 1 --2- 172.21.15.17:0/2872814703 >> v2:172.21.15.26:3300/0 conn(0x7fed5c0c8bb0 0x7fed5c159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:22.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.663+0000 7fed60ea7640 1 --2- 172.21.15.17:0/2872814703 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fed5c0c8280 0x7fed5c0c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:22.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.665+0000 7fed60ea7640 1 -- 172.21.15.17:0/2872814703 >> v2:172.21.15.26:3300/0 conn(0x7fed5c0c8bb0 msgr2=0x7fed5c159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:57:22.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.665+0000 7fed60ea7640 1 --2- 172.21.15.17:0/2872814703 >> v2:172.21.15.26:3300/0 conn(0x7fed5c0c8bb0 0x7fed5c159020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:22.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.666+0000 7fed60ea7640 1 -- 172.21.15.17:0/2872814703 >> v1:172.21.15.17:6789/0 conn(0x7fed5c152a10 legacy=0x7fed5c0cabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:22.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.666+0000 7fed60ea7640 1 -- 172.21.15.17:0/2872814703 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed5c0c4ee0 con 0x7fed5c0c8280 2024-09-05T07:57:22.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.666+0000 7fed5b7fe640 1 --2- 172.21.15.17:0/2872814703 >> v2:172.21.15.26:3300/0 conn(0x7fed5c0c8bb0 0x7fed5c159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:57:22.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.667+0000 7fed60ea7640 1 --2- 172.21.15.17:0/2872814703 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fed5c0c8280 0x7fed5c0c95e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fed54009d90 tx=0x7fed5402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1d4323c3d0e1dd server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:22.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.671+0000 7fed5affd640 1 -- 172.21.15.17:0/2872814703 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed54031600 con 0x7fed5c0c8280 2024-09-05T07:57:22.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.671+0000 7fed5affd640 1 -- 172.21.15.17:0/2872814703 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed540317a0 con 0x7fed5c0c8280 2024-09-05T07:57:22.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.671+0000 7fed5affd640 1 -- 172.21.15.17:0/2872814703 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed54031b70 con 0x7fed5c0c8280 2024-09-05T07:57:22.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.672+0000 7fed6290a640 1 -- 172.21.15.17:0/2872814703 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fed5c0c8280 msgr2=0x7fed5c0c95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:22.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.672+0000 7fed6290a640 1 --2- 172.21.15.17:0/2872814703 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fed5c0c8280 0x7fed5c0c95e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fed54009d90 tx=0x7fed5402a5d0 comp rx=0 tx=0).stop 2024-09-05T07:57:22.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.672+0000 7fed6290a640 1 -- 172.21.15.17:0/2872814703 shutdown_connections 2024-09-05T07:57:22.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.672+0000 7fed6290a640 1 --2- 172.21.15.17:0/2872814703 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fed5c0c8280 0x7fed5c0c95e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:22.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.672+0000 7fed6290a640 1 --2- 172.21.15.17:0/2872814703 >> v2:172.21.15.26:3300/0 conn(0x7fed5c0c8bb0 0x7fed5c159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:22.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.672+0000 7fed6290a640 1 -- 172.21.15.17:0/2872814703 >> 172.21.15.17:0/2872814703 conn(0x7fed5c071500 msgr2=0x7fed5c071910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:22.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.672+0000 7fed6290a640 1 -- 172.21.15.17:0/2872814703 shutdown_connections 2024-09-05T07:57:22.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.672+0000 7fed6290a640 1 -- 172.21.15.17:0/2872814703 wait complete. 2024-09-05T07:57:22.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.673+0000 7fed6290a640 1 Processor -- start 2024-09-05T07:57:22.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.673+0000 7fed6290a640 1 -- start start 2024-09-05T07:57:22.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.674+0000 7fed6290a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed5c0c8280 0x7fed5c1e5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:22.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.674+0000 7fed6290a640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fed5c0c8bb0 0x7fed5c14e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:22.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.674+0000 7fed6290a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed5c152a10 0x7fed5c14e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:22.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.674+0000 7fed6290a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fed5c0c3690 con 0x7fed5c152a10 2024-09-05T07:57:22.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.674+0000 7fed6290a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fed5c0c33b0 con 0x7fed5c0c8280 2024-09-05T07:57:22.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.674+0000 7fed6290a640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fed5c0cb2e0 con 0x7fed5c0c8bb0 2024-09-05T07:57:22.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.674+0000 7fed5b7fe640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fed5c0c8bb0 0x7fed5c14e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:22.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.674+0000 7fed60ea7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed5c152a10 0x7fed5c14e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:22.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.674+0000 7fed5bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed5c0c8280 0x7fed5c1e5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:22.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.675+0000 7fed5b7fe640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fed5c0c8bb0 0x7fed5c14e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:54216/0 (socket says 172.21.15.17:54216) 2024-09-05T07:57:22.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.675+0000 7fed5b7fe640 1 -- 172.21.15.17:0/3722258662 learned_addr learned my addr 172.21.15.17:0/3722258662 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:22.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.678+0000 7fed5b7fe640 1 -- 172.21.15.17:0/3722258662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed5c0c8280 msgr2=0x7fed5c1e5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:22.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.678+0000 7fed5b7fe640 1 --2- 172.21.15.17:0/3722258662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed5c0c8280 0x7fed5c1e5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:22.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.678+0000 7fed5b7fe640 1 -- 172.21.15.17:0/3722258662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed5c152a10 msgr2=0x7fed5c14e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:22.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.678+0000 7fed5b7fe640 1 --2- 172.21.15.17:0/3722258662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed5c152a10 0x7fed5c14e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:22.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.678+0000 7fed5b7fe640 1 -- 172.21.15.17:0/3722258662 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed5c151ac0 con 0x7fed5c0c8bb0 2024-09-05T07:57:22.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.680+0000 7fed5b7fe640 1 --2- 172.21.15.17:0/3722258662 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fed5c0c8bb0 0x7fed5c14e1f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fed5000ebe0 tx=0x7fed5000c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:22.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.684+0000 7fed58ff9640 1 -- 172.21.15.17:0/3722258662 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed50017070 con 0x7fed5c0c8bb0 2024-09-05T07:57:22.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.684+0000 7fed58ff9640 1 -- 172.21.15.17:0/3722258662 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed5000cc30 con 0x7fed5c0c8bb0 2024-09-05T07:57:22.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.684+0000 7fed6290a640 1 -- 172.21.15.17:0/3722258662 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed5c1e5ed0 con 0x7fed5c0c8bb0 2024-09-05T07:57:22.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.684+0000 7fed58ff9640 1 -- 172.21.15.17:0/3722258662 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed50013470 con 0x7fed5c0c8bb0 2024-09-05T07:57:22.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.684+0000 7fed6290a640 1 -- 172.21.15.17:0/3722258662 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fed5c151d30 con 0x7fed5c0c8bb0 2024-09-05T07:57:22.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.685+0000 7fed6290a640 1 -- 172.21.15.17:0/3722258662 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed5c0c5790 con 0x7fed5c0c8bb0 2024-09-05T07:57:22.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.705+0000 7fed58ff9640 1 -- 172.21.15.17:0/3722258662 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fed5001a070 con 0x7fed5c0c8bb0 2024-09-05T07:57:22.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.705+0000 7fed58ff9640 1 --2- 172.21.15.17:0/3722258662 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fed4806be60 0x7fed4806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:22.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.706+0000 7fed5bfff640 1 --2- 172.21.15.17:0/3722258662 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fed4806be60 0x7fed4806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:22.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.706+0000 7fed5bfff640 1 --2- 172.21.15.17:0/3722258662 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fed4806be60 0x7fed4806e320 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fed4c007fd0 tx=0x7fed4c007e80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:22.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.709+0000 7fed58ff9640 1 -- 172.21.15.17:0/3722258662 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7fed50057950 con 0x7fed5c0c8bb0 2024-09-05T07:57:22.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:22.977+0000 7fed58ff9640 1 -- 172.21.15.17:0/3722258662 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fed5c0c5790 con 0x7fed5c0c8bb0 2024-09-05T07:57:23.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.157+0000 7fed6290a640 1 -- 172.21.15.17:0/3722258662 --> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fed5c159020 con 0x7fed4806be60 2024-09-05T07:57:23.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.158+0000 7fed58ff9640 1 -- 172.21.15.17:0/3722258662 <== mgr.4099 v2:172.21.15.26:6800/2736912541 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fed5c159020 con 0x7fed4806be60 2024-09-05T07:57:23.158 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 3 to deep-scrub 2024-09-05T07:57:23.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.160+0000 7fed6290a640 1 -- 172.21.15.17:0/3722258662 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fed4806be60 msgr2=0x7fed4806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:23.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.160+0000 7fed6290a640 1 --2- 172.21.15.17:0/3722258662 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fed4806be60 0x7fed4806e320 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fed4c007fd0 tx=0x7fed4c007e80 comp rx=0 tx=0).stop 2024-09-05T07:57:23.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.160+0000 7fed6290a640 1 -- 172.21.15.17:0/3722258662 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fed5c0c8bb0 msgr2=0x7fed5c14e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:23.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.160+0000 7fed6290a640 1 --2- 172.21.15.17:0/3722258662 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fed5c0c8bb0 0x7fed5c14e1f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fed5000ebe0 tx=0x7fed5000c520 comp rx=0 tx=0).stop 2024-09-05T07:57:23.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.160+0000 7fed6290a640 1 -- 172.21.15.17:0/3722258662 shutdown_connections 2024-09-05T07:57:23.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.160+0000 7fed6290a640 1 --2- 172.21.15.17:0/3722258662 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fed4806be60 0x7fed4806e320 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:23.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.160+0000 7fed6290a640 1 --2- 172.21.15.17:0/3722258662 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fed5c0c8bb0 0x7fed5c14e1f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:23.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.160+0000 7fed6290a640 1 --2- 172.21.15.17:0/3722258662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed5c152a10 0x7fed5c14e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:23.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.160+0000 7fed6290a640 1 --2- 172.21.15.17:0/3722258662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed5c0c8280 0x7fed5c1e5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:23.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.160+0000 7fed6290a640 1 -- 172.21.15.17:0/3722258662 >> 172.21.15.17:0/3722258662 conn(0x7fed5c071500 msgr2=0x7fed5c070850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:23.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.161+0000 7fed6290a640 1 -- 172.21.15.17:0/3722258662 shutdown_connections 2024-09-05T07:57:23.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.161+0000 7fed6290a640 1 -- 172.21.15.17:0/3722258662 wait complete. 2024-09-05T07:57:23.173 INFO:tasks.ceph:Scrubbing osd.4 2024-09-05T07:57:23.173 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-05T07:57:23.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.281+0000 7f4de11ef640 1 Processor -- start 2024-09-05T07:57:23.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.282+0000 7f4de11ef640 1 -- start start 2024-09-05T07:57:23.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.283+0000 7f4de11ef640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4ddc15c840 0x7f4ddc0ca500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:23.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.283+0000 7f4de11ef640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ddc1590e0 con 0x7f4ddc152aa0 2024-09-05T07:57:23.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.283+0000 7f4de11ef640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ddc1593c0 con 0x7f4ddc070130 2024-09-05T07:57:23.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.283+0000 7f4de11ef640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f4ddc0caa40 con 0x7f4ddc15c840 2024-09-05T07:57:23.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.283+0000 7f4dd3fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4ddc070130 0x7f4ddc15c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.17:56596/0 (socket says 172.21.15.17:56596) 2024-09-05T07:57:23.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.283+0000 7f4dd3fff640 1 -- 172.21.15.17:0/4098128173 learned_addr learned my addr 172.21.15.17:0/4098128173 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:57:23.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.330+0000 7f4ddb59e640 1 --2- 172.21.15.17:0/4098128173 >> v2:172.21.15.17:3300/0 conn(0x7f4ddc15c840 0x7f4ddc0ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:23.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.335+0000 7f4ddb59e640 1 -- 172.21.15.17:0/4098128173 >> v1:172.21.15.26:6789/0 conn(0x7f4ddc070130 legacy=0x7f4ddc15c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:23.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.335+0000 7f4ddb59e640 1 -- 172.21.15.17:0/4098128173 >> v1:172.21.15.17:6789/0 conn(0x7f4ddc152aa0 legacy=0x7f4ddc0cb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:23.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.335+0000 7f4ddb59e640 1 -- 172.21.15.17:0/4098128173 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ddc0c9550 con 0x7f4ddc15c840 2024-09-05T07:57:23.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.341+0000 7f4ddb59e640 1 --2- 172.21.15.17:0/4098128173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ddc15c840 0x7f4ddc0ca500 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4009d90 tx=0x7f4dd402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2de90abf05dd8a9a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:23.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.345+0000 7f4dda59c640 1 -- 172.21.15.17:0/4098128173 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4007740 con 0x7f4ddc15c840 2024-09-05T07:57:23.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.345+0000 7f4dda59c640 1 -- 172.21.15.17:0/4098128173 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dd40078e0 con 0x7f4ddc15c840 2024-09-05T07:57:23.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.345+0000 7f4dda59c640 1 -- 172.21.15.17:0/4098128173 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4007cb0 con 0x7f4ddc15c840 2024-09-05T07:57:23.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.346+0000 7f4de11ef640 1 -- 172.21.15.17:0/4098128173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ddc15c840 msgr2=0x7f4ddc0ca500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:23.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.346+0000 7f4de11ef640 1 --2- 172.21.15.17:0/4098128173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ddc15c840 0x7f4ddc0ca500 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4009d90 tx=0x7f4dd402a6f0 comp rx=0 tx=0).stop 2024-09-05T07:57:23.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.346+0000 7f4de11ef640 1 -- 172.21.15.17:0/4098128173 shutdown_connections 2024-09-05T07:57:23.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.346+0000 7f4de11ef640 1 --2- 172.21.15.17:0/4098128173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ddc15c840 0x7f4ddc0ca500 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:23.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.346+0000 7f4de11ef640 1 -- 172.21.15.17:0/4098128173 >> 172.21.15.17:0/4098128173 conn(0x7f4ddc071670 msgr2=0x7f4ddc071a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:23.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.346+0000 7f4de11ef640 1 -- 172.21.15.17:0/4098128173 shutdown_connections 2024-09-05T07:57:23.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.346+0000 7f4de11ef640 1 -- 172.21.15.17:0/4098128173 wait complete. 2024-09-05T07:57:23.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.347+0000 7f4de11ef640 1 Processor -- start 2024-09-05T07:57:23.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.347+0000 7f4de11ef640 1 -- start start 2024-09-05T07:57:23.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.348+0000 7f4de11ef640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ddc070130 0x7f4ddc0b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:23.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.348+0000 7f4de11ef640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ddc152aa0 0x7f4ddc1f3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:23.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.348+0000 7f4de11ef640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ddc15c840 0x7f4ddc151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:23.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.348+0000 7f4de11ef640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4ddc0c8d60 con 0x7f4ddc15c840 2024-09-05T07:57:23.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.348+0000 7f4de11ef640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f4ddc0c9300 con 0x7f4ddc152aa0 2024-09-05T07:57:23.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.348+0000 7f4de11ef640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f4ddc0c8ee0 con 0x7f4ddc070130 2024-09-05T07:57:23.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.349+0000 7f4ddb59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ddc15c840 0x7f4ddc151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:23.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.349+0000 7f4ddb59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ddc15c840 0x7f4ddc151d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51814/0 (socket says 172.21.15.17:51814) 2024-09-05T07:57:23.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.349+0000 7f4ddb59e640 1 -- 172.21.15.17:0/922882576 learned_addr learned my addr 172.21.15.17:0/922882576 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:23.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.353+0000 7f4ddb59e640 1 -- 172.21.15.17:0/922882576 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ddc070130 msgr2=0x7f4ddc0b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:23.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.353+0000 7f4ddb59e640 1 --2- 172.21.15.17:0/922882576 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ddc070130 0x7f4ddc0b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:23.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.353+0000 7f4ddb59e640 1 -- 172.21.15.17:0/922882576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ddc152aa0 msgr2=0x7f4ddc1f3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:23.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.353+0000 7f4ddb59e640 1 --2- 172.21.15.17:0/922882576 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ddc152aa0 0x7f4ddc1f3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:23.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.353+0000 7f4ddb59e640 1 -- 172.21.15.17:0/922882576 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ddc158860 con 0x7f4ddc15c840 2024-09-05T07:57:23.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.355+0000 7f4ddb59e640 1 --2- 172.21.15.17:0/922882576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ddc15c840 0x7f4ddc151d70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4009e80 tx=0x7f4dd4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:23.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.357+0000 7f4dd37fe640 1 -- 172.21.15.17:0/922882576 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd403f070 con 0x7f4ddc15c840 2024-09-05T07:57:23.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.357+0000 7f4de11ef640 1 -- 172.21.15.17:0/922882576 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ddc0b0150 con 0x7f4ddc15c840 2024-09-05T07:57:23.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.357+0000 7f4de11ef640 1 -- 172.21.15.17:0/922882576 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ddc1f06a0 con 0x7f4ddc15c840 2024-09-05T07:57:23.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.358+0000 7f4de11ef640 1 -- 172.21.15.17:0/922882576 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4ddc069220 con 0x7f4ddc15c840 2024-09-05T07:57:23.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.379+0000 7f4dd37fe640 1 -- 172.21.15.17:0/922882576 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dd4007850 con 0x7f4ddc15c840 2024-09-05T07:57:23.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.379+0000 7f4dd37fe640 1 -- 172.21.15.17:0/922882576 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4031e30 con 0x7f4ddc15c840 2024-09-05T07:57:23.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.380+0000 7f4dd37fe640 1 -- 172.21.15.17:0/922882576 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4dd4044460 con 0x7f4ddc15c840 2024-09-05T07:57:23.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.381+0000 7f4dd37fe640 1 --2- 172.21.15.17:0/922882576 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f4dbc06be60 0x7f4dbc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:23.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.381+0000 7f4ddad9d640 1 --2- 172.21.15.17:0/922882576 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f4dbc06be60 0x7f4dbc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:23.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.381+0000 7f4ddad9d640 1 --2- 172.21.15.17:0/922882576 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f4dbc06be60 0x7f4dbc06e320 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc000f60 tx=0x7f4dcc0079d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:23.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.384+0000 7f4dd37fe640 1 -- 172.21.15.17:0/922882576 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f4dd4078da0 con 0x7f4ddc15c840 2024-09-05T07:57:23.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.384+0000 7f4dd37fe640 1 --2- 172.21.15.17:0/922882576 >> [v2:172.21.15.26:6802/3740556509,v1:172.21.15.26:6803/3740556509] conn(0x7f4dbc0740c0 0x7f4dbc0764e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:23.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.384+0000 7f4dd37fe640 1 -- 172.21.15.17:0/922882576 --> [v2:172.21.15.26:6802/3740556509,v1:172.21.15.26:6803/3740556509] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4dd400ae60 con 0x7f4dbc0740c0 2024-09-05T07:57:23.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.384+0000 7f4dd37fe640 1 -- 172.21.15.17:0/922882576 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4dd4076fa0 con 0x7f4ddc15c840 2024-09-05T07:57:23.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.384+0000 7f4dd3fff640 1 --2- 172.21.15.17:0/922882576 >> [v2:172.21.15.26:6802/3740556509,v1:172.21.15.26:6803/3740556509] conn(0x7f4dbc0740c0 0x7f4dbc0764e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:23.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.385+0000 7f4dd3fff640 1 --2- 172.21.15.17:0/922882576 >> [v2:172.21.15.26:6802/3740556509,v1:172.21.15.26:6803/3740556509] conn(0x7f4dbc0740c0 0x7f4dbc0764e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:23.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.385+0000 7f4dd37fe640 1 -- 172.21.15.17:0/922882576 <== osd.4 v2:172.21.15.26:6802/3740556509 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4dd400ae60 con 0x7f4dbc0740c0 2024-09-05T07:57:23.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.398+0000 7f4de11ef640 1 -- 172.21.15.17:0/922882576 --> [v2:172.21.15.26:6802/3740556509,v1:172.21.15.26:6803/3740556509] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4ddc0ca500 con 0x7f4dbc0740c0 2024-09-05T07:57:23.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.399+0000 7f4dd37fe640 1 -- 172.21.15.17:0/922882576 <== osd.4 v2:172.21.15.26:6802/3740556509 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4ddc0ca500 con 0x7f4dbc0740c0 2024-09-05T07:57:23.399 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-05T07:57:23.400 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-05T07:57:23.400 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-05T07:57:23.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.399+0000 7f4de11ef640 1 -- 172.21.15.17:0/922882576 >> [v2:172.21.15.26:6802/3740556509,v1:172.21.15.26:6803/3740556509] conn(0x7f4dbc0740c0 msgr2=0x7f4dbc0764e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:23.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.399+0000 7f4de11ef640 1 --2- 172.21.15.17:0/922882576 >> [v2:172.21.15.26:6802/3740556509,v1:172.21.15.26:6803/3740556509] conn(0x7f4dbc0740c0 0x7f4dbc0764e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:23.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.399+0000 7f4de11ef640 1 -- 172.21.15.17:0/922882576 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f4dbc06be60 msgr2=0x7f4dbc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:23.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.399+0000 7f4de11ef640 1 --2- 172.21.15.17:0/922882576 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f4dbc06be60 0x7f4dbc06e320 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc000f60 tx=0x7f4dcc0079d0 comp rx=0 tx=0).stop 2024-09-05T07:57:23.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.399+0000 7f4de11ef640 1 -- 172.21.15.17:0/922882576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ddc15c840 msgr2=0x7f4ddc151d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:23.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.399+0000 7f4de11ef640 1 --2- 172.21.15.17:0/922882576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ddc15c840 0x7f4ddc151d70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4009e80 tx=0x7f4dd4004a40 comp rx=0 tx=0).stop 2024-09-05T07:57:23.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.399+0000 7f4ddb59e640 1 -- 172.21.15.17:0/922882576 reap_dead start 2024-09-05T07:57:23.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.399+0000 7f4de11ef640 1 -- 172.21.15.17:0/922882576 shutdown_connections 2024-09-05T07:57:23.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.399+0000 7f4de11ef640 1 -- 172.21.15.17:0/922882576 >> 172.21.15.17:0/922882576 conn(0x7f4ddc071670 msgr2=0x7f4ddc071a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:23.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.399+0000 7f4de11ef640 1 -- 172.21.15.17:0/922882576 shutdown_connections 2024-09-05T07:57:23.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.399+0000 7f4de11ef640 1 -- 172.21.15.17:0/922882576 wait complete. 2024-09-05T07:57:23.410 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-05T07:57:23.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.512+0000 7f551be47640 1 Processor -- start 2024-09-05T07:57:23.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.513+0000 7f551be47640 1 -- start start 2024-09-05T07:57:23.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.513+0000 7f551be47640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5514154bc0 0x7f551415de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:23.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.513+0000 7f551be47640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f551415b650 0x7f551406c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:23.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.514+0000 7f551be47640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f551415a8f0 con 0x7f55140cda50 2024-09-05T07:57:23.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.514+0000 7f551be47640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f55140cae30 con 0x7f5514154bc0 2024-09-05T07:57:23.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.514+0000 7f551be47640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f55140cc710 con 0x7f551415b650 2024-09-05T07:57:23.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.514+0000 7f5519be3640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5514154bc0 0x7f551415de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:23.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.514+0000 7f55193e2640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f551415b650 0x7f551406c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:23.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.514+0000 7f551a3e4640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f55140cda50 0x7f55140d0290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:38288/0 (socket says 172.21.15.17:38288) 2024-09-05T07:57:23.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.514+0000 7f551a3e4640 1 -- 172.21.15.17:0/2735123204 learned_addr learned my addr 172.21.15.17:0/2735123204 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:57:23.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.517+0000 7f55193e2640 1 -- 172.21.15.17:0/2735123204 >> v2:172.21.15.26:3300/0 conn(0x7f5514154bc0 msgr2=0x7f551415de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:57:23.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.517+0000 7f55193e2640 1 --2- 172.21.15.17:0/2735123204 >> v2:172.21.15.26:3300/0 conn(0x7f5514154bc0 0x7f551415de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:23.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.517+0000 7f55193e2640 1 -- 172.21.15.17:0/2735123204 >> v1:172.21.15.17:6789/0 conn(0x7f55140cda50 legacy=0x7f55140d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:23.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.517+0000 7f55193e2640 1 -- 172.21.15.17:0/2735123204 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55140cc9f0 con 0x7f551415b650 2024-09-05T07:57:23.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.517+0000 7f5519be3640 1 --2- 172.21.15.17:0/2735123204 >> v2:172.21.15.26:3300/0 conn(0x7f5514154bc0 0x7f551415de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:57:23.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.519+0000 7f55193e2640 1 --2- 172.21.15.17:0/2735123204 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f551415b650 0x7f551406c140 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f55080097d0 tx=0x7f550802a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43aeafd9747c6d65 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:23.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.522+0000 7f5518be1640 1 -- 172.21.15.17:0/2735123204 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5508037070 con 0x7f551415b650 2024-09-05T07:57:23.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.523+0000 7f5518be1640 1 -- 172.21.15.17:0/2735123204 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5508032440 con 0x7f551415b650 2024-09-05T07:57:23.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.523+0000 7f5518be1640 1 -- 172.21.15.17:0/2735123204 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5508032810 con 0x7f551415b650 2024-09-05T07:57:23.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.523+0000 7f551be47640 1 -- 172.21.15.17:0/2735123204 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f551415b650 msgr2=0x7f551406c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:23.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.523+0000 7f551be47640 1 --2- 172.21.15.17:0/2735123204 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f551415b650 0x7f551406c140 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f55080097d0 tx=0x7f550802a1c0 comp rx=0 tx=0).stop 2024-09-05T07:57:23.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.523+0000 7f551be47640 1 -- 172.21.15.17:0/2735123204 shutdown_connections 2024-09-05T07:57:23.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.523+0000 7f551be47640 1 --2- 172.21.15.17:0/2735123204 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f551415b650 0x7f551406c140 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:23.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.523+0000 7f551be47640 1 --2- 172.21.15.17:0/2735123204 >> v2:172.21.15.26:3300/0 conn(0x7f5514154bc0 0x7f551415de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:23.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.523+0000 7f551be47640 1 -- 172.21.15.17:0/2735123204 >> 172.21.15.17:0/2735123204 conn(0x7f55140738d0 msgr2=0x7f5514073ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:23.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.523+0000 7f551be47640 1 -- 172.21.15.17:0/2735123204 shutdown_connections 2024-09-05T07:57:23.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.523+0000 7f551be47640 1 -- 172.21.15.17:0/2735123204 wait complete. 2024-09-05T07:57:23.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.524+0000 7f551be47640 1 Processor -- start 2024-09-05T07:57:23.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.524+0000 7f551be47640 1 -- start start 2024-09-05T07:57:23.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.525+0000 7f551be47640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55140cda50 0x7f55140c54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:23.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.525+0000 7f551be47640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5514154bc0 0x7f551414eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:23.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.525+0000 7f551be47640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f551415b650 0x7f551414f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:23.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.525+0000 7f551be47640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f551415b130 con 0x7f551415b650 2024-09-05T07:57:23.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.525+0000 7f551be47640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f551415ae50 con 0x7f55140cda50 2024-09-05T07:57:23.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.525+0000 7f551be47640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f551415e3a0 con 0x7f5514154bc0 2024-09-05T07:57:23.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.526+0000 7f551a3e4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f551415b650 0x7f551414f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:23.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.526+0000 7f55193e2640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5514154bc0 0x7f551414eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:23.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.526+0000 7f55193e2640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5514154bc0 0x7f551414eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:54242/0 (socket says 172.21.15.17:54242) 2024-09-05T07:57:23.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.526+0000 7f55193e2640 1 -- 172.21.15.17:0/1109307031 learned_addr learned my addr 172.21.15.17:0/1109307031 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:23.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.526+0000 7f5519be3640 1 --2- 172.21.15.17:0/1109307031 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55140cda50 0x7f55140c54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:23.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.529+0000 7f55193e2640 1 -- 172.21.15.17:0/1109307031 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55140cda50 msgr2=0x7f55140c54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:23.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.529+0000 7f55193e2640 1 --2- 172.21.15.17:0/1109307031 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55140cda50 0x7f55140c54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:23.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.529+0000 7f55193e2640 1 -- 172.21.15.17:0/1109307031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f551415b650 msgr2=0x7f551414f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:23.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.529+0000 7f55193e2640 1 --2- 172.21.15.17:0/1109307031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f551415b650 0x7f551414f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:23.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.529+0000 7f55193e2640 1 -- 172.21.15.17:0/1109307031 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55140c7d10 con 0x7f5514154bc0 2024-09-05T07:57:23.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.532+0000 7f55193e2640 1 --2- 172.21.15.17:0/1109307031 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5514154bc0 0x7f551414eb60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f550802a7b0 tx=0x7f55080046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:23.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.536+0000 7f55127fc640 1 -- 172.21.15.17:0/1109307031 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5508037050 con 0x7f5514154bc0 2024-09-05T07:57:23.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.536+0000 7f55127fc640 1 -- 172.21.15.17:0/1109307031 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5508038040 con 0x7f5514154bc0 2024-09-05T07:57:23.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.536+0000 7f551be47640 1 -- 172.21.15.17:0/1109307031 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55140c8c70 con 0x7f5514154bc0 2024-09-05T07:57:23.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.536+0000 7f55127fc640 1 -- 172.21.15.17:0/1109307031 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5508030bd0 con 0x7f5514154bc0 2024-09-05T07:57:23.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.536+0000 7f551be47640 1 -- 172.21.15.17:0/1109307031 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f55140c7a30 con 0x7f5514154bc0 2024-09-05T07:57:23.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.537+0000 7f551be47640 1 -- 172.21.15.17:0/1109307031 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f551415a5b0 con 0x7f5514154bc0 2024-09-05T07:57:23.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.811+0000 7f55127fc640 1 -- 172.21.15.17:0/1109307031 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f550803c440 con 0x7f5514154bc0 2024-09-05T07:57:23.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.812+0000 7f55127fc640 1 --2- 172.21.15.17:0/1109307031 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f550006be30 0x7f550006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:23.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.812+0000 7f5519be3640 1 --2- 172.21.15.17:0/1109307031 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f550006be30 0x7f550006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:23.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.813+0000 7f5519be3640 1 --2- 172.21.15.17:0/1109307031 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f550006be30 0x7f550006e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5504009bd0 tx=0x7f550400b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:23.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.815+0000 7f55127fc640 1 -- 172.21.15.17:0/1109307031 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f5508078780 con 0x7f5514154bc0 2024-09-05T07:57:23.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:23.827+0000 7f55127fc640 1 -- 172.21.15.17:0/1109307031 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f551415a5b0 con 0x7f5514154bc0 2024-09-05T07:57:24.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.011+0000 7f551be47640 1 -- 172.21.15.17:0/1109307031 --> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f55140c8f50 con 0x7f550006be30 2024-09-05T07:57:24.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.012+0000 7f55127fc640 1 -- 172.21.15.17:0/1109307031 <== mgr.4099 v2:172.21.15.26:6800/2736912541 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f55140c8f50 con 0x7f550006be30 2024-09-05T07:57:24.012 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 4 to deep-scrub 2024-09-05T07:57:24.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.014+0000 7f551be47640 1 -- 172.21.15.17:0/1109307031 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f550006be30 msgr2=0x7f550006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:24.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.014+0000 7f551be47640 1 --2- 172.21.15.17:0/1109307031 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f550006be30 0x7f550006e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5504009bd0 tx=0x7f550400b040 comp rx=0 tx=0).stop 2024-09-05T07:57:24.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.014+0000 7f551be47640 1 -- 172.21.15.17:0/1109307031 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5514154bc0 msgr2=0x7f551414eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:24.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.014+0000 7f551be47640 1 --2- 172.21.15.17:0/1109307031 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5514154bc0 0x7f551414eb60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f550802a7b0 tx=0x7f55080046c0 comp rx=0 tx=0).stop 2024-09-05T07:57:24.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.014+0000 7f551be47640 1 -- 172.21.15.17:0/1109307031 shutdown_connections 2024-09-05T07:57:24.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.014+0000 7f551be47640 1 --2- 172.21.15.17:0/1109307031 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f550006be30 0x7f550006e2f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:24.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.014+0000 7f551be47640 1 --2- 172.21.15.17:0/1109307031 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5514154bc0 0x7f551414eb60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:24.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.014+0000 7f551be47640 1 --2- 172.21.15.17:0/1109307031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f551415b650 0x7f551414f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:24.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.014+0000 7f551be47640 1 --2- 172.21.15.17:0/1109307031 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55140cda50 0x7f55140c54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:24.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.014+0000 7f551be47640 1 -- 172.21.15.17:0/1109307031 >> 172.21.15.17:0/1109307031 conn(0x7f55140738d0 msgr2=0x7f5514159860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:24.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.014+0000 7f551be47640 1 -- 172.21.15.17:0/1109307031 shutdown_connections 2024-09-05T07:57:24.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.014+0000 7f551be47640 1 -- 172.21.15.17:0/1109307031 wait complete. 2024-09-05T07:57:24.025 INFO:tasks.ceph:Scrubbing osd.5 2024-09-05T07:57:24.026 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-05T07:57:24.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.130+0000 7f45f7e7b640 1 Processor -- start 2024-09-05T07:57:24.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.130+0000 7f45f7e7b640 1 -- start start 2024-09-05T07:57:24.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.131+0000 7f45f7e7b640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45f01527e0 0x7f45f00c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:24.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.131+0000 7f45f7e7b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f45f0152bc0 0x7f45f00c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:24.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.131+0000 7f45f7e7b640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45f00c5280 con 0x7f45f0158640 2024-09-05T07:57:24.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.131+0000 7f45f7e7b640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f45f00c9430 con 0x7f45f0152bc0 2024-09-05T07:57:24.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.131+0000 7f45f7e7b640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f45f00c3200 con 0x7f45f01527e0 2024-09-05T07:57:24.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.131+0000 7f45f5c17640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45f01527e0 0x7f45f00c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:24.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.132+0000 7f45f5c17640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45f01527e0 0x7f45f00c8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:54258/0 (socket says 172.21.15.17:54258) 2024-09-05T07:57:24.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.132+0000 7f45f5c17640 1 -- 172.21.15.17:0/1971513694 learned_addr learned my addr 172.21.15.17:0/1971513694 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:24.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.132+0000 7f45f5416640 1 --2- 172.21.15.17:0/1971513694 >> v2:172.21.15.26:3300/0 conn(0x7f45f0152bc0 0x7f45f00c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:24.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.134+0000 7f45f5c17640 1 -- 172.21.15.17:0/1971513694 >> v2:172.21.15.26:3300/0 conn(0x7f45f0152bc0 msgr2=0x7f45f00c98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:57:24.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.134+0000 7f45f5c17640 1 --2- 172.21.15.17:0/1971513694 >> v2:172.21.15.26:3300/0 conn(0x7f45f0152bc0 0x7f45f00c98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:24.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.134+0000 7f45f5c17640 1 -- 172.21.15.17:0/1971513694 >> v1:172.21.15.26:6789/0 conn(0x7f45f0158640 legacy=0x7f45f006fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:24.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.134+0000 7f45f5c17640 1 -- 172.21.15.17:0/1971513694 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f00c34e0 con 0x7f45f01527e0 2024-09-05T07:57:24.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.136+0000 7f45f5c17640 1 --2- 172.21.15.17:0/1971513694 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45f01527e0 0x7f45f00c8b40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f45ec0098a0 tx=0x7f45ec02a320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9513b0d0ab2e323a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:24.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.140+0000 7f45f4c15640 1 -- 172.21.15.17:0/1971513694 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec037070 con 0x7f45f01527e0 2024-09-05T07:57:24.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.140+0000 7f45f4c15640 1 -- 172.21.15.17:0/1971513694 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45ec032640 con 0x7f45f01527e0 2024-09-05T07:57:24.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.140+0000 7f45f4c15640 1 -- 172.21.15.17:0/1971513694 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec032a10 con 0x7f45f01527e0 2024-09-05T07:57:24.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.141+0000 7f45f7e7b640 1 -- 172.21.15.17:0/1971513694 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45f01527e0 msgr2=0x7f45f00c8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:24.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.141+0000 7f45f7e7b640 1 --2- 172.21.15.17:0/1971513694 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45f01527e0 0x7f45f00c8b40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f45ec0098a0 tx=0x7f45ec02a320 comp rx=0 tx=0).stop 2024-09-05T07:57:24.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.141+0000 7f45f7e7b640 1 -- 172.21.15.17:0/1971513694 shutdown_connections 2024-09-05T07:57:24.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.141+0000 7f45f7e7b640 1 --2- 172.21.15.17:0/1971513694 >> v2:172.21.15.26:3300/0 conn(0x7f45f0152bc0 0x7f45f00c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:24.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.141+0000 7f45f7e7b640 1 --2- 172.21.15.17:0/1971513694 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45f01527e0 0x7f45f00c8b40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:24.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.141+0000 7f45f7e7b640 1 -- 172.21.15.17:0/1971513694 >> 172.21.15.17:0/1971513694 conn(0x7f45f00ce140 msgr2=0x7f45f00ce550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:24.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.141+0000 7f45f7e7b640 1 -- 172.21.15.17:0/1971513694 shutdown_connections 2024-09-05T07:57:24.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.141+0000 7f45f7e7b640 1 -- 172.21.15.17:0/1971513694 wait complete. 2024-09-05T07:57:24.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.142+0000 7f45f7e7b640 1 Processor -- start 2024-09-05T07:57:24.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.143+0000 7f45f7e7b640 1 -- start start 2024-09-05T07:57:24.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.143+0000 7f45f7e7b640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45f01527e0 0x7f45f014da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:24.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.143+0000 7f45f7e7b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45f0158640 0x7f45f014e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:24.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.143+0000 7f45f7e7b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45f01e2e50 0x7f45f01f0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:24.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.143+0000 7f45f7e7b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f45f00c4f00 con 0x7f45f01e2e50 2024-09-05T07:57:24.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.143+0000 7f45f7e7b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f45f00c9e00 con 0x7f45f0158640 2024-09-05T07:57:24.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.143+0000 7f45f7e7b640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f45f0070270 con 0x7f45f01527e0 2024-09-05T07:57:24.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.144+0000 7f45f5c17640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45f01527e0 0x7f45f014da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:24.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.144+0000 7f45f5416640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45f0158640 0x7f45f014e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:24.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.144+0000 7f45f5416640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45f0158640 0x7f45f014e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:58478/0 (socket says 172.21.15.17:58478) 2024-09-05T07:57:24.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.144+0000 7f45f5c17640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45f01527e0 0x7f45f014da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:54266/0 (socket says 172.21.15.17:54266) 2024-09-05T07:57:24.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.144+0000 7f45f5416640 1 -- 172.21.15.17:0/1448132051 learned_addr learned my addr 172.21.15.17:0/1448132051 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:24.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.145+0000 7f45f6418640 1 --2- 172.21.15.17:0/1448132051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45f01e2e50 0x7f45f01f0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:24.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.148+0000 7f45f5c17640 1 -- 172.21.15.17:0/1448132051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45f0158640 msgr2=0x7f45f014e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:24.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.148+0000 7f45f5c17640 1 --2- 172.21.15.17:0/1448132051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45f0158640 0x7f45f014e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:24.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.148+0000 7f45f5c17640 1 -- 172.21.15.17:0/1448132051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45f01e2e50 msgr2=0x7f45f01f0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:24.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.148+0000 7f45f5c17640 1 --2- 172.21.15.17:0/1448132051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45f01e2e50 0x7f45f01f0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:24.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.148+0000 7f45f5c17640 1 -- 172.21.15.17:0/1448132051 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f01e19b0 con 0x7f45f01527e0 2024-09-05T07:57:24.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.150+0000 7f45f5c17640 1 --2- 172.21.15.17:0/1448132051 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45f01527e0 0x7f45f014da50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f45f00c95b0 tx=0x7f45ec0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:24.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.155+0000 7f45e67fc640 1 -- 172.21.15.17:0/1448132051 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec041070 con 0x7f45f01527e0 2024-09-05T07:57:24.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.155+0000 7f45e67fc640 1 -- 172.21.15.17:0/1448132051 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45ec03c8b0 con 0x7f45f01527e0 2024-09-05T07:57:24.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.155+0000 7f45f7e7b640 1 -- 172.21.15.17:0/1448132051 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45f01e1c50 con 0x7f45f01527e0 2024-09-05T07:57:24.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.155+0000 7f45e67fc640 1 -- 172.21.15.17:0/1448132051 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec037040 con 0x7f45f01527e0 2024-09-05T07:57:24.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.155+0000 7f45f7e7b640 1 -- 172.21.15.17:0/1448132051 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f45f014bf30 con 0x7f45f01527e0 2024-09-05T07:57:24.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.156+0000 7f45f7e7b640 1 -- 172.21.15.17:0/1448132051 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f45f0068880 con 0x7f45f01527e0 2024-09-05T07:57:24.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.176+0000 7f45e67fc640 1 -- 172.21.15.17:0/1448132051 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f45ec044070 con 0x7f45f01527e0 2024-09-05T07:57:24.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.176+0000 7f45e67fc640 1 --2- 172.21.15.17:0/1448132051 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f45d406be80 0x7f45d406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:24.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.176+0000 7f45f5416640 1 --2- 172.21.15.17:0/1448132051 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f45d406be80 0x7f45d406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:24.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.177+0000 7f45f5416640 1 --2- 172.21.15.17:0/1448132051 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f45d406be80 0x7f45d406e340 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f45f0157860 tx=0x7f45e0009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:24.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.179+0000 7f45e67fc640 1 -- 172.21.15.17:0/1448132051 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f45ec078010 con 0x7f45f01527e0 2024-09-05T07:57:24.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.179+0000 7f45e67fc640 1 --2- 172.21.15.17:0/1448132051 >> [v2:172.21.15.26:6818/3020770750,v1:172.21.15.26:6819/3020770750] conn(0x7f45d40740e0 0x7f45d4076500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:24.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.179+0000 7f45e67fc640 1 -- 172.21.15.17:0/1448132051 --> [v2:172.21.15.26:6818/3020770750,v1:172.21.15.26:6819/3020770750] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f45d4076bd0 con 0x7f45d40740e0 2024-09-05T07:57:24.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.179+0000 7f45f6418640 1 --2- 172.21.15.17:0/1448132051 >> [v2:172.21.15.26:6818/3020770750,v1:172.21.15.26:6819/3020770750] conn(0x7f45d40740e0 0x7f45d4076500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:24.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.179+0000 7f45f6418640 1 --2- 172.21.15.17:0/1448132051 >> [v2:172.21.15.26:6818/3020770750,v1:172.21.15.26:6819/3020770750] conn(0x7f45d40740e0 0x7f45d4076500 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:24.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.180+0000 7f45e67fc640 1 -- 172.21.15.17:0/1448132051 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f45ec076210 con 0x7f45f01527e0 2024-09-05T07:57:24.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.180+0000 7f45e67fc640 1 -- 172.21.15.17:0/1448132051 <== osd.5 v2:172.21.15.26:6818/3020770750 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f45d4076bd0 con 0x7f45d40740e0 2024-09-05T07:57:24.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.193+0000 7f45f7e7b640 1 -- 172.21.15.17:0/1448132051 --> [v2:172.21.15.26:6818/3020770750,v1:172.21.15.26:6819/3020770750] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f45f00c98c0 con 0x7f45d40740e0 2024-09-05T07:57:24.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.193+0000 7f45e67fc640 1 -- 172.21.15.17:0/1448132051 <== osd.5 v2:172.21.15.26:6818/3020770750 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f45f00c98c0 con 0x7f45d40740e0 2024-09-05T07:57:24.194 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-05T07:57:24.194 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-05T07:57:24.194 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-05T07:57:24.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.193+0000 7f45f7e7b640 1 -- 172.21.15.17:0/1448132051 >> [v2:172.21.15.26:6818/3020770750,v1:172.21.15.26:6819/3020770750] conn(0x7f45d40740e0 msgr2=0x7f45d4076500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:24.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.193+0000 7f45f7e7b640 1 --2- 172.21.15.17:0/1448132051 >> [v2:172.21.15.26:6818/3020770750,v1:172.21.15.26:6819/3020770750] conn(0x7f45d40740e0 0x7f45d4076500 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:24.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.193+0000 7f45f7e7b640 1 -- 172.21.15.17:0/1448132051 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f45d406be80 msgr2=0x7f45d406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:24.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.193+0000 7f45f7e7b640 1 --2- 172.21.15.17:0/1448132051 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f45d406be80 0x7f45d406e340 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f45f0157860 tx=0x7f45e0009190 comp rx=0 tx=0).stop 2024-09-05T07:57:24.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.193+0000 7f45f7e7b640 1 -- 172.21.15.17:0/1448132051 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45f01527e0 msgr2=0x7f45f014da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:24.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.193+0000 7f45f7e7b640 1 --2- 172.21.15.17:0/1448132051 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f45f01527e0 0x7f45f014da50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f45f00c95b0 tx=0x7f45ec0046c0 comp rx=0 tx=0).stop 2024-09-05T07:57:24.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.193+0000 7f45f6418640 1 -- 172.21.15.17:0/1448132051 reap_dead start 2024-09-05T07:57:24.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.194+0000 7f45f7e7b640 1 -- 172.21.15.17:0/1448132051 shutdown_connections 2024-09-05T07:57:24.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.194+0000 7f45f7e7b640 1 -- 172.21.15.17:0/1448132051 >> 172.21.15.17:0/1448132051 conn(0x7f45f00ce140 msgr2=0x7f45f006eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:24.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.194+0000 7f45f7e7b640 1 -- 172.21.15.17:0/1448132051 shutdown_connections 2024-09-05T07:57:24.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.194+0000 7f45f7e7b640 1 -- 172.21.15.17:0/1448132051 wait complete. 2024-09-05T07:57:24.205 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-05T07:57:24.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.308+0000 7ff015b49640 1 Processor -- start 2024-09-05T07:57:24.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.308+0000 7ff015b49640 1 -- start start 2024-09-05T07:57:24.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.309+0000 7ff015b49640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff01006be80 0x7ff010071160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:24.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.309+0000 7ff015b49640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff0100c90a0 0x7ff0101582c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:24.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.309+0000 7ff015b49640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff01015acb0 con 0x7ff01006c260 2024-09-05T07:57:24.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.309+0000 7ff015b49640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7ff01015b5a0 con 0x7ff0100c90a0 2024-09-05T07:57:24.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.309+0000 7ff015b49640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7ff0100c9cb0 con 0x7ff01006be80 2024-09-05T07:57:24.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.353+0000 7ff00ffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff0100c90a0 0x7ff0101582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:24.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.354+0000 7ff00ffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff0100c90a0 0x7ff0101582c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51840/0 (socket says 172.21.15.17:51840) 2024-09-05T07:57:24.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.354+0000 7ff00ffff640 1 -- 172.21.15.17:0/724337791 learned_addr learned my addr 172.21.15.17:0/724337791 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:24.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.358+0000 7ff00ffff640 1 -- 172.21.15.17:0/724337791 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff01006be80 msgr2=0x7ff010071160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:57:24.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.358+0000 7ff00ffff640 1 --2- 172.21.15.17:0/724337791 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff01006be80 0x7ff010071160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:24.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.358+0000 7ff00ffff640 1 -- 172.21.15.17:0/724337791 >> v1:172.21.15.17:6789/0 conn(0x7ff01006c260 legacy=0x7ff010157bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:24.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.358+0000 7ff00ffff640 1 -- 172.21.15.17:0/724337791 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff01015af50 con 0x7ff0100c90a0 2024-09-05T07:57:24.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.363+0000 7ff00ffff640 1 --2- 172.21.15.17:0/724337791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0100c90a0 0x7ff0101582c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff008009e50 tx=0x7ff00802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a7f4e092df191e server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:24.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.367+0000 7ff00e7fc640 1 -- 172.21.15.17:0/724337791 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff008036070 con 0x7ff0100c90a0 2024-09-05T07:57:24.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.367+0000 7ff00e7fc640 1 -- 172.21.15.17:0/724337791 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff008031600 con 0x7ff0100c90a0 2024-09-05T07:57:24.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.367+0000 7ff00e7fc640 1 -- 172.21.15.17:0/724337791 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0080319d0 con 0x7ff0100c90a0 2024-09-05T07:57:24.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.367+0000 7ff015b49640 1 -- 172.21.15.17:0/724337791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0100c90a0 msgr2=0x7ff0101582c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:24.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.367+0000 7ff015b49640 1 --2- 172.21.15.17:0/724337791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0100c90a0 0x7ff0101582c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff008009e50 tx=0x7ff00802a7a0 comp rx=0 tx=0).stop 2024-09-05T07:57:24.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.368+0000 7ff015b49640 1 -- 172.21.15.17:0/724337791 shutdown_connections 2024-09-05T07:57:24.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.368+0000 7ff015b49640 1 --2- 172.21.15.17:0/724337791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0100c90a0 0x7ff0101582c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:24.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.368+0000 7ff015b49640 1 --2- 172.21.15.17:0/724337791 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff01006be80 0x7ff010071160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:24.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.368+0000 7ff015b49640 1 -- 172.21.15.17:0/724337791 >> 172.21.15.17:0/724337791 conn(0x7ff01006de20 msgr2=0x7ff01006e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:24.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.368+0000 7ff015b49640 1 -- 172.21.15.17:0/724337791 shutdown_connections 2024-09-05T07:57:24.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.368+0000 7ff015b49640 1 -- 172.21.15.17:0/724337791 wait complete. 2024-09-05T07:57:24.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.369+0000 7ff015b49640 1 Processor -- start 2024-09-05T07:57:24.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.369+0000 7ff015b49640 1 -- start start 2024-09-05T07:57:24.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.370+0000 7ff015b49640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff01006be80 0x7ff0100cd890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:24.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.370+0000 7ff015b49640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff01006c260 0x7ff0101f0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:24.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.370+0000 7ff015b49640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0100c90a0 0x7ff0101542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:24.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.370+0000 7ff015b49640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff01006c730 con 0x7ff0100c90a0 2024-09-05T07:57:24.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.370+0000 7ff015b49640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ff0100c9f90 con 0x7ff01006c260 2024-09-05T07:57:24.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.370+0000 7ff015b49640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7ff01015ba30 con 0x7ff01006be80 2024-09-05T07:57:24.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.371+0000 7ff00ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0100c90a0 0x7ff0101542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:24.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.371+0000 7ff00ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0100c90a0 0x7ff0101542e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51854/0 (socket says 172.21.15.17:51854) 2024-09-05T07:57:24.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.371+0000 7ff00ffff640 1 -- 172.21.15.17:0/3082461511 learned_addr learned my addr 172.21.15.17:0/3082461511 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:24.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.374+0000 7ff00ffff640 1 -- 172.21.15.17:0/3082461511 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff01006be80 msgr2=0x7ff0100cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:24.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.374+0000 7ff00ffff640 1 --2- 172.21.15.17:0/3082461511 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff01006be80 0x7ff0100cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:24.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.374+0000 7ff00ffff640 1 -- 172.21.15.17:0/3082461511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff01006c260 msgr2=0x7ff0101f0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:24.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.374+0000 7ff00ffff640 1 --2- 172.21.15.17:0/3082461511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff01006c260 0x7ff0101f0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:24.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.374+0000 7ff00ffff640 1 -- 172.21.15.17:0/3082461511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff010155700 con 0x7ff0100c90a0 2024-09-05T07:57:24.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.379+0000 7ff00ffff640 1 --2- 172.21.15.17:0/3082461511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0100c90a0 0x7ff0101542e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff008009f70 tx=0x7ff008004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:24.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.381+0000 7feff7fff640 1 -- 172.21.15.17:0/3082461511 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff008036050 con 0x7ff0100c90a0 2024-09-05T07:57:24.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.381+0000 7ff015b49640 1 -- 172.21.15.17:0/3082461511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0101f0490 con 0x7ff0100c90a0 2024-09-05T07:57:24.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.381+0000 7ff015b49640 1 -- 172.21.15.17:0/3082461511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0100cc680 con 0x7ff0100c90a0 2024-09-05T07:57:24.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.382+0000 7ff015b49640 1 -- 172.21.15.17:0/3082461511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff010070490 con 0x7ff0100c90a0 2024-09-05T07:57:24.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.383+0000 7feff7fff640 1 -- 172.21.15.17:0/3082461511 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff008042070 con 0x7ff0100c90a0 2024-09-05T07:57:24.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.383+0000 7feff7fff640 1 -- 172.21.15.17:0/3082461511 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff008009510 con 0x7ff0100c90a0 2024-09-05T07:57:24.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.657+0000 7feff7fff640 1 -- 172.21.15.17:0/3082461511 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff008007b90 con 0x7ff0100c90a0 2024-09-05T07:57:24.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.657+0000 7feff7fff640 1 --2- 172.21.15.17:0/3082461511 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7feffc06be30 0x7feffc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:24.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.658+0000 7ff00f7fe640 1 --2- 172.21.15.17:0/3082461511 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7feffc06be30 0x7feffc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:24.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.658+0000 7ff00f7fe640 1 --2- 172.21.15.17:0/3082461511 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7feffc06be30 0x7feffc06e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff000009710 tx=0x7ff000006c90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:24.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.673+0000 7feff7fff640 1 -- 172.21.15.17:0/3082461511 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7ff008078d40 con 0x7ff0100c90a0 2024-09-05T07:57:24.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.673+0000 7feff7fff640 1 -- 172.21.15.17:0/3082461511 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff008045360 con 0x7ff0100c90a0 2024-09-05T07:57:24.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.849+0000 7ff015b49640 1 -- 172.21.15.17:0/3082461511 --> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7ff0101e5d80 con 0x7feffc06be30 2024-09-05T07:57:24.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.850+0000 7feff7fff640 1 -- 172.21.15.17:0/3082461511 <== mgr.4099 v2:172.21.15.26:6800/2736912541 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff0101e5d80 con 0x7feffc06be30 2024-09-05T07:57:24.851 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 5 to deep-scrub 2024-09-05T07:57:24.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.852+0000 7ff015b49640 1 -- 172.21.15.17:0/3082461511 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7feffc06be30 msgr2=0x7feffc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:24.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.852+0000 7ff015b49640 1 --2- 172.21.15.17:0/3082461511 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7feffc06be30 0x7feffc06e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff000009710 tx=0x7ff000006c90 comp rx=0 tx=0).stop 2024-09-05T07:57:24.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.852+0000 7ff015b49640 1 -- 172.21.15.17:0/3082461511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0100c90a0 msgr2=0x7ff0101542e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:24.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.852+0000 7ff015b49640 1 --2- 172.21.15.17:0/3082461511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0100c90a0 0x7ff0101542e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff008009f70 tx=0x7ff008004a40 comp rx=0 tx=0).stop 2024-09-05T07:57:24.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.852+0000 7ff015b49640 1 -- 172.21.15.17:0/3082461511 shutdown_connections 2024-09-05T07:57:24.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.852+0000 7ff015b49640 1 --2- 172.21.15.17:0/3082461511 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7feffc06be30 0x7feffc06e2f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:24.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.852+0000 7ff015b49640 1 --2- 172.21.15.17:0/3082461511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0100c90a0 0x7ff0101542e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:24.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.852+0000 7ff015b49640 1 --2- 172.21.15.17:0/3082461511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff01006c260 0x7ff0101f0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:24.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.852+0000 7ff015b49640 1 --2- 172.21.15.17:0/3082461511 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff01006be80 0x7ff0100cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:24.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.852+0000 7ff015b49640 1 -- 172.21.15.17:0/3082461511 >> 172.21.15.17:0/3082461511 conn(0x7ff01006de20 msgr2=0x7ff0100b3280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:24.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.852+0000 7ff015b49640 1 -- 172.21.15.17:0/3082461511 shutdown_connections 2024-09-05T07:57:24.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.853+0000 7ff015b49640 1 -- 172.21.15.17:0/3082461511 wait complete. 2024-09-05T07:57:24.865 INFO:tasks.ceph:Scrubbing osd.6 2024-09-05T07:57:24.865 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-05T07:57:24.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.968+0000 7f2788542640 1 Processor -- start 2024-09-05T07:57:24.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.968+0000 7f2788542640 1 -- start start 2024-09-05T07:57:24.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.969+0000 7f2788542640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f278015df00 0x7f27800ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:24.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.969+0000 7f2788542640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f278015b470 con 0x7f27800ce5d0 2024-09-05T07:57:24.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.969+0000 7f2788542640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f278015b750 con 0x7f27800c7a80 2024-09-05T07:57:24.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.969+0000 7f2788542640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f27800c3730 con 0x7f278015df00 2024-09-05T07:57:24.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.969+0000 7f2786adf640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f27800ce5d0 0x7f27800c4210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:38294/0 (socket says 172.21.15.17:38294) 2024-09-05T07:57:24.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.969+0000 7f2786adf640 1 -- 172.21.15.17:0/2454415689 learned_addr learned my addr 172.21.15.17:0/2454415689 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:57:24.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.970+0000 7f2785add640 1 --2- 172.21.15.17:0/2454415689 >> v2:172.21.15.26:3300/0 conn(0x7f278015df00 0x7f27800ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:24.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.972+0000 7f27852dc640 1 -- 172.21.15.17:0/2454415689 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 339267715 0 0) 0x7f278015b470 con 0x7f27800ce5d0 2024-09-05T07:57:24.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.972+0000 7f27852dc640 1 -- 172.21.15.17:0/2454415689 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f276c003520 con 0x7f27800ce5d0 2024-09-05T07:57:24.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.973+0000 7f27852dc640 1 -- 172.21.15.17:0/2454415689 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3135328811 0 0) 0x7f278015b750 con 0x7f27800c7a80 2024-09-05T07:57:24.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.973+0000 7f27852dc640 1 -- 172.21.15.17:0/2454415689 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f278015b470 con 0x7f27800c7a80 2024-09-05T07:57:24.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.975+0000 7f2785add640 1 -- 172.21.15.17:0/2454415689 >> v1:172.21.15.26:6789/0 conn(0x7f27800c7a80 legacy=0x7f278015a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:24.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.975+0000 7f2785add640 1 -- 172.21.15.17:0/2454415689 >> v1:172.21.15.17:6789/0 conn(0x7f27800ce5d0 legacy=0x7f27800c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:24.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.975+0000 7f2785add640 1 -- 172.21.15.17:0/2454415689 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27800c3a10 con 0x7f278015df00 2024-09-05T07:57:24.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.978+0000 7f2785add640 1 --2- 172.21.15.17:0/2454415689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f278015df00 0x7f27800ce090 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f27700097d0 tx=0x7f277002a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6ce0b3be7524fc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:24.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.984+0000 7f27852dc640 1 -- 172.21.15.17:0/2454415689 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2770037070 con 0x7f278015df00 2024-09-05T07:57:24.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.984+0000 7f27852dc640 1 -- 172.21.15.17:0/2454415689 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2770032640 con 0x7f278015df00 2024-09-05T07:57:24.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.984+0000 7f27852dc640 1 -- 172.21.15.17:0/2454415689 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2770032a10 con 0x7f278015df00 2024-09-05T07:57:24.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.984+0000 7f2788542640 1 -- 172.21.15.17:0/2454415689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f278015df00 msgr2=0x7f27800ce090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:24.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.984+0000 7f2788542640 1 --2- 172.21.15.17:0/2454415689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f278015df00 0x7f27800ce090 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f27700097d0 tx=0x7f277002a300 comp rx=0 tx=0).stop 2024-09-05T07:57:24.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.984+0000 7f2788542640 1 -- 172.21.15.17:0/2454415689 shutdown_connections 2024-09-05T07:57:24.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.984+0000 7f2788542640 1 --2- 172.21.15.17:0/2454415689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f278015df00 0x7f27800ce090 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:24.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.984+0000 7f2788542640 1 -- 172.21.15.17:0/2454415689 >> 172.21.15.17:0/2454415689 conn(0x7f278006fbd0 msgr2=0x7f2780067950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:24.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.985+0000 7f2788542640 1 -- 172.21.15.17:0/2454415689 shutdown_connections 2024-09-05T07:57:24.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.985+0000 7f2788542640 1 -- 172.21.15.17:0/2454415689 wait complete. 2024-09-05T07:57:24.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.986+0000 7f2788542640 1 Processor -- start 2024-09-05T07:57:24.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.986+0000 7f2788542640 1 -- start start 2024-09-05T07:57:24.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.986+0000 7f2788542640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27800c7a80 0x7f2780159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:24.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.986+0000 7f2788542640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27800ce5d0 0x7f27800af9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:24.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.986+0000 7f2788542640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f278015df00 0x7f27801f37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:24.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.986+0000 7f2788542640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f278015b0f0 con 0x7f27800c7a80 2024-09-05T07:57:24.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.986+0000 7f2788542640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f27800c5b10 con 0x7f27800ce5d0 2024-09-05T07:57:24.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.986+0000 7f2788542640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f27800c7e60 con 0x7f278015df00 2024-09-05T07:57:24.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.987+0000 7f27862de640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27800c7a80 0x7f2780159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:24.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.987+0000 7f2785add640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27800ce5d0 0x7f27800af9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:24.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.987+0000 7f2786adf640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f278015df00 0x7f27801f37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:24.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.987+0000 7f27862de640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27800c7a80 0x7f2780159460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51856/0 (socket says 172.21.15.17:51856) 2024-09-05T07:57:24.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.987+0000 7f27862de640 1 -- 172.21.15.17:0/2048178725 learned_addr learned my addr 172.21.15.17:0/2048178725 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:24.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.991+0000 7f27862de640 1 -- 172.21.15.17:0/2048178725 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f278015df00 msgr2=0x7f27801f37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:24.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.991+0000 7f27862de640 1 --2- 172.21.15.17:0/2048178725 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f278015df00 0x7f27801f37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:24.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.991+0000 7f27862de640 1 -- 172.21.15.17:0/2048178725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27800ce5d0 msgr2=0x7f27800af9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:24.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.991+0000 7f27862de640 1 --2- 172.21.15.17:0/2048178725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27800ce5d0 0x7f27800af9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:24.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.991+0000 7f27862de640 1 -- 172.21.15.17:0/2048178725 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27801f3d30 con 0x7f27800c7a80 2024-09-05T07:57:24.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.991+0000 7f2785add640 1 --2- 172.21.15.17:0/2048178725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27800ce5d0 0x7f27800af9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T07:57:24.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.993+0000 7f27862de640 1 --2- 172.21.15.17:0/2048178725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27800c7a80 0x7f2780159460 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f277c00c500 tx=0x7f277c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:24.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.997+0000 7f2776ffd640 1 -- 172.21.15.17:0/2048178725 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c0052d0 con 0x7f27800c7a80 2024-09-05T07:57:24.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.997+0000 7f2776ffd640 1 -- 172.21.15.17:0/2048178725 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f277c005490 con 0x7f27800c7a80 2024-09-05T07:57:24.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.997+0000 7f2776ffd640 1 -- 172.21.15.17:0/2048178725 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c012870 con 0x7f27800c7a80 2024-09-05T07:57:24.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.997+0000 7f2788542640 1 -- 172.21.15.17:0/2048178725 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f278015aae0 con 0x7f27800c7a80 2024-09-05T07:57:24.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.997+0000 7f2788542640 1 -- 172.21.15.17:0/2048178725 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27800c6fb0 con 0x7f27800c7a80 2024-09-05T07:57:24.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:24.998+0000 7f2788542640 1 -- 172.21.15.17:0/2048178725 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f27800ce090 con 0x7f27800c7a80 2024-09-05T07:57:25.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.018+0000 7f2776ffd640 1 -- 172.21.15.17:0/2048178725 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f277c012a10 con 0x7f27800c7a80 2024-09-05T07:57:25.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.018+0000 7f2776ffd640 1 --2- 172.21.15.17:0/2048178725 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f276406be80 0x7f276406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:25.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.018+0000 7f2785add640 1 --2- 172.21.15.17:0/2048178725 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f276406be80 0x7f276406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:25.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.019+0000 7f2785add640 1 --2- 172.21.15.17:0/2048178725 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f276406be80 0x7f276406e340 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2770034000 tx=0x7f277002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:25.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.022+0000 7f2776ffd640 1 -- 172.21.15.17:0/2048178725 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f277c057830 con 0x7f27800c7a80 2024-09-05T07:57:25.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.022+0000 7f2776ffd640 1 --2- 172.21.15.17:0/2048178725 >> [v2:172.21.15.26:6810/158775588,v1:172.21.15.26:6811/158775588] conn(0x7f27640740e0 0x7f2764076500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:25.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.022+0000 7f2776ffd640 1 -- 172.21.15.17:0/2048178725 --> [v2:172.21.15.26:6810/158775588,v1:172.21.15.26:6811/158775588] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2764076bd0 con 0x7f27640740e0 2024-09-05T07:57:25.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.022+0000 7f2776ffd640 1 -- 172.21.15.17:0/2048178725 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f277c055a30 con 0x7f27800c7a80 2024-09-05T07:57:25.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.022+0000 7f2786adf640 1 --2- 172.21.15.17:0/2048178725 >> [v2:172.21.15.26:6810/158775588,v1:172.21.15.26:6811/158775588] conn(0x7f27640740e0 0x7f2764076500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:25.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.023+0000 7f2786adf640 1 --2- 172.21.15.17:0/2048178725 >> [v2:172.21.15.26:6810/158775588,v1:172.21.15.26:6811/158775588] conn(0x7f27640740e0 0x7f2764076500 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:25.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.023+0000 7f2776ffd640 1 -- 172.21.15.17:0/2048178725 <== osd.6 v2:172.21.15.26:6810/158775588 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2764076bd0 con 0x7f27640740e0 2024-09-05T07:57:25.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.036+0000 7f2788542640 1 -- 172.21.15.17:0/2048178725 --> [v2:172.21.15.26:6810/158775588,v1:172.21.15.26:6811/158775588] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f278015b750 con 0x7f27640740e0 2024-09-05T07:57:25.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.036+0000 7f2776ffd640 1 -- 172.21.15.17:0/2048178725 <== osd.6 v2:172.21.15.26:6810/158775588 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f278015b750 con 0x7f27640740e0 2024-09-05T07:57:25.037 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-05T07:57:25.037 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-05T07:57:25.037 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-05T07:57:25.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.037+0000 7f2788542640 1 -- 172.21.15.17:0/2048178725 >> [v2:172.21.15.26:6810/158775588,v1:172.21.15.26:6811/158775588] conn(0x7f27640740e0 msgr2=0x7f2764076500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:25.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.037+0000 7f2788542640 1 --2- 172.21.15.17:0/2048178725 >> [v2:172.21.15.26:6810/158775588,v1:172.21.15.26:6811/158775588] conn(0x7f27640740e0 0x7f2764076500 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:25.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.037+0000 7f2788542640 1 -- 172.21.15.17:0/2048178725 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f276406be80 msgr2=0x7f276406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:25.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.037+0000 7f2788542640 1 --2- 172.21.15.17:0/2048178725 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f276406be80 0x7f276406e340 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2770034000 tx=0x7f277002e000 comp rx=0 tx=0).stop 2024-09-05T07:57:25.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.037+0000 7f2788542640 1 -- 172.21.15.17:0/2048178725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27800c7a80 msgr2=0x7f2780159460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:25.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.037+0000 7f2788542640 1 --2- 172.21.15.17:0/2048178725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27800c7a80 0x7f2780159460 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f277c00c500 tx=0x7f277c00c9c0 comp rx=0 tx=0).stop 2024-09-05T07:57:25.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.037+0000 7f2786adf640 1 -- 172.21.15.17:0/2048178725 reap_dead start 2024-09-05T07:57:25.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.037+0000 7f2788542640 1 -- 172.21.15.17:0/2048178725 shutdown_connections 2024-09-05T07:57:25.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.037+0000 7f2788542640 1 -- 172.21.15.17:0/2048178725 >> 172.21.15.17:0/2048178725 conn(0x7f278006fbd0 msgr2=0x7f27800cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:25.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.037+0000 7f2788542640 1 -- 172.21.15.17:0/2048178725 shutdown_connections 2024-09-05T07:57:25.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.037+0000 7f2788542640 1 -- 172.21.15.17:0/2048178725 wait complete. 2024-09-05T07:57:25.048 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-05T07:57:25.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.149+0000 7fbe2ba7b640 1 Processor -- start 2024-09-05T07:57:25.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.149+0000 7fbe2ba7b640 1 -- start start 2024-09-05T07:57:25.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.150+0000 7fbe2ba7b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbe240d07a0 0x7fbe240cb870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:25.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.150+0000 7fbe2ba7b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbe240d0b80 0x7fbe241546a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:25.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.150+0000 7fbe2ba7b640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe240cbdb0 con 0x7fbe240cabb0 2024-09-05T07:57:25.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.150+0000 7fbe2ba7b640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fbe240cb160 con 0x7fbe240d0b80 2024-09-05T07:57:25.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.150+0000 7fbe2ba7b640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fbe2415a9a0 con 0x7fbe240d07a0 2024-09-05T07:57:25.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.150+0000 7fbe29016640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbe240d0b80 0x7fbe241546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:25.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.150+0000 7fbe29817640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbe240d07a0 0x7fbe240cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:25.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.151+0000 7fbe29817640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbe240d07a0 0x7fbe240cb870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:58522/0 (socket says 172.21.15.17:58522) 2024-09-05T07:57:25.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.151+0000 7fbe29817640 1 -- 172.21.15.17:0/2461082691 learned_addr learned my addr 172.21.15.17:0/2461082691 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:25.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.153+0000 7fbe29817640 1 -- 172.21.15.17:0/2461082691 >> v2:172.21.15.17:3300/0 conn(0x7fbe240d0b80 msgr2=0x7fbe241546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:57:25.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.153+0000 7fbe29817640 1 --2- 172.21.15.17:0/2461082691 >> v2:172.21.15.17:3300/0 conn(0x7fbe240d0b80 0x7fbe241546a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:25.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.153+0000 7fbe29817640 1 -- 172.21.15.17:0/2461082691 >> v1:172.21.15.17:6789/0 conn(0x7fbe240cabb0 legacy=0x7fbe2415de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:25.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.153+0000 7fbe29817640 1 -- 172.21.15.17:0/2461082691 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe2415ac80 con 0x7fbe240d07a0 2024-09-05T07:57:25.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.155+0000 7fbe29817640 1 --2- 172.21.15.17:0/2461082691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe240d07a0 0x7fbe240cb870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbe240cb2e0 tx=0x7fbe2002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3ee0e4fb4268d6a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:25.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.159+0000 7fbe28815640 1 -- 172.21.15.17:0/2461082691 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe20037070 con 0x7fbe240d07a0 2024-09-05T07:57:25.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.159+0000 7fbe28815640 1 -- 172.21.15.17:0/2461082691 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe20032440 con 0x7fbe240d07a0 2024-09-05T07:57:25.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.159+0000 7fbe28815640 1 -- 172.21.15.17:0/2461082691 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe20032810 con 0x7fbe240d07a0 2024-09-05T07:57:25.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.159+0000 7fbe2ba7b640 1 -- 172.21.15.17:0/2461082691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe240d07a0 msgr2=0x7fbe240cb870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:25.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.159+0000 7fbe2ba7b640 1 --2- 172.21.15.17:0/2461082691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe240d07a0 0x7fbe240cb870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbe240cb2e0 tx=0x7fbe2002a270 comp rx=0 tx=0).stop 2024-09-05T07:57:25.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.159+0000 7fbe2ba7b640 1 -- 172.21.15.17:0/2461082691 shutdown_connections 2024-09-05T07:57:25.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.159+0000 7fbe2ba7b640 1 --2- 172.21.15.17:0/2461082691 >> v2:172.21.15.17:3300/0 conn(0x7fbe240d0b80 0x7fbe241546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:25.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.159+0000 7fbe2ba7b640 1 --2- 172.21.15.17:0/2461082691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe240d07a0 0x7fbe240cb870 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:25.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.159+0000 7fbe2ba7b640 1 -- 172.21.15.17:0/2461082691 >> 172.21.15.17:0/2461082691 conn(0x7fbe24073710 msgr2=0x7fbe24073b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:25.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.159+0000 7fbe2ba7b640 1 -- 172.21.15.17:0/2461082691 shutdown_connections 2024-09-05T07:57:25.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.159+0000 7fbe2ba7b640 1 -- 172.21.15.17:0/2461082691 wait complete. 2024-09-05T07:57:25.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.161+0000 7fbe2ba7b640 1 Processor -- start 2024-09-05T07:57:25.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.161+0000 7fbe2ba7b640 1 -- start start 2024-09-05T07:57:25.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.161+0000 7fbe2ba7b640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbe240cabb0 0x7fbe2414df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:25.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.161+0000 7fbe2ba7b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe240d07a0 0x7fbe2415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:25.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.161+0000 7fbe2ba7b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe240d0b80 0x7fbe2415cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:25.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.161+0000 7fbe2ba7b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbe2406c9b0 con 0x7fbe240d07a0 2024-09-05T07:57:25.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.162+0000 7fbe2ba7b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fbe2415b240 con 0x7fbe240d0b80 2024-09-05T07:57:25.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.162+0000 7fbe2ba7b640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fbe2406cb30 con 0x7fbe240cabb0 2024-09-05T07:57:25.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.162+0000 7fbe2a018640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe240d0b80 0x7fbe2415cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:25.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.162+0000 7fbe29016640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe240d07a0 0x7fbe2415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:25.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.162+0000 7fbe29817640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbe240cabb0 0x7fbe2414df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:25.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.162+0000 7fbe2a018640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe240d0b80 0x7fbe2415cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:58530/0 (socket says 172.21.15.17:58530) 2024-09-05T07:57:25.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.162+0000 7fbe2a018640 1 -- 172.21.15.17:0/1001882070 learned_addr learned my addr 172.21.15.17:0/1001882070 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:25.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.166+0000 7fbe29016640 1 -- 172.21.15.17:0/1001882070 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbe240cabb0 msgr2=0x7fbe2414df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:25.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.166+0000 7fbe29016640 1 --2- 172.21.15.17:0/1001882070 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbe240cabb0 0x7fbe2414df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:25.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.166+0000 7fbe29016640 1 -- 172.21.15.17:0/1001882070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe240d0b80 msgr2=0x7fbe2415cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:25.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.166+0000 7fbe29016640 1 --2- 172.21.15.17:0/1001882070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe240d0b80 0x7fbe2415cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:25.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.166+0000 7fbe29016640 1 -- 172.21.15.17:0/1001882070 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe24159ec0 con 0x7fbe240d07a0 2024-09-05T07:57:25.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.168+0000 7fbe29016640 1 --2- 172.21.15.17:0/1001882070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe240d07a0 0x7fbe2415c9b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbe1400e820 tx=0x7fbe1400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:25.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.172+0000 7fbe1a7fc640 1 -- 172.21.15.17:0/1001882070 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe14017070 con 0x7fbe240d07a0 2024-09-05T07:57:25.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.172+0000 7fbe1a7fc640 1 -- 172.21.15.17:0/1001882070 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe1400c940 con 0x7fbe240d07a0 2024-09-05T07:57:25.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.172+0000 7fbe1a7fc640 1 -- 172.21.15.17:0/1001882070 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1400cd30 con 0x7fbe240d07a0 2024-09-05T07:57:25.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.172+0000 7fbe2ba7b640 1 -- 172.21.15.17:0/1001882070 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe241f0b40 con 0x7fbe240d07a0 2024-09-05T07:57:25.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.172+0000 7fbe2ba7b640 1 -- 172.21.15.17:0/1001882070 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe241f10c0 con 0x7fbe240d07a0 2024-09-05T07:57:25.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.173+0000 7fbe2ba7b640 1 -- 172.21.15.17:0/1001882070 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe240cb870 con 0x7fbe240d07a0 2024-09-05T07:57:25.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.447+0000 7fbe1a7fc640 1 -- 172.21.15.17:0/1001882070 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbe1401a070 con 0x7fbe240d07a0 2024-09-05T07:57:25.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.448+0000 7fbe1a7fc640 1 --2- 172.21.15.17:0/1001882070 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fbe0806beb0 0x7fbe0806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:25.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.448+0000 7fbe29817640 1 --2- 172.21.15.17:0/1001882070 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fbe0806beb0 0x7fbe0806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:25.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.448+0000 7fbe29817640 1 --2- 172.21.15.17:0/1001882070 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fbe0806beb0 0x7fbe0806e370 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbe20034000 tx=0x7fbe2002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:25.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.462+0000 7fbe1a7fc640 1 -- 172.21.15.17:0/1001882070 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7fbe14057890 con 0x7fbe240d07a0 2024-09-05T07:57:25.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.462+0000 7fbe1a7fc640 1 -- 172.21.15.17:0/1001882070 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbe140597f0 con 0x7fbe240d07a0 2024-09-05T07:57:25.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.646+0000 7fbe2ba7b640 1 -- 172.21.15.17:0/1001882070 --> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fbe240c51f0 con 0x7fbe0806beb0 2024-09-05T07:57:25.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.647+0000 7fbe1a7fc640 1 -- 172.21.15.17:0/1001882070 <== mgr.4099 v2:172.21.15.26:6800/2736912541 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbe240c51f0 con 0x7fbe0806beb0 2024-09-05T07:57:25.648 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 6 to deep-scrub 2024-09-05T07:57:25.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.649+0000 7fbe2ba7b640 1 -- 172.21.15.17:0/1001882070 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fbe0806beb0 msgr2=0x7fbe0806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:25.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.649+0000 7fbe2ba7b640 1 --2- 172.21.15.17:0/1001882070 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fbe0806beb0 0x7fbe0806e370 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbe20034000 tx=0x7fbe2002e000 comp rx=0 tx=0).stop 2024-09-05T07:57:25.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.649+0000 7fbe2ba7b640 1 -- 172.21.15.17:0/1001882070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe240d07a0 msgr2=0x7fbe2415c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:25.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.649+0000 7fbe2ba7b640 1 --2- 172.21.15.17:0/1001882070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe240d07a0 0x7fbe2415c9b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbe1400e820 tx=0x7fbe1400ece0 comp rx=0 tx=0).stop 2024-09-05T07:57:25.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.649+0000 7fbe2ba7b640 1 -- 172.21.15.17:0/1001882070 shutdown_connections 2024-09-05T07:57:25.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.649+0000 7fbe2ba7b640 1 --2- 172.21.15.17:0/1001882070 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fbe0806beb0 0x7fbe0806e370 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:25.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.649+0000 7fbe2ba7b640 1 --2- 172.21.15.17:0/1001882070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe240d0b80 0x7fbe2415cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:25.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.649+0000 7fbe2ba7b640 1 --2- 172.21.15.17:0/1001882070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe240d07a0 0x7fbe2415c9b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:25.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.649+0000 7fbe2ba7b640 1 --2- 172.21.15.17:0/1001882070 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbe240cabb0 0x7fbe2414df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:25.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.649+0000 7fbe2ba7b640 1 -- 172.21.15.17:0/1001882070 >> 172.21.15.17:0/1001882070 conn(0x7fbe24073710 msgr2=0x7fbe24073af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:25.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.649+0000 7fbe2ba7b640 1 -- 172.21.15.17:0/1001882070 shutdown_connections 2024-09-05T07:57:25.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.649+0000 7fbe2ba7b640 1 -- 172.21.15.17:0/1001882070 wait complete. 2024-09-05T07:57:25.661 INFO:tasks.ceph:Scrubbing osd.7 2024-09-05T07:57:25.661 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-05T07:57:25.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.764+0000 7fc37fcaf640 1 Processor -- start 2024-09-05T07:57:25.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.764+0000 7fc37fcaf640 1 -- start start 2024-09-05T07:57:25.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.765+0000 7fc37fcaf640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc3780ccef0 0x7fc3780b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:25.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.765+0000 7fc37fcaf640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc3780cd2d0 0x7fc378157f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:25.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.765+0000 7fc37fcaf640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3780b3b20 con 0x7fc3780b43b0 2024-09-05T07:57:25.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.765+0000 7fc37fcaf640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fc37815b590 con 0x7fc3780ccef0 2024-09-05T07:57:25.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.765+0000 7fc37fcaf640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fc3780b2d60 con 0x7fc3780cd2d0 2024-09-05T07:57:25.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.765+0000 7fc37da4b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc3780ccef0 0x7fc3780b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:25.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.765+0000 7fc37e24c640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc3780cd2d0 0x7fc378157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:25.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.766+0000 7fc37da4b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc3780ccef0 0x7fc3780b3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51876/0 (socket says 172.21.15.17:51876) 2024-09-05T07:57:25.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.766+0000 7fc37da4b640 1 -- 172.21.15.17:0/667911147 learned_addr learned my addr 172.21.15.17:0/667911147 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:25.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.768+0000 7fc37e24c640 1 -- 172.21.15.17:0/667911147 >> v2:172.21.15.17:3300/0 conn(0x7fc3780ccef0 msgr2=0x7fc3780b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:57:25.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.768+0000 7fc37e24c640 1 --2- 172.21.15.17:0/667911147 >> v2:172.21.15.17:3300/0 conn(0x7fc3780ccef0 0x7fc3780b3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:25.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.768+0000 7fc37e24c640 1 -- 172.21.15.17:0/667911147 >> v1:172.21.15.17:6789/0 conn(0x7fc3780b43b0 legacy=0x7fc378157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:25.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.768+0000 7fc37e24c640 1 -- 172.21.15.17:0/667911147 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3780b3040 con 0x7fc3780cd2d0 2024-09-05T07:57:25.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.770+0000 7fc37e24c640 1 --2- 172.21.15.17:0/667911147 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc3780cd2d0 0x7fc378157f10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc3700097d0 tx=0x7fc37002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9079cf5618515099 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:25.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.774+0000 7fc37ca49640 1 -- 172.21.15.17:0/667911147 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc370037070 con 0x7fc3780cd2d0 2024-09-05T07:57:25.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.774+0000 7fc37ca49640 1 -- 172.21.15.17:0/667911147 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc370032440 con 0x7fc3780cd2d0 2024-09-05T07:57:25.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.774+0000 7fc37ca49640 1 -- 172.21.15.17:0/667911147 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc370032810 con 0x7fc3780cd2d0 2024-09-05T07:57:25.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.775+0000 7fc37fcaf640 1 -- 172.21.15.17:0/667911147 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc3780cd2d0 msgr2=0x7fc378157f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:25.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.775+0000 7fc37fcaf640 1 --2- 172.21.15.17:0/667911147 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc3780cd2d0 0x7fc378157f10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc3700097d0 tx=0x7fc37002a1c0 comp rx=0 tx=0).stop 2024-09-05T07:57:25.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.775+0000 7fc37fcaf640 1 -- 172.21.15.17:0/667911147 shutdown_connections 2024-09-05T07:57:25.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.775+0000 7fc37fcaf640 1 --2- 172.21.15.17:0/667911147 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc3780cd2d0 0x7fc378157f10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:25.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.775+0000 7fc37fcaf640 1 --2- 172.21.15.17:0/667911147 >> v2:172.21.15.17:3300/0 conn(0x7fc3780ccef0 0x7fc3780b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:25.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.775+0000 7fc37fcaf640 1 -- 172.21.15.17:0/667911147 >> 172.21.15.17:0/667911147 conn(0x7fc378072230 msgr2=0x7fc378072640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:25.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.775+0000 7fc37fcaf640 1 -- 172.21.15.17:0/667911147 shutdown_connections 2024-09-05T07:57:25.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.775+0000 7fc37fcaf640 1 -- 172.21.15.17:0/667911147 wait complete. 2024-09-05T07:57:25.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.776+0000 7fc37fcaf640 1 Processor -- start 2024-09-05T07:57:25.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.776+0000 7fc37fcaf640 1 -- start start 2024-09-05T07:57:25.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.777+0000 7fc37fcaf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3780b43b0 0x7fc37815a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:25.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.777+0000 7fc37fcaf640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc3780ccef0 0x7fc378155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:25.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.777+0000 7fc37fcaf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3780cd2d0 0x7fc37815cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:25.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.777+0000 7fc37fcaf640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc37815dee0 con 0x7fc3780cd2d0 2024-09-05T07:57:25.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.777+0000 7fc37fcaf640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc3780b3600 con 0x7fc3780b43b0 2024-09-05T07:57:25.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.777+0000 7fc37fcaf640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fc37815e060 con 0x7fc3780ccef0 2024-09-05T07:57:25.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.777+0000 7fc37e24c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3780cd2d0 0x7fc37815cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:25.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.778+0000 7fc37d24a640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc3780ccef0 0x7fc378155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:25.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.778+0000 7fc37da4b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3780b43b0 0x7fc37815a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:25.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.778+0000 7fc37e24c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3780cd2d0 0x7fc37815cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51882/0 (socket says 172.21.15.17:51882) 2024-09-05T07:57:25.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.778+0000 7fc37e24c640 1 -- 172.21.15.17:0/2442444718 learned_addr learned my addr 172.21.15.17:0/2442444718 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:25.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.781+0000 7fc37e24c640 1 -- 172.21.15.17:0/2442444718 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc3780ccef0 msgr2=0x7fc378155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:25.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.781+0000 7fc37e24c640 1 --2- 172.21.15.17:0/2442444718 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc3780ccef0 0x7fc378155900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:25.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.781+0000 7fc37e24c640 1 -- 172.21.15.17:0/2442444718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3780b43b0 msgr2=0x7fc37815a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:25.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.781+0000 7fc37e24c640 1 --2- 172.21.15.17:0/2442444718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc3780b43b0 0x7fc37815a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:25.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.781+0000 7fc37e24c640 1 -- 172.21.15.17:0/2442444718 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3780c83a0 con 0x7fc3780cd2d0 2024-09-05T07:57:25.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.784+0000 7fc37e24c640 1 --2- 172.21.15.17:0/2442444718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3780cd2d0 0x7fc37815cb00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc3700098f0 tx=0x7fc3700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:25.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.790+0000 7fc36e7fc640 1 -- 172.21.15.17:0/2442444718 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc370037050 con 0x7fc3780cd2d0 2024-09-05T07:57:25.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.790+0000 7fc36e7fc640 1 -- 172.21.15.17:0/2442444718 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc370038040 con 0x7fc3780cd2d0 2024-09-05T07:57:25.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.790+0000 7fc37fcaf640 1 -- 172.21.15.17:0/2442444718 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3781f0b60 con 0x7fc3780cd2d0 2024-09-05T07:57:25.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.790+0000 7fc36e7fc640 1 -- 172.21.15.17:0/2442444718 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37003cb50 con 0x7fc3780cd2d0 2024-09-05T07:57:25.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.790+0000 7fc37fcaf640 1 -- 172.21.15.17:0/2442444718 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3781f1120 con 0x7fc3780cd2d0 2024-09-05T07:57:25.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.791+0000 7fc37fcaf640 1 -- 172.21.15.17:0/2442444718 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc378069220 con 0x7fc3780cd2d0 2024-09-05T07:57:25.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.814+0000 7fc36e7fc640 1 -- 172.21.15.17:0/2442444718 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc37003ccf0 con 0x7fc3780cd2d0 2024-09-05T07:57:25.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.815+0000 7fc36e7fc640 1 --2- 172.21.15.17:0/2442444718 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc35c06be30 0x7fc35c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:25.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.816+0000 7fc37da4b640 1 --2- 172.21.15.17:0/2442444718 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc35c06be30 0x7fc35c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:25.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.816+0000 7fc37da4b640 1 --2- 172.21.15.17:0/2442444718 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc35c06be30 0x7fc35c06e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc374011340 tx=0x7fc37400b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:25.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.819+0000 7fc36e7fc640 1 -- 172.21.15.17:0/2442444718 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7fc370078710 con 0x7fc3780cd2d0 2024-09-05T07:57:25.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.819+0000 7fc36e7fc640 1 --2- 172.21.15.17:0/2442444718 >> [v2:172.21.15.26:6826/4176189153,v1:172.21.15.26:6827/4176189153] conn(0x7fc35c074090 0x7fc35c0764b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:25.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.819+0000 7fc36e7fc640 1 -- 172.21.15.17:0/2442444718 --> [v2:172.21.15.26:6826/4176189153,v1:172.21.15.26:6827/4176189153] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc370001d30 con 0x7fc35c074090 2024-09-05T07:57:25.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.819+0000 7fc36e7fc640 1 -- 172.21.15.17:0/2442444718 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc370076910 con 0x7fc3780cd2d0 2024-09-05T07:57:25.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.819+0000 7fc37d24a640 1 --2- 172.21.15.17:0/2442444718 >> [v2:172.21.15.26:6826/4176189153,v1:172.21.15.26:6827/4176189153] conn(0x7fc35c074090 0x7fc35c0764b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:25.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.820+0000 7fc37d24a640 1 --2- 172.21.15.17:0/2442444718 >> [v2:172.21.15.26:6826/4176189153,v1:172.21.15.26:6827/4176189153] conn(0x7fc35c074090 0x7fc35c0764b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:25.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.820+0000 7fc36e7fc640 1 -- 172.21.15.17:0/2442444718 <== osd.7 v2:172.21.15.26:6826/4176189153 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc370001d30 con 0x7fc35c074090 2024-09-05T07:57:25.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.833+0000 7fc37fcaf640 1 -- 172.21.15.17:0/2442444718 --> [v2:172.21.15.26:6826/4176189153,v1:172.21.15.26:6827/4176189153] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc3780b3e70 con 0x7fc35c074090 2024-09-05T07:57:25.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.834+0000 7fc36e7fc640 1 -- 172.21.15.17:0/2442444718 <== osd.7 v2:172.21.15.26:6826/4176189153 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc3780b3e70 con 0x7fc35c074090 2024-09-05T07:57:25.835 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-05T07:57:25.835 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-05T07:57:25.835 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-05T07:57:25.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.834+0000 7fc37fcaf640 1 -- 172.21.15.17:0/2442444718 >> [v2:172.21.15.26:6826/4176189153,v1:172.21.15.26:6827/4176189153] conn(0x7fc35c074090 msgr2=0x7fc35c0764b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:25.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.834+0000 7fc37fcaf640 1 --2- 172.21.15.17:0/2442444718 >> [v2:172.21.15.26:6826/4176189153,v1:172.21.15.26:6827/4176189153] conn(0x7fc35c074090 0x7fc35c0764b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:25.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.834+0000 7fc37fcaf640 1 -- 172.21.15.17:0/2442444718 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc35c06be30 msgr2=0x7fc35c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:25.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.834+0000 7fc37fcaf640 1 --2- 172.21.15.17:0/2442444718 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc35c06be30 0x7fc35c06e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc374011340 tx=0x7fc37400b040 comp rx=0 tx=0).stop 2024-09-05T07:57:25.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.834+0000 7fc37fcaf640 1 -- 172.21.15.17:0/2442444718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3780cd2d0 msgr2=0x7fc37815cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:25.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.834+0000 7fc37fcaf640 1 --2- 172.21.15.17:0/2442444718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3780cd2d0 0x7fc37815cb00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc3700098f0 tx=0x7fc3700046c0 comp rx=0 tx=0).stop 2024-09-05T07:57:25.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.834+0000 7fc37e24c640 1 -- 172.21.15.17:0/2442444718 reap_dead start 2024-09-05T07:57:25.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.834+0000 7fc37fcaf640 1 -- 172.21.15.17:0/2442444718 shutdown_connections 2024-09-05T07:57:25.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.834+0000 7fc37fcaf640 1 -- 172.21.15.17:0/2442444718 >> 172.21.15.17:0/2442444718 conn(0x7fc378072230 msgr2=0x7fc3781575d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:25.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.834+0000 7fc37fcaf640 1 -- 172.21.15.17:0/2442444718 shutdown_connections 2024-09-05T07:57:25.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.834+0000 7fc37fcaf640 1 -- 172.21.15.17:0/2442444718 wait complete. 2024-09-05T07:57:25.846 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-05T07:57:25.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.946+0000 7fcb6f50a640 1 Processor -- start 2024-09-05T07:57:25.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.946+0000 7fcb6f50a640 1 -- start start 2024-09-05T07:57:25.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.947+0000 7fcb6f50a640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fcb6815b650 0x7fcb6806c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:25.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.947+0000 7fcb6f50a640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb6815a8f0 con 0x7fcb680cda50 2024-09-05T07:57:25.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.947+0000 7fcb6f50a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb680cae30 con 0x7fcb68154bc0 2024-09-05T07:57:25.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.947+0000 7fcb6f50a640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fcb680cc710 con 0x7fcb6815b650 2024-09-05T07:57:25.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.947+0000 7fcb6d2a6640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fcb68154bc0 0x7fcb6815de60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.17:56610/0 (socket says 172.21.15.17:56610) 2024-09-05T07:57:25.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.948+0000 7fcb6d2a6640 1 -- 172.21.15.17:0/2440534032 learned_addr learned my addr 172.21.15.17:0/2440534032 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:57:25.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.948+0000 7fcb6caa5640 1 --2- 172.21.15.17:0/2440534032 >> v2:172.21.15.17:3300/0 conn(0x7fcb6815b650 0x7fcb6806c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:25.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.950+0000 7fcb5ffff640 1 -- 172.21.15.17:0/2440534032 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3215555465 0 0) 0x7fcb680cae30 con 0x7fcb68154bc0 2024-09-05T07:57:25.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.950+0000 7fcb5ffff640 1 -- 172.21.15.17:0/2440534032 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb54003520 con 0x7fcb68154bc0 2024-09-05T07:57:25.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.951+0000 7fcb6caa5640 1 -- 172.21.15.17:0/2440534032 >> v1:172.21.15.26:6789/0 conn(0x7fcb68154bc0 legacy=0x7fcb6815de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:25.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.951+0000 7fcb6caa5640 1 -- 172.21.15.17:0/2440534032 >> v1:172.21.15.17:6789/0 conn(0x7fcb680cda50 legacy=0x7fcb681651b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:25.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.951+0000 7fcb6caa5640 1 -- 172.21.15.17:0/2440534032 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb680cc9f0 con 0x7fcb6815b650 2024-09-05T07:57:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.956+0000 7fcb6caa5640 1 --2- 172.21.15.17:0/2440534032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb6815b650 0x7fcb6806c140 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcb580097a0 tx=0x7fcb5802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed6423f35d5bc487 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:25.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.960+0000 7fcb5ffff640 1 -- 172.21.15.17:0/2440534032 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb58037070 con 0x7fcb6815b650 2024-09-05T07:57:25.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.960+0000 7fcb5ffff640 1 -- 172.21.15.17:0/2440534032 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb58032440 con 0x7fcb6815b650 2024-09-05T07:57:25.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.960+0000 7fcb5ffff640 1 -- 172.21.15.17:0/2440534032 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb58032810 con 0x7fcb6815b650 2024-09-05T07:57:25.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.960+0000 7fcb6f50a640 1 -- 172.21.15.17:0/2440534032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb6815b650 msgr2=0x7fcb6806c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:25.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.960+0000 7fcb6f50a640 1 --2- 172.21.15.17:0/2440534032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb6815b650 0x7fcb6806c140 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcb580097a0 tx=0x7fcb5802a230 comp rx=0 tx=0).stop 2024-09-05T07:57:25.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.961+0000 7fcb6f50a640 1 -- 172.21.15.17:0/2440534032 shutdown_connections 2024-09-05T07:57:25.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.961+0000 7fcb6f50a640 1 --2- 172.21.15.17:0/2440534032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb6815b650 0x7fcb6806c140 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:25.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.961+0000 7fcb6f50a640 1 -- 172.21.15.17:0/2440534032 >> 172.21.15.17:0/2440534032 conn(0x7fcb680738d0 msgr2=0x7fcb68073ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:25.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.961+0000 7fcb6f50a640 1 -- 172.21.15.17:0/2440534032 shutdown_connections 2024-09-05T07:57:25.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.961+0000 7fcb6f50a640 1 -- 172.21.15.17:0/2440534032 wait complete. 2024-09-05T07:57:25.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.962+0000 7fcb6f50a640 1 Processor -- start 2024-09-05T07:57:25.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.962+0000 7fcb6f50a640 1 -- start start 2024-09-05T07:57:25.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.963+0000 7fcb6f50a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb680cda50 0x7fcb68153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:25.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.963+0000 7fcb6f50a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb68154bc0 0x7fcb681e4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:25.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.963+0000 7fcb6f50a640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb6815b650 0x7fcb681e48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:25.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.963+0000 7fcb6f50a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6815b130 con 0x7fcb68154bc0 2024-09-05T07:57:25.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.963+0000 7fcb6f50a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6815ae50 con 0x7fcb680cda50 2024-09-05T07:57:25.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.963+0000 7fcb6f50a640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fcb68154fa0 con 0x7fcb6815b650 2024-09-05T07:57:25.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.963+0000 7fcb6caa5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb68154bc0 0x7fcb681e4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:25.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.963+0000 7fcb6d2a6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb680cda50 0x7fcb68153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:25.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.963+0000 7fcb6daa7640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb6815b650 0x7fcb681e48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:25.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.963+0000 7fcb6caa5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb68154bc0 0x7fcb681e4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51912/0 (socket says 172.21.15.17:51912) 2024-09-05T07:57:25.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.963+0000 7fcb6caa5640 1 -- 172.21.15.17:0/618617624 learned_addr learned my addr 172.21.15.17:0/618617624 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:25.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.967+0000 7fcb6caa5640 1 -- 172.21.15.17:0/618617624 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb6815b650 msgr2=0x7fcb681e48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:25.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.967+0000 7fcb6caa5640 1 --2- 172.21.15.17:0/618617624 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb6815b650 0x7fcb681e48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:25.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.967+0000 7fcb6caa5640 1 -- 172.21.15.17:0/618617624 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb680cda50 msgr2=0x7fcb68153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:25.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.967+0000 7fcb6caa5640 1 --2- 172.21.15.17:0/618617624 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb680cda50 0x7fcb68153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:25.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.967+0000 7fcb6caa5640 1 -- 172.21.15.17:0/618617624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb681f41f0 con 0x7fcb68154bc0 2024-09-05T07:57:25.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.969+0000 7fcb6caa5640 1 --2- 172.21.15.17:0/618617624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb68154bc0 0x7fcb681e4380 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcb58000c00 tx=0x7fcb580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:25.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.973+0000 7fcb5dffb640 1 -- 172.21.15.17:0/618617624 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb58037040 con 0x7fcb68154bc0 2024-09-05T07:57:25.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.973+0000 7fcb5dffb640 1 -- 172.21.15.17:0/618617624 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb58042070 con 0x7fcb68154bc0 2024-09-05T07:57:25.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.973+0000 7fcb6f50a640 1 -- 172.21.15.17:0/618617624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb681f44d0 con 0x7fcb68154bc0 2024-09-05T07:57:25.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.973+0000 7fcb5dffb640 1 -- 172.21.15.17:0/618617624 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb58030920 con 0x7fcb68154bc0 2024-09-05T07:57:25.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.973+0000 7fcb6f50a640 1 -- 172.21.15.17:0/618617624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb681553d0 con 0x7fcb68154bc0 2024-09-05T07:57:25.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:25.974+0000 7fcb6f50a640 1 -- 172.21.15.17:0/618617624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb680b3cb0 con 0x7fcb68154bc0 2024-09-05T07:57:26.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.247+0000 7fcb5dffb640 1 -- 172.21.15.17:0/618617624 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcb58030ac0 con 0x7fcb68154bc0 2024-09-05T07:57:26.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.247+0000 7fcb5dffb640 1 --2- 172.21.15.17:0/618617624 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fcb4c06be60 0x7fcb4c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:26.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.247+0000 7fcb6d2a6640 1 --2- 172.21.15.17:0/618617624 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fcb4c06be60 0x7fcb4c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:26.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.248+0000 7fcb6d2a6640 1 --2- 172.21.15.17:0/618617624 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fcb4c06be60 0x7fcb4c06e320 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcb640011e0 tx=0x7fcb64007d30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:26.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.262+0000 7fcb5dffb640 1 -- 172.21.15.17:0/618617624 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7fcb58078550 con 0x7fcb68154bc0 2024-09-05T07:57:26.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.262+0000 7fcb5dffb640 1 -- 172.21.15.17:0/618617624 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcb5807a4b0 con 0x7fcb68154bc0 2024-09-05T07:57:26.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.458+0000 7fcb6f50a640 1 -- 172.21.15.17:0/618617624 --> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fcb680caaf0 con 0x7fcb4c06be60 2024-09-05T07:57:26.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.459+0000 7fcb5dffb640 1 -- 172.21.15.17:0/618617624 <== mgr.4099 v2:172.21.15.26:6800/2736912541 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fcb680caaf0 con 0x7fcb4c06be60 2024-09-05T07:57:26.460 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 7 to deep-scrub 2024-09-05T07:57:26.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.461+0000 7fcb6f50a640 1 -- 172.21.15.17:0/618617624 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fcb4c06be60 msgr2=0x7fcb4c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:26.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.462+0000 7fcb6f50a640 1 --2- 172.21.15.17:0/618617624 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fcb4c06be60 0x7fcb4c06e320 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcb640011e0 tx=0x7fcb64007d30 comp rx=0 tx=0).stop 2024-09-05T07:57:26.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.462+0000 7fcb6f50a640 1 -- 172.21.15.17:0/618617624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb68154bc0 msgr2=0x7fcb681e4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:26.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.462+0000 7fcb6f50a640 1 --2- 172.21.15.17:0/618617624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb68154bc0 0x7fcb681e4380 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcb58000c00 tx=0x7fcb580046c0 comp rx=0 tx=0).stop 2024-09-05T07:57:26.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.462+0000 7fcb6f50a640 1 -- 172.21.15.17:0/618617624 shutdown_connections 2024-09-05T07:57:26.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.462+0000 7fcb6f50a640 1 --2- 172.21.15.17:0/618617624 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fcb4c06be60 0x7fcb4c06e320 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:26.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.462+0000 7fcb6f50a640 1 --2- 172.21.15.17:0/618617624 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcb6815b650 0x7fcb681e48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:26.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.462+0000 7fcb6f50a640 1 --2- 172.21.15.17:0/618617624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb68154bc0 0x7fcb681e4380 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:26.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.462+0000 7fcb6f50a640 1 --2- 172.21.15.17:0/618617624 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb680cda50 0x7fcb68153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:26.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.462+0000 7fcb6f50a640 1 -- 172.21.15.17:0/618617624 >> 172.21.15.17:0/618617624 conn(0x7fcb680738d0 msgr2=0x7fcb68158550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:26.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.462+0000 7fcb6f50a640 1 -- 172.21.15.17:0/618617624 shutdown_connections 2024-09-05T07:57:26.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.462+0000 7fcb6f50a640 1 -- 172.21.15.17:0/618617624 wait complete. 2024-09-05T07:57:26.474 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T07:57:26.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.575+0000 7f18d0511640 1 Processor -- start 2024-09-05T07:57:26.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.575+0000 7f18d0511640 1 -- start start 2024-09-05T07:57:26.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.576+0000 7f18d0511640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f18c806ece0 0x7f18c806f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:26.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.576+0000 7f18d0511640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18c815ad90 con 0x7f18c8157840 2024-09-05T07:57:26.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.576+0000 7f18d0511640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18c815b070 con 0x7f18c806e900 2024-09-05T07:57:26.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.576+0000 7f18d0511640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f18c806ffe0 con 0x7f18c806ece0 2024-09-05T07:57:26.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.577+0000 7f18ceaae640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f18c8157840 0x7f18c8157cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:38334/0 (socket says 172.21.15.17:38334) 2024-09-05T07:57:26.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.577+0000 7f18ceaae640 1 -- 172.21.15.17:0/4062832777 learned_addr learned my addr 172.21.15.17:0/4062832777 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:57:26.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.580+0000 7f18cd2ab640 1 -- 172.21.15.17:0/4062832777 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1049625521 0 0) 0x7f18c815ad90 con 0x7f18c8157840 2024-09-05T07:57:26.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.580+0000 7f18cd2ab640 1 -- 172.21.15.17:0/4062832777 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18b4005730 con 0x7f18c8157840 2024-09-05T07:57:26.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.583+0000 7f18cd2ab640 1 -- 172.21.15.17:0/4062832777 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 82356642 0 0) 0x7f18b4005730 con 0x7f18c8157840 2024-09-05T07:57:26.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.583+0000 7f18cd2ab640 1 -- 172.21.15.17:0/4062832777 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f18c806ece0 msgr2=0x7f18c806f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:57:26.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.583+0000 7f18cd2ab640 1 --2- 172.21.15.17:0/4062832777 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f18c806ece0 0x7f18c806f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:26.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.583+0000 7f18cd2ab640 1 -- 172.21.15.17:0/4062832777 >> v1:172.21.15.26:6789/0 conn(0x7f18c806e900 legacy=0x7f18c80c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:57:26.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.583+0000 7f18cd2ab640 1 -- 172.21.15.17:0/4062832777 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c815b350 con 0x7f18c8157840 2024-09-05T07:57:26.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.583+0000 7f18cd2ab640 1 -- 172.21.15.17:0/4062832777 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1460137602 0 0) 0x7f18c00019f0 con 0x7f18c8157840 2024-09-05T07:57:26.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.583+0000 7f18cd2ab640 1 -- 172.21.15.17:0/4062832777 >> v1:172.21.15.17:6789/0 conn(0x7f18c8157840 legacy=0x7f18c8157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:26.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.583+0000 7f18cd2ab640 1 --2- 172.21.15.17:0/4062832777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18b4005bf0 0x7f18b4005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:26.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.583+0000 7f18cd2ab640 1 --2- 172.21.15.17:0/4062832777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18b4006a10 0x7f18b4006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:26.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.583+0000 7f18cd2ab640 1 --2- 172.21.15.17:0/4062832777 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f18c806ece0 0x7f18b400dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:26.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.583+0000 7f18cd2ab640 1 -- 172.21.15.17:0/4062832777 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f18c806ffe0 con 0x7f18b4005bf0 2024-09-05T07:57:26.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.583+0000 7f18cd2ab640 1 -- 172.21.15.17:0/4062832777 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f18b4007730 con 0x7f18b4006a10 2024-09-05T07:57:26.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.583+0000 7f18cd2ab640 1 -- 172.21.15.17:0/4062832777 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f18b400e110 con 0x7f18c806ece0 2024-09-05T07:57:26.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.584+0000 7f18ce2ad640 1 --2- 172.21.15.17:0/4062832777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18b4005bf0 0x7f18b4005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:26.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.587+0000 7f18ceaae640 1 --2- 172.21.15.17:0/4062832777 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f18c806ece0 0x7f18b400dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:26.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.589+0000 7f18ce2ad640 1 -- 172.21.15.17:0/4062832777 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f18c806ece0 msgr2=0x7f18b400dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:57:26.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.589+0000 7f18ce2ad640 1 --2- 172.21.15.17:0/4062832777 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f18c806ece0 0x7f18b400dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:26.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.589+0000 7f18ce2ad640 1 -- 172.21.15.17:0/4062832777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18b4006a10 msgr2=0x7f18b4006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:57:26.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.589+0000 7f18ce2ad640 1 --2- 172.21.15.17:0/4062832777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18b4006a10 0x7f18b4006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:26.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.589+0000 7f18ce2ad640 1 -- 172.21.15.17:0/4062832777 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b4005730 con 0x7f18b4005bf0 2024-09-05T07:57:26.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.591+0000 7f18ce2ad640 1 --2- 172.21.15.17:0/4062832777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18b4005bf0 0x7f18b4005ff0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f18c4003db0 tx=0x7f18b4007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a82b5360c84670c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:26.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.597+0000 7f18cd2ab640 1 -- 172.21.15.17:0/4062832777 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c4037070 con 0x7f18b4005bf0 2024-09-05T07:57:26.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.597+0000 7f18cd2ab640 1 -- 172.21.15.17:0/4062832777 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18c402aa00 con 0x7f18b4005bf0 2024-09-05T07:57:26.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.597+0000 7f18cd2ab640 1 -- 172.21.15.17:0/4062832777 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c4003980 con 0x7f18b4005bf0 2024-09-05T07:57:26.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.597+0000 7f18d0511640 1 -- 172.21.15.17:0/4062832777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18b4005bf0 msgr2=0x7f18b4005ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:26.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.597+0000 7f18d0511640 1 --2- 172.21.15.17:0/4062832777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18b4005bf0 0x7f18b4005ff0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f18c4003db0 tx=0x7f18b4007a40 comp rx=0 tx=0).stop 2024-09-05T07:57:26.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.597+0000 7f18ceaae640 1 -- 172.21.15.17:0/4062832777 reap_dead start 2024-09-05T07:57:26.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.597+0000 7f18d0511640 1 -- 172.21.15.17:0/4062832777 shutdown_connections 2024-09-05T07:57:26.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.597+0000 7f18d0511640 1 -- 172.21.15.17:0/4062832777 >> 172.21.15.17:0/4062832777 conn(0x7f18c80cd440 msgr2=0x7f18c80cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:26.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.598+0000 7f18d0511640 1 -- 172.21.15.17:0/4062832777 shutdown_connections 2024-09-05T07:57:26.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.598+0000 7f18d0511640 1 -- 172.21.15.17:0/4062832777 wait complete. 2024-09-05T07:57:26.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.599+0000 7f18d0511640 1 Processor -- start 2024-09-05T07:57:26.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.599+0000 7f18d0511640 1 -- start start 2024-09-05T07:57:26.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.599+0000 7f18d0511640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18b4005bf0 0x7f18c8153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:26.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.599+0000 7f18d0511640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18c80b19d0 0x7f18c80b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:26.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.599+0000 7f18d0511640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f18c8150680 0x7f18c8150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:26.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.599+0000 7f18d0511640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f18c8072aa0 con 0x7f18b4005bf0 2024-09-05T07:57:26.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.599+0000 7f18d0511640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f18c815b910 con 0x7f18c80b19d0 2024-09-05T07:57:26.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.599+0000 7f18d0511640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f18c806f8c0 con 0x7f18c8150680 2024-09-05T07:57:26.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.600+0000 7f18ceaae640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f18c8150680 0x7f18c8150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:26.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.600+0000 7f18cdaac640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18c80b19d0 0x7f18c80b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:26.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.601+0000 7f18ceaae640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f18c8150680 0x7f18c8150b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:54344/0 (socket says 172.21.15.17:54344) 2024-09-05T07:57:26.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.601+0000 7f18ceaae640 1 -- 172.21.15.17:0/478482168 learned_addr learned my addr 172.21.15.17:0/478482168 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:26.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.605+0000 7f18ceaae640 1 -- 172.21.15.17:0/478482168 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18c80b19d0 msgr2=0x7f18c80b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:26.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.605+0000 7f18ceaae640 1 --2- 172.21.15.17:0/478482168 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18c80b19d0 0x7f18c80b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:26.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.605+0000 7f18ceaae640 1 -- 172.21.15.17:0/478482168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18b4005bf0 msgr2=0x7f18c8153630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:26.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.605+0000 7f18ceaae640 1 --2- 172.21.15.17:0/478482168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18b4005bf0 0x7f18c8153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:26.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.605+0000 7f18ceaae640 1 -- 172.21.15.17:0/478482168 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c81eca30 con 0x7f18c8150680 2024-09-05T07:57:26.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.607+0000 7f18ceaae640 1 --2- 172.21.15.17:0/478482168 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f18c8150680 0x7f18c8150b30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f18c80cb110 tx=0x7f18c000e160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:26.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.611+0000 7f18baffd640 1 -- 172.21.15.17:0/478482168 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c000eb70 con 0x7f18c8150680 2024-09-05T07:57:26.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.611+0000 7f18baffd640 1 -- 172.21.15.17:0/478482168 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18c0018070 con 0x7f18c8150680 2024-09-05T07:57:26.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.611+0000 7f18d0511640 1 -- 172.21.15.17:0/478482168 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18c8157e10 con 0x7f18c8150680 2024-09-05T07:57:26.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.611+0000 7f18baffd640 1 -- 172.21.15.17:0/478482168 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c0013420 con 0x7f18c8150680 2024-09-05T07:57:26.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.611+0000 7f18d0511640 1 -- 172.21.15.17:0/478482168 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f18c80b11d0 con 0x7f18c8150680 2024-09-05T07:57:26.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.612+0000 7f18d0511640 1 -- 172.21.15.17:0/478482168 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18c806fc40 con 0x7f18c8150680 2024-09-05T07:57:26.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.892+0000 7f18baffd640 1 -- 172.21.15.17:0/478482168 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f18c00135c0 con 0x7f18c8150680 2024-09-05T07:57:26.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.892+0000 7f18baffd640 1 --2- 172.21.15.17:0/478482168 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f18ac06be80 0x7f18ac06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:26.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.893+0000 7f18ce2ad640 1 --2- 172.21.15.17:0/478482168 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f18ac06be80 0x7f18ac06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:26.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.893+0000 7f18ce2ad640 1 --2- 172.21.15.17:0/478482168 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f18ac06be80 0x7f18ac06e340 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f18c4034000 tx=0x7f18c402c000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:26.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.898+0000 7f18baffd640 1 -- 172.21.15.17:0/478482168 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f18c0057f70 con 0x7f18c8150680 2024-09-05T07:57:26.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:26.909+0000 7f18baffd640 1 -- 172.21.15.17:0/478482168 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f18c81eca30 con 0x7f18c8150680 2024-09-05T07:57:27.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:27.084+0000 7f18d0511640 1 -- 172.21.15.17:0/478482168 --> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f18c8073c70 con 0x7f18ac06be80 2024-09-05T07:57:27.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:27.091+0000 7f18baffd640 1 -- 172.21.15.17:0/478482168 <== mgr.4099 v2:172.21.15.26:6800/2736912541 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251646 (secure 0 0 0) 0x7f18c8073c70 con 0x7f18ac06be80 2024-09-05T07:57:27.094 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:57:27.096 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-05T07:57:27.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:27.094+0000 7f18d0511640 1 -- 172.21.15.17:0/478482168 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f18ac06be80 msgr2=0x7f18ac06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:27.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:27.094+0000 7f18d0511640 1 --2- 172.21.15.17:0/478482168 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f18ac06be80 0x7f18ac06e340 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f18c4034000 tx=0x7f18c402c000 comp rx=0 tx=0).stop 2024-09-05T07:57:27.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:27.094+0000 7f18d0511640 1 -- 172.21.15.17:0/478482168 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f18c8150680 msgr2=0x7f18c8150b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:27.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:27.094+0000 7f18d0511640 1 --2- 172.21.15.17:0/478482168 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f18c8150680 0x7f18c8150b30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f18c80cb110 tx=0x7f18c000e160 comp rx=0 tx=0).stop 2024-09-05T07:57:27.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:27.094+0000 7f18d0511640 1 -- 172.21.15.17:0/478482168 shutdown_connections 2024-09-05T07:57:27.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:27.094+0000 7f18d0511640 1 --2- 172.21.15.17:0/478482168 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f18ac06be80 0x7f18ac06e340 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:27.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:27.094+0000 7f18d0511640 1 --2- 172.21.15.17:0/478482168 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f18c8150680 0x7f18c8150b30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:27.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:27.094+0000 7f18d0511640 1 --2- 172.21.15.17:0/478482168 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f18c80b19d0 0x7f18c80b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:27.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:27.094+0000 7f18d0511640 1 --2- 172.21.15.17:0/478482168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18b4005bf0 0x7f18c8153630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:27.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:27.094+0000 7f18d0511640 1 -- 172.21.15.17:0/478482168 >> 172.21.15.17:0/478482168 conn(0x7f18c80cd440 msgr2=0x7f18c8155b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:27.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:27.094+0000 7f18d0511640 1 -- 172.21.15.17:0/478482168 shutdown_connections 2024-09-05T07:57:27.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:27.094+0000 7f18d0511640 1 -- 172.21.15.17:0/478482168 wait complete. 2024-09-05T07:57:27.105 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":866,"stamp":"2024-09-05T07:57:26.211906+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":37817128,"num_objects":109,"num_object_clones":0,"num_object_copies":218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":0,"num_read":985,"num_read_kb":1016,"num_write":14420,"num_write_kb":339551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13337,"ondisk_log_size":13337,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":376824,"kb_used_data":76024,"kb_used_omap":12,"kb_used_meta":300659,"kb_avail":754597896,"statfs":{"total":773094113280,"available":772708245504,"internally_reserved":0,"allocated":77848576,"data_stored":76343576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":307875377},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2336,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002824"},"pg_stats":[{"pgid":"3.3f","version":"24'52","reported_seq":75,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.326626+0000","last_change":"2024-09-05T07:30:02.495241+0000","last_active":"2024-09-05T07:57:10.326626+0000","last_peered":"2024-09-05T07:57:10.326626+0000","last_clean":"2024-09-05T07:57:10.326626+0000","last_became_active":"2024-09-05T07:30:02.494878+0000","last_became_peered":"2024-09-05T07:30:02.494878+0000","last_unstale":"2024-09-05T07:57:10.326626+0000","last_undegraded":"2024-09-05T07:57:10.326626+0000","last_fullsized":"2024-09-05T07:57:10.326626+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:15:28.381136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":2980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"24'95","reported_seq":124,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.313902+0000","last_change":"2024-09-05T07:29:30.658489+0000","last_active":"2024-09-05T07:57:10.313902+0000","last_peered":"2024-09-05T07:57:10.313902+0000","last_clean":"2024-09-05T07:57:10.313902+0000","last_became_active":"2024-09-05T07:29:30.658225+0000","last_became_peered":"2024-09-05T07:29:30.658225+0000","last_unstale":"2024-09-05T07:57:10.313902+0000","last_undegraded":"2024-09-05T07:57:10.313902+0000","last_fullsized":"2024-09-05T07:57:10.313902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:03:07.788844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":7017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"24'86","reported_seq":115,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.313139+0000","last_change":"2024-09-05T07:29:30.659535+0000","last_active":"2024-09-05T07:57:10.313139+0000","last_peered":"2024-09-05T07:57:10.313139+0000","last_clean":"2024-09-05T07:57:10.313139+0000","last_became_active":"2024-09-05T07:29:30.659042+0000","last_became_peered":"2024-09-05T07:29:30.659042+0000","last_unstale":"2024-09-05T07:57:10.313139+0000","last_undegraded":"2024-09-05T07:57:10.313139+0000","last_fullsized":"2024-09-05T07:57:10.313139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:08:39.718764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":4627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"24'50","reported_seq":79,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.356926+0000","last_change":"2024-09-05T07:29:30.640489+0000","last_active":"2024-09-05T07:57:10.356926+0000","last_peered":"2024-09-05T07:57:10.356926+0000","last_clean":"2024-09-05T07:57:10.356926+0000","last_became_active":"2024-09-05T07:29:30.640141+0000","last_became_peered":"2024-09-05T07:29:30.640141+0000","last_unstale":"2024-09-05T07:57:10.356926+0000","last_undegraded":"2024-09-05T07:57:10.356926+0000","last_fullsized":"2024-09-05T07:57:10.356926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:53:14.516901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":3092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"24'51","reported_seq":79,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.348475+0000","last_change":"2024-09-05T07:29:30.659266+0000","last_active":"2024-09-05T07:57:10.348475+0000","last_peered":"2024-09-05T07:57:10.348475+0000","last_clean":"2024-09-05T07:57:10.348475+0000","last_became_active":"2024-09-05T07:29:30.658981+0000","last_became_peered":"2024-09-05T07:29:30.658981+0000","last_unstale":"2024-09-05T07:57:10.348475+0000","last_undegraded":"2024-09-05T07:57:10.348475+0000","last_fullsized":"2024-09-05T07:57:10.348475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":3119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"24'102","reported_seq":129,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.347508+0000","last_change":"2024-09-05T07:29:30.641512+0000","last_active":"2024-09-05T07:57:10.347508+0000","last_peered":"2024-09-05T07:57:10.347508+0000","last_clean":"2024-09-05T07:57:10.347508+0000","last_became_active":"2024-09-05T07:29:30.641255+0000","last_became_peered":"2024-09-05T07:29:30.641255+0000","last_unstale":"2024-09-05T07:57:10.347508+0000","last_undegraded":"2024-09-05T07:57:10.347508+0000","last_fullsized":"2024-09-05T07:57:10.347508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:42.938157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":5219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"24'87","reported_seq":115,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.343263+0000","last_change":"2024-09-05T07:29:30.556064+0000","last_active":"2024-09-05T07:57:10.343263+0000","last_peered":"2024-09-05T07:57:10.343263+0000","last_clean":"2024-09-05T07:57:10.343263+0000","last_became_active":"2024-09-05T07:29:30.555796+0000","last_became_peered":"2024-09-05T07:29:30.555796+0000","last_unstale":"2024-09-05T07:57:10.343263+0000","last_undegraded":"2024-09-05T07:57:10.343263+0000","last_fullsized":"2024-09-05T07:57:10.343263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":6302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"24'64","reported_seq":91,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.319405+0000","last_change":"2024-09-05T07:29:30.659561+0000","last_active":"2024-09-05T07:57:10.319405+0000","last_peered":"2024-09-05T07:57:10.319405+0000","last_clean":"2024-09-05T07:57:10.319405+0000","last_became_active":"2024-09-05T07:29:30.659070+0000","last_became_peered":"2024-09-05T07:29:30.659070+0000","last_unstale":"2024-09-05T07:57:10.319405+0000","last_undegraded":"2024-09-05T07:57:10.319405+0000","last_fullsized":"2024-09-05T07:57:10.319405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:13:33.902479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"24'73","reported_seq":101,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.321199+0000","last_change":"2024-09-05T07:29:30.565653+0000","last_active":"2024-09-05T07:57:10.321199+0000","last_peered":"2024-09-05T07:57:10.321199+0000","last_clean":"2024-09-05T07:57:10.321199+0000","last_became_active":"2024-09-05T07:29:30.565408+0000","last_became_peered":"2024-09-05T07:29:30.565408+0000","last_unstale":"2024-09-05T07:57:10.321199+0000","last_undegraded":"2024-09-05T07:57:10.321199+0000","last_fullsized":"2024-09-05T07:57:10.321199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":5244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"24'70","reported_seq":98,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.351285+0000","last_change":"2024-09-05T07:29:30.643865+0000","last_active":"2024-09-05T07:57:10.351285+0000","last_peered":"2024-09-05T07:57:10.351285+0000","last_clean":"2024-09-05T07:57:10.351285+0000","last_became_active":"2024-09-05T07:29:30.643587+0000","last_became_peered":"2024-09-05T07:29:30.643587+0000","last_unstale":"2024-09-05T07:57:10.351285+0000","last_undegraded":"2024-09-05T07:57:10.351285+0000","last_fullsized":"2024-09-05T07:57:10.351285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":1781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"24'68","reported_seq":96,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.346144+0000","last_change":"2024-09-05T07:29:30.557314+0000","last_active":"2024-09-05T07:57:10.346144+0000","last_peered":"2024-09-05T07:57:10.346144+0000","last_clean":"2024-09-05T07:57:10.346144+0000","last_became_active":"2024-09-05T07:29:30.557039+0000","last_became_peered":"2024-09-05T07:29:30.557039+0000","last_unstale":"2024-09-05T07:57:10.346144+0000","last_undegraded":"2024-09-05T07:57:10.346144+0000","last_fullsized":"2024-09-05T07:57:10.346144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"24'49","reported_seq":77,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.349793+0000","last_change":"2024-09-05T07:29:30.564518+0000","last_active":"2024-09-05T07:57:10.349793+0000","last_peered":"2024-09-05T07:57:10.349793+0000","last_clean":"2024-09-05T07:57:10.349793+0000","last_became_active":"2024-09-05T07:29:30.564271+0000","last_became_peered":"2024-09-05T07:29:30.564271+0000","last_unstale":"2024-09-05T07:57:10.349793+0000","last_undegraded":"2024-09-05T07:57:10.349793+0000","last_fullsized":"2024-09-05T07:57:10.349793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":2250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"24'77","reported_seq":104,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.296011+0000","last_change":"2024-09-05T07:29:30.631857+0000","last_active":"2024-09-05T07:57:10.296011+0000","last_peered":"2024-09-05T07:57:10.296011+0000","last_clean":"2024-09-05T07:57:10.296011+0000","last_became_active":"2024-09-05T07:29:30.631588+0000","last_became_peered":"2024-09-05T07:29:30.631588+0000","last_unstale":"2024-09-05T07:57:10.296011+0000","last_undegraded":"2024-09-05T07:57:10.296011+0000","last_fullsized":"2024-09-05T07:57:10.296011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:41:25.696697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"24'67","reported_seq":94,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.297577+0000","last_change":"2024-09-05T07:29:30.632829+0000","last_active":"2024-09-05T07:57:10.297577+0000","last_peered":"2024-09-05T07:57:10.297577+0000","last_clean":"2024-09-05T07:57:10.297577+0000","last_became_active":"2024-09-05T07:29:30.632528+0000","last_became_peered":"2024-09-05T07:29:30.632528+0000","last_unstale":"2024-09-05T07:57:10.297577+0000","last_undegraded":"2024-09-05T07:57:10.297577+0000","last_fullsized":"2024-09-05T07:57:10.297577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:22:35.613478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":4207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"24'87","reported_seq":114,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.313845+0000","last_change":"2024-09-05T07:29:30.657306+0000","last_active":"2024-09-05T07:57:10.313845+0000","last_peered":"2024-09-05T07:57:10.313845+0000","last_clean":"2024-09-05T07:57:10.313845+0000","last_became_active":"2024-09-05T07:29:30.656997+0000","last_became_peered":"2024-09-05T07:29:30.656997+0000","last_unstale":"2024-09-05T07:57:10.313845+0000","last_undegraded":"2024-09-05T07:57:10.313845+0000","last_fullsized":"2024-09-05T07:57:10.313845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:15:28.381136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"24'76","reported_seq":103,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.293131+0000","last_change":"2024-09-05T07:29:30.641543+0000","last_active":"2024-09-05T07:57:10.293131+0000","last_peered":"2024-09-05T07:57:10.293131+0000","last_clean":"2024-09-05T07:57:10.293131+0000","last_became_active":"2024-09-05T07:29:30.641283+0000","last_became_peered":"2024-09-05T07:29:30.641283+0000","last_unstale":"2024-09-05T07:57:10.293131+0000","last_undegraded":"2024-09-05T07:57:10.293131+0000","last_fullsized":"2024-09-05T07:57:10.293131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:36:59.967135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"24'92","reported_seq":119,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.291737+0000","last_change":"2024-09-05T07:29:30.558414+0000","last_active":"2024-09-05T07:57:10.291737+0000","last_peered":"2024-09-05T07:57:10.291737+0000","last_clean":"2024-09-05T07:57:10.291737+0000","last_became_active":"2024-09-05T07:29:30.558105+0000","last_became_peered":"2024-09-05T07:29:30.558105+0000","last_unstale":"2024-09-05T07:57:10.291737+0000","last_undegraded":"2024-09-05T07:57:10.291737+0000","last_fullsized":"2024-09-05T07:57:10.291737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:55:31.494616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":4227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"24'95","reported_seq":122,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.326590+0000","last_change":"2024-09-05T07:29:30.643169+0000","last_active":"2024-09-05T07:57:10.326590+0000","last_peered":"2024-09-05T07:57:10.326590+0000","last_clean":"2024-09-05T07:57:10.326590+0000","last_became_active":"2024-09-05T07:29:30.642876+0000","last_became_peered":"2024-09-05T07:29:30.642876+0000","last_unstale":"2024-09-05T07:57:10.326590+0000","last_undegraded":"2024-09-05T07:57:10.326590+0000","last_fullsized":"2024-09-05T07:57:10.326590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:40.101513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":9001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"24'66","reported_seq":94,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.288476+0000","last_change":"2024-09-05T07:29:30.557239+0000","last_active":"2024-09-05T07:57:10.288476+0000","last_peered":"2024-09-05T07:57:10.288476+0000","last_clean":"2024-09-05T07:57:10.288476+0000","last_became_active":"2024-09-05T07:29:30.556969+0000","last_became_peered":"2024-09-05T07:29:30.556969+0000","last_unstale":"2024-09-05T07:57:10.288476+0000","last_undegraded":"2024-09-05T07:57:10.288476+0000","last_fullsized":"2024-09-05T07:57:10.288476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:47:29.801348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":2884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"24'78","reported_seq":107,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.350112+0000","last_change":"2024-09-05T07:29:30.564077+0000","last_active":"2024-09-05T07:57:10.350112+0000","last_peered":"2024-09-05T07:57:10.350112+0000","last_clean":"2024-09-05T07:57:10.350112+0000","last_became_active":"2024-09-05T07:29:30.563808+0000","last_became_peered":"2024-09-05T07:29:30.563808+0000","last_unstale":"2024-09-05T07:57:10.350112+0000","last_undegraded":"2024-09-05T07:57:10.350112+0000","last_fullsized":"2024-09-05T07:57:10.350112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":5103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"24'109","reported_seq":138,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.356699+0000","last_change":"2024-09-05T07:29:30.643879+0000","last_active":"2024-09-05T07:57:10.356699+0000","last_peered":"2024-09-05T07:57:10.356699+0000","last_clean":"2024-09-05T07:57:10.356699+0000","last_became_active":"2024-09-05T07:29:30.643559+0000","last_became_peered":"2024-09-05T07:29:30.643559+0000","last_unstale":"2024-09-05T07:57:10.356699+0000","last_undegraded":"2024-09-05T07:57:10.356699+0000","last_fullsized":"2024-09-05T07:57:10.356699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":8204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"24'68","reported_seq":97,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.321373+0000","last_change":"2024-09-05T07:29:30.564954+0000","last_active":"2024-09-05T07:57:10.321373+0000","last_peered":"2024-09-05T07:57:10.321373+0000","last_clean":"2024-09-05T07:57:10.321373+0000","last_became_active":"2024-09-05T07:29:30.564669+0000","last_became_peered":"2024-09-05T07:29:30.564669+0000","last_unstale":"2024-09-05T07:57:10.321373+0000","last_undegraded":"2024-09-05T07:57:10.321373+0000","last_fullsized":"2024-09-05T07:57:10.321373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":2069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"24'75","reported_seq":103,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.315721+0000","last_change":"2024-09-05T07:29:30.656718+0000","last_active":"2024-09-05T07:57:10.315721+0000","last_peered":"2024-09-05T07:57:10.315721+0000","last_clean":"2024-09-05T07:57:10.315721+0000","last_became_active":"2024-09-05T07:29:30.656451+0000","last_became_peered":"2024-09-05T07:29:30.656451+0000","last_unstale":"2024-09-05T07:57:10.315721+0000","last_undegraded":"2024-09-05T07:57:10.315721+0000","last_fullsized":"2024-09-05T07:57:10.315721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:38:11.961137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":3632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"24'60","reported_seq":88,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.291730+0000","last_change":"2024-09-05T07:29:30.658481+0000","last_active":"2024-09-05T07:57:10.291730+0000","last_peered":"2024-09-05T07:57:10.291730+0000","last_clean":"2024-09-05T07:57:10.291730+0000","last_became_active":"2024-09-05T07:29:30.658207+0000","last_became_peered":"2024-09-05T07:29:30.658207+0000","last_unstale":"2024-09-05T07:57:10.291730+0000","last_undegraded":"2024-09-05T07:57:10.291730+0000","last_fullsized":"2024-09-05T07:57:10.291730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:23:04.483495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":3656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"24'76","reported_seq":104,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.312991+0000","last_change":"2024-09-05T07:29:30.657936+0000","last_active":"2024-09-05T07:57:10.312991+0000","last_peered":"2024-09-05T07:57:10.312991+0000","last_clean":"2024-09-05T07:57:10.312991+0000","last_became_active":"2024-09-05T07:29:30.657177+0000","last_became_peered":"2024-09-05T07:29:30.657177+0000","last_unstale":"2024-09-05T07:57:10.312991+0000","last_undegraded":"2024-09-05T07:57:10.312991+0000","last_fullsized":"2024-09-05T07:57:10.312991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:01:34.217228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":7413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"24'76","reported_seq":104,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.352634+0000","last_change":"2024-09-05T07:29:30.642790+0000","last_active":"2024-09-05T07:57:10.352634+0000","last_peered":"2024-09-05T07:57:10.352634+0000","last_clean":"2024-09-05T07:57:10.352634+0000","last_became_active":"2024-09-05T07:29:30.641834+0000","last_became_peered":"2024-09-05T07:29:30.641834+0000","last_unstale":"2024-09-05T07:57:10.352634+0000","last_undegraded":"2024-09-05T07:57:10.352634+0000","last_fullsized":"2024-09-05T07:57:10.352634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:34:17.448981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":3360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"24'83","reported_seq":111,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.297659+0000","last_change":"2024-09-05T07:29:30.633776+0000","last_active":"2024-09-05T07:57:10.297659+0000","last_peered":"2024-09-05T07:57:10.297659+0000","last_clean":"2024-09-05T07:57:10.297659+0000","last_became_active":"2024-09-05T07:29:30.633507+0000","last_became_peered":"2024-09-05T07:29:30.633507+0000","last_unstale":"2024-09-05T07:57:10.297659+0000","last_undegraded":"2024-09-05T07:57:10.297659+0000","last_fullsized":"2024-09-05T07:57:10.297659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:34:54.335152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":5040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"24'50","reported_seq":78,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.296242+0000","last_change":"2024-09-05T07:29:30.632558+0000","last_active":"2024-09-05T07:57:10.296242+0000","last_peered":"2024-09-05T07:57:10.296242+0000","last_clean":"2024-09-05T07:57:10.296242+0000","last_became_active":"2024-09-05T07:29:30.632269+0000","last_became_peered":"2024-09-05T07:29:30.632269+0000","last_unstale":"2024-09-05T07:57:10.296242+0000","last_undegraded":"2024-09-05T07:57:10.296242+0000","last_fullsized":"2024-09-05T07:57:10.296242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:35:18.927192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":6253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"24'73","reported_seq":102,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.312088+0000","last_change":"2024-09-05T07:29:30.656638+0000","last_active":"2024-09-05T07:57:10.312088+0000","last_peered":"2024-09-05T07:57:10.312088+0000","last_clean":"2024-09-05T07:57:10.312088+0000","last_became_active":"2024-09-05T07:29:30.656382+0000","last_became_peered":"2024-09-05T07:29:30.656382+0000","last_unstale":"2024-09-05T07:57:10.312088+0000","last_undegraded":"2024-09-05T07:57:10.312088+0000","last_fullsized":"2024-09-05T07:57:10.312088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:34:49.879681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":7725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"24'117","reported_seq":146,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.285819+0000","last_change":"2024-09-05T07:29:30.657421+0000","last_active":"2024-09-05T07:57:10.285819+0000","last_peered":"2024-09-05T07:57:10.285819+0000","last_clean":"2024-09-05T07:57:10.285819+0000","last_became_active":"2024-09-05T07:29:30.657159+0000","last_became_peered":"2024-09-05T07:29:30.657159+0000","last_unstale":"2024-09-05T07:57:10.285819+0000","last_undegraded":"2024-09-05T07:57:10.285819+0000","last_fullsized":"2024-09-05T07:57:10.285819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:13:05.334750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":4986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"24'92","reported_seq":121,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.327999+0000","last_change":"2024-09-05T07:29:30.624866+0000","last_active":"2024-09-05T07:57:10.327999+0000","last_peered":"2024-09-05T07:57:10.327999+0000","last_clean":"2024-09-05T07:57:10.327999+0000","last_became_active":"2024-09-05T07:29:30.624605+0000","last_became_peered":"2024-09-05T07:29:30.624605+0000","last_unstale":"2024-09-05T07:57:10.327999+0000","last_undegraded":"2024-09-05T07:57:10.327999+0000","last_fullsized":"2024-09-05T07:57:10.327999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:42.938157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":7891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"24'80","reported_seq":109,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.355465+0000","last_change":"2024-09-05T07:29:30.642514+0000","last_active":"2024-09-05T07:57:10.355465+0000","last_peered":"2024-09-05T07:57:10.355465+0000","last_clean":"2024-09-05T07:57:10.355465+0000","last_became_active":"2024-09-05T07:29:30.642084+0000","last_became_peered":"2024-09-05T07:29:30.642084+0000","last_unstale":"2024-09-05T07:57:10.355465+0000","last_undegraded":"2024-09-05T07:57:10.355465+0000","last_fullsized":"2024-09-05T07:57:10.355465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:40.101513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":4235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"24'60","reported_seq":88,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.321128+0000","last_change":"2024-09-05T07:29:30.657456+0000","last_active":"2024-09-05T07:57:10.321128+0000","last_peered":"2024-09-05T07:57:10.321128+0000","last_clean":"2024-09-05T07:57:10.321128+0000","last_became_active":"2024-09-05T07:29:30.657117+0000","last_became_peered":"2024-09-05T07:29:30.657117+0000","last_unstale":"2024-09-05T07:57:10.321128+0000","last_undegraded":"2024-09-05T07:57:10.321128+0000","last_fullsized":"2024-09-05T07:57:10.321128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":3534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"24'647","reported_seq":676,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:05.043520+0000","last_change":"2024-09-05T07:29:29.568126+0000","last_active":"2024-09-05T07:57:05.043520+0000","last_peered":"2024-09-05T07:57:05.043520+0000","last_clean":"2024-09-05T07:57:05.043520+0000","last_became_active":"2024-09-05T07:29:29.567846+0000","last_became_peered":"2024-09-05T07:29:29.567846+0000","last_unstale":"2024-09-05T07:57:05.043520+0000","last_undegraded":"2024-09-05T07:57:05.043520+0000","last_fullsized":"2024-09-05T07:57:05.043520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:48:25.900221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195510,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":639,"num_write_kb":4403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"24'89","reported_seq":117,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.358485+0000","last_change":"2024-09-05T07:29:30.557504+0000","last_active":"2024-09-05T07:57:10.358485+0000","last_peered":"2024-09-05T07:57:10.358485+0000","last_clean":"2024-09-05T07:57:10.358485+0000","last_became_active":"2024-09-05T07:29:30.557203+0000","last_became_peered":"2024-09-05T07:29:30.557203+0000","last_unstale":"2024-09-05T07:57:10.358485+0000","last_undegraded":"2024-09-05T07:57:10.358485+0000","last_fullsized":"2024-09-05T07:57:10.358485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":6286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"24'598","reported_seq":627,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:54:31.541138+0000","last_change":"2024-09-05T07:29:29.524587+0000","last_active":"2024-09-05T07:54:31.541138+0000","last_peered":"2024-09-05T07:54:31.541138+0000","last_clean":"2024-09-05T07:54:31.541138+0000","last_became_active":"2024-09-05T07:29:29.524321+0000","last_became_peered":"2024-09-05T07:29:29.524321+0000","last_unstale":"2024-09-05T07:54:31.541138+0000","last_undegraded":"2024-09-05T07:54:31.541138+0000","last_fullsized":"2024-09-05T07:54:31.541138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":598,"log_dups_size":0,"ondisk_log_size":598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:53:13.376716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"24'6","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:56:53.384231+0000","last_change":"2024-09-05T07:29:29.570879+0000","last_active":"2024-09-05T07:56:53.384231+0000","last_peered":"2024-09-05T07:56:53.384231+0000","last_clean":"2024-09-05T07:56:53.384231+0000","last_became_active":"2024-09-05T07:29:29.570456+0000","last_became_peered":"2024-09-05T07:29:29.570456+0000","last_unstale":"2024-09-05T07:56:53.384231+0000","last_undegraded":"2024-09-05T07:56:53.384231+0000","last_fullsized":"2024-09-05T07:56:53.384231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:52:54.638586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"24'84","reported_seq":111,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.318416+0000","last_change":"2024-09-05T07:29:30.657364+0000","last_active":"2024-09-05T07:57:10.318416+0000","last_peered":"2024-09-05T07:57:10.318416+0000","last_clean":"2024-09-05T07:57:10.318416+0000","last_became_active":"2024-09-05T07:29:30.657008+0000","last_became_peered":"2024-09-05T07:29:30.657008+0000","last_unstale":"2024-09-05T07:57:10.318416+0000","last_undegraded":"2024-09-05T07:57:10.318416+0000","last_fullsized":"2024-09-05T07:57:10.318416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:36:59.967135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":7830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"24'7","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:56:49.948482+0000","last_change":"2024-09-05T07:29:29.562802+0000","last_active":"2024-09-05T07:56:49.948482+0000","last_peered":"2024-09-05T07:56:49.948482+0000","last_clean":"2024-09-05T07:56:49.948482+0000","last_became_active":"2024-09-05T07:29:29.562520+0000","last_became_peered":"2024-09-05T07:29:29.562520+0000","last_unstale":"2024-09-05T07:56:49.948482+0000","last_undegraded":"2024-09-05T07:56:49.948482+0000","last_fullsized":"2024-09-05T07:56:49.948482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:34:16.308797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"24'88","reported_seq":116,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.358381+0000","last_change":"2024-09-05T07:29:30.563197+0000","last_active":"2024-09-05T07:57:10.358381+0000","last_peered":"2024-09-05T07:57:10.358381+0000","last_clean":"2024-09-05T07:57:10.358381+0000","last_became_active":"2024-09-05T07:29:30.562945+0000","last_became_peered":"2024-09-05T07:29:30.562945+0000","last_unstale":"2024-09-05T07:57:10.358381+0000","last_undegraded":"2024-09-05T07:57:10.358381+0000","last_fullsized":"2024-09-05T07:57:10.358381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"24'14","reported_seq":44,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.086392+0000","last_change":"2024-09-05T07:29:29.559012+0000","last_active":"2024-09-05T07:57:10.086392+0000","last_peered":"2024-09-05T07:57:10.086392+0000","last_clean":"2024-09-05T07:57:10.086392+0000","last_became_active":"2024-09-05T07:29:29.558744+0000","last_became_peered":"2024-09-05T07:29:29.558744+0000","last_unstale":"2024-09-05T07:57:10.086392+0000","last_undegraded":"2024-09-05T07:57:10.086392+0000","last_fullsized":"2024-09-05T07:57:10.086392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"24'98","reported_seq":125,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.357735+0000","last_change":"2024-09-05T07:29:30.641594+0000","last_active":"2024-09-05T07:57:10.357735+0000","last_peered":"2024-09-05T07:57:10.357735+0000","last_clean":"2024-09-05T07:57:10.357735+0000","last_became_active":"2024-09-05T07:29:30.641360+0000","last_became_peered":"2024-09-05T07:29:30.641360+0000","last_unstale":"2024-09-05T07:57:10.357735+0000","last_undegraded":"2024-09-05T07:57:10.357735+0000","last_fullsized":"2024-09-05T07:57:10.357735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:49:40.327718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":5807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"24'8","reported_seq":38,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:07.771590+0000","last_change":"2024-09-05T07:29:29.559998+0000","last_active":"2024-09-05T07:57:07.771590+0000","last_peered":"2024-09-05T07:57:07.771590+0000","last_clean":"2024-09-05T07:57:07.771590+0000","last_became_active":"2024-09-05T07:29:29.559717+0000","last_became_peered":"2024-09-05T07:29:29.559717+0000","last_unstale":"2024-09-05T07:57:07.771590+0000","last_undegraded":"2024-09-05T07:57:07.771590+0000","last_fullsized":"2024-09-05T07:57:07.771590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"24'57","reported_seq":84,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.314763+0000","last_change":"2024-09-05T07:29:30.657727+0000","last_active":"2024-09-05T07:57:10.314763+0000","last_peered":"2024-09-05T07:57:10.314763+0000","last_clean":"2024-09-05T07:57:10.314763+0000","last_became_active":"2024-09-05T07:29:30.657038+0000","last_became_peered":"2024-09-05T07:29:30.657038+0000","last_unstale":"2024-09-05T07:57:10.314763+0000","last_undegraded":"2024-09-05T07:57:10.314763+0000","last_fullsized":"2024-09-05T07:57:10.314763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:00:35.625571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":3450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"24'613","reported_seq":642,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:09.740261+0000","last_change":"2024-09-05T07:29:29.566840+0000","last_active":"2024-09-05T07:57:09.740261+0000","last_peered":"2024-09-05T07:57:09.740261+0000","last_clean":"2024-09-05T07:57:09.740261+0000","last_became_active":"2024-09-05T07:29:29.566501+0000","last_became_peered":"2024-09-05T07:29:29.566501+0000","last_unstale":"2024-09-05T07:57:09.740261+0000","last_undegraded":"2024-09-05T07:57:09.740261+0000","last_fullsized":"2024-09-05T07:57:09.740261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:47:57.187710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":613,"num_write_kb":614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"24'72","reported_seq":99,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.303889+0000","last_change":"2024-09-05T07:29:30.642252+0000","last_active":"2024-09-05T07:57:10.303889+0000","last_peered":"2024-09-05T07:57:10.303889+0000","last_clean":"2024-09-05T07:57:10.303889+0000","last_became_active":"2024-09-05T07:29:30.641991+0000","last_became_peered":"2024-09-05T07:29:30.641991+0000","last_unstale":"2024-09-05T07:57:10.303889+0000","last_undegraded":"2024-09-05T07:57:10.303889+0000","last_fullsized":"2024-09-05T07:57:10.303889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:42:04.216273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":2982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"24'832","reported_seq":861,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:00.513516+0000","last_change":"2024-09-05T07:29:29.562441+0000","last_active":"2024-09-05T07:57:00.513516+0000","last_peered":"2024-09-05T07:57:00.513516+0000","last_clean":"2024-09-05T07:57:00.513516+0000","last_became_active":"2024-09-05T07:29:29.562136+0000","last_became_peered":"2024-09-05T07:29:29.562136+0000","last_unstale":"2024-09-05T07:57:00.513516+0000","last_undegraded":"2024-09-05T07:57:00.513516+0000","last_fullsized":"2024-09-05T07:57:00.513516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:06:20.633881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":830,"num_write_kb":4536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"24'66","reported_seq":94,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.343449+0000","last_change":"2024-09-05T07:29:30.633033+0000","last_active":"2024-09-05T07:57:10.343449+0000","last_peered":"2024-09-05T07:57:10.343449+0000","last_clean":"2024-09-05T07:57:10.343449+0000","last_became_active":"2024-09-05T07:29:30.632784+0000","last_became_peered":"2024-09-05T07:29:30.632784+0000","last_unstale":"2024-09-05T07:57:10.343449+0000","last_undegraded":"2024-09-05T07:57:10.343449+0000","last_fullsized":"2024-09-05T07:57:10.343449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":3605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'14","reported_seq":43,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:02.687518+0000","last_change":"2024-09-05T07:29:29.567195+0000","last_active":"2024-09-05T07:57:02.687518+0000","last_peered":"2024-09-05T07:57:02.687518+0000","last_clean":"2024-09-05T07:57:02.687518+0000","last_became_active":"2024-09-05T07:29:29.566934+0000","last_became_peered":"2024-09-05T07:29:29.566934+0000","last_unstale":"2024-09-05T07:57:02.687518+0000","last_undegraded":"2024-09-05T07:57:02.687518+0000","last_fullsized":"2024-09-05T07:57:02.687518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:10:28.438071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"24'76","reported_seq":103,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.298339+0000","last_change":"2024-09-05T07:29:30.632260+0000","last_active":"2024-09-05T07:57:10.298339+0000","last_peered":"2024-09-05T07:57:10.298339+0000","last_clean":"2024-09-05T07:57:10.298339+0000","last_became_active":"2024-09-05T07:29:30.631974+0000","last_became_peered":"2024-09-05T07:29:30.631974+0000","last_unstale":"2024-09-05T07:57:10.298339+0000","last_undegraded":"2024-09-05T07:57:10.298339+0000","last_fullsized":"2024-09-05T07:57:10.298339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:45:00.967978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"24'10","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:09.707101+0000","last_change":"2024-09-05T07:29:29.567028+0000","last_active":"2024-09-05T07:57:09.707101+0000","last_peered":"2024-09-05T07:57:09.707101+0000","last_clean":"2024-09-05T07:57:09.707101+0000","last_became_active":"2024-09-05T07:29:29.566754+0000","last_became_peered":"2024-09-05T07:29:29.566754+0000","last_unstale":"2024-09-05T07:57:09.707101+0000","last_undegraded":"2024-09-05T07:57:09.707101+0000","last_fullsized":"2024-09-05T07:57:09.707101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:49:13.565181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"24'97","reported_seq":124,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.302295+0000","last_change":"2024-09-05T07:29:30.558658+0000","last_active":"2024-09-05T07:57:10.302295+0000","last_peered":"2024-09-05T07:57:10.302295+0000","last_clean":"2024-09-05T07:57:10.302295+0000","last_became_active":"2024-09-05T07:29:30.558179+0000","last_became_peered":"2024-09-05T07:29:30.558179+0000","last_unstale":"2024-09-05T07:57:10.302295+0000","last_undegraded":"2024-09-05T07:57:10.302295+0000","last_fullsized":"2024-09-05T07:57:10.302295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:44:13.003367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":15470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"24'10","reported_seq":40,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.084817+0000","last_change":"2024-09-05T07:29:29.525420+0000","last_active":"2024-09-05T07:57:10.084817+0000","last_peered":"2024-09-05T07:57:10.084817+0000","last_clean":"2024-09-05T07:57:10.084817+0000","last_became_active":"2024-09-05T07:29:29.525139+0000","last_became_peered":"2024-09-05T07:29:29.525139+0000","last_unstale":"2024-09-05T07:57:10.084817+0000","last_undegraded":"2024-09-05T07:57:10.084817+0000","last_fullsized":"2024-09-05T07:57:10.084817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1172,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"24'53","reported_seq":81,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.316778+0000","last_change":"2024-09-05T07:29:30.659606+0000","last_active":"2024-09-05T07:57:10.316778+0000","last_peered":"2024-09-05T07:57:10.316778+0000","last_clean":"2024-09-05T07:57:10.316778+0000","last_became_active":"2024-09-05T07:29:30.659311+0000","last_became_peered":"2024-09-05T07:29:30.659311+0000","last_unstale":"2024-09-05T07:57:10.316778+0000","last_undegraded":"2024-09-05T07:57:10.316778+0000","last_fullsized":"2024-09-05T07:57:10.316778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":2804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"24'22","reported_seq":52,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.694922+0000","last_change":"2024-09-05T07:29:29.566784+0000","last_active":"2024-09-05T07:57:10.694922+0000","last_peered":"2024-09-05T07:57:10.694922+0000","last_clean":"2024-09-05T07:57:10.694922+0000","last_became_active":"2024-09-05T07:29:29.566503+0000","last_became_peered":"2024-09-05T07:29:29.566503+0000","last_unstale":"2024-09-05T07:57:10.694922+0000","last_undegraded":"2024-09-05T07:57:10.694922+0000","last_fullsized":"2024-09-05T07:57:10.694922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"24'65","reported_seq":92,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.290685+0000","last_change":"2024-09-05T07:29:30.641565+0000","last_active":"2024-09-05T07:57:10.290685+0000","last_peered":"2024-09-05T07:57:10.290685+0000","last_clean":"2024-09-05T07:57:10.290685+0000","last_became_active":"2024-09-05T07:29:30.641309+0000","last_became_peered":"2024-09-05T07:29:30.641309+0000","last_unstale":"2024-09-05T07:57:10.290685+0000","last_undegraded":"2024-09-05T07:57:10.290685+0000","last_fullsized":"2024-09-05T07:57:10.290685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:37:28.088603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":5311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"24'8","reported_seq":47,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:21.584696+0000","last_change":"2024-09-05T07:57:21.584725+0000","last_active":"2024-09-05T07:57:21.584696+0000","last_peered":"2024-09-05T07:57:21.584696+0000","last_clean":"2024-09-05T07:57:21.584696+0000","last_became_active":"2024-09-05T07:29:29.524522+0000","last_became_peered":"2024-09-05T07:29:29.524522+0000","last_unstale":"2024-09-05T07:57:21.584696+0000","last_undegraded":"2024-09-05T07:57:21.584696+0000","last_fullsized":"2024-09-05T07:57:21.584696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'8","last_scrub_stamp":"2024-09-05T07:57:21.584620+0000","last_deep_scrub":"24'8","last_deep_scrub_stamp":"2024-09-05T07:57:21.584620+0000","last_clean_scrub_stamp":"2024-09-05T07:57:21.584620+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:25:12.769108+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"24'36","reported_seq":64,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.348352+0000","last_change":"2024-09-05T07:29:30.642565+0000","last_active":"2024-09-05T07:57:10.348352+0000","last_peered":"2024-09-05T07:57:10.348352+0000","last_clean":"2024-09-05T07:57:10.348352+0000","last_became_active":"2024-09-05T07:29:30.641774+0000","last_became_peered":"2024-09-05T07:29:30.641774+0000","last_unstale":"2024-09-05T07:57:10.348352+0000","last_undegraded":"2024-09-05T07:57:10.348352+0000","last_fullsized":"2024-09-05T07:57:10.348352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:09:36.911425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"24'9","reported_seq":48,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:24.496483+0000","last_change":"2024-09-05T07:57:24.496520+0000","last_active":"2024-09-05T07:57:24.496483+0000","last_peered":"2024-09-05T07:57:24.496483+0000","last_clean":"2024-09-05T07:57:24.496483+0000","last_became_active":"2024-09-05T07:29:29.525044+0000","last_became_peered":"2024-09-05T07:29:29.525044+0000","last_unstale":"2024-09-05T07:57:24.496483+0000","last_undegraded":"2024-09-05T07:57:24.496483+0000","last_fullsized":"2024-09-05T07:57:24.496483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'9","last_scrub_stamp":"2024-09-05T07:57:24.496406+0000","last_deep_scrub":"24'9","last_deep_scrub_stamp":"2024-09-05T07:57:24.496406+0000","last_clean_scrub_stamp":"2024-09-05T07:57:24.496406+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:46:11.565692+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"24'52","reported_seq":81,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.349985+0000","last_change":"2024-09-05T07:29:30.563669+0000","last_active":"2024-09-05T07:57:10.349985+0000","last_peered":"2024-09-05T07:57:10.349985+0000","last_clean":"2024-09-05T07:57:10.349985+0000","last_became_active":"2024-09-05T07:29:30.563408+0000","last_became_peered":"2024-09-05T07:29:30.563408+0000","last_unstale":"2024-09-05T07:57:10.349985+0000","last_undegraded":"2024-09-05T07:57:10.349985+0000","last_fullsized":"2024-09-05T07:57:10.349985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":3705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'6","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:56:58.387111+0000","last_change":"2024-09-05T07:29:29.559111+0000","last_active":"2024-09-05T07:56:58.387111+0000","last_peered":"2024-09-05T07:56:58.387111+0000","last_clean":"2024-09-05T07:56:58.387111+0000","last_became_active":"2024-09-05T07:29:29.558856+0000","last_became_peered":"2024-09-05T07:29:29.558856+0000","last_unstale":"2024-09-05T07:56:58.387111+0000","last_undegraded":"2024-09-05T07:56:58.387111+0000","last_fullsized":"2024-09-05T07:56:58.387111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:47:57.187710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"24'61","reported_seq":90,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.345566+0000","last_change":"2024-09-05T07:29:30.624401+0000","last_active":"2024-09-05T07:57:10.345566+0000","last_peered":"2024-09-05T07:57:10.345566+0000","last_clean":"2024-09-05T07:57:10.345566+0000","last_became_active":"2024-09-05T07:29:30.624057+0000","last_became_peered":"2024-09-05T07:29:30.624057+0000","last_unstale":"2024-09-05T07:57:10.345566+0000","last_undegraded":"2024-09-05T07:57:10.345566+0000","last_fullsized":"2024-09-05T07:57:10.345566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":4070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"24'14","reported_seq":44,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:09.732085+0000","last_change":"2024-09-05T07:29:29.570940+0000","last_active":"2024-09-05T07:57:09.732085+0000","last_peered":"2024-09-05T07:57:09.732085+0000","last_clean":"2024-09-05T07:57:09.732085+0000","last_became_active":"2024-09-05T07:29:29.570478+0000","last_became_peered":"2024-09-05T07:29:29.570478+0000","last_unstale":"2024-09-05T07:57:09.732085+0000","last_undegraded":"2024-09-05T07:57:09.732085+0000","last_fullsized":"2024-09-05T07:57:09.732085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:35:54.465221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1754,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"24'65","reported_seq":93,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.298478+0000","last_change":"2024-09-05T07:29:30.563109+0000","last_active":"2024-09-05T07:57:10.298478+0000","last_peered":"2024-09-05T07:57:10.298478+0000","last_clean":"2024-09-05T07:57:10.298478+0000","last_became_active":"2024-09-05T07:29:30.562824+0000","last_became_peered":"2024-09-05T07:29:30.562824+0000","last_unstale":"2024-09-05T07:57:10.298478+0000","last_undegraded":"2024-09-05T07:57:10.298478+0000","last_fullsized":"2024-09-05T07:57:10.298478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:42:02.212868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":2542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":190,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:16.591170+0000","last_change":"2024-09-05T07:29:13.366600+0000","last_active":"2024-09-05T07:57:16.591170+0000","last_peered":"2024-09-05T07:57:16.591170+0000","last_clean":"2024-09-05T07:57:16.591170+0000","last_became_active":"2024-09-05T07:29:13.365841+0000","last_became_peered":"2024-09-05T07:29:13.365841+0000","last_unstale":"2024-09-05T07:57:16.591170+0000","last_undegraded":"2024-09-05T07:57:16.591170+0000","last_fullsized":"2024-09-05T07:57:16.591170+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:10.874807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:10.874807+0000","last_clean_scrub_stamp":"2024-09-05T07:29:10.874807+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"22'6","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:54:31.541160+0000","last_change":"2024-09-05T07:29:29.563604+0000","last_active":"2024-09-05T07:54:31.541160+0000","last_peered":"2024-09-05T07:54:31.541160+0000","last_clean":"2024-09-05T07:54:31.541160+0000","last_became_active":"2024-09-05T07:29:29.562956+0000","last_became_peered":"2024-09-05T07:29:29.562956+0000","last_unstale":"2024-09-05T07:54:31.541160+0000","last_undegraded":"2024-09-05T07:54:31.541160+0000","last_fullsized":"2024-09-05T07:54:31.541160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:39:41.797972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"24'54","reported_seq":84,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.355863+0000","last_change":"2024-09-05T07:29:30.641543+0000","last_active":"2024-09-05T07:57:10.355863+0000","last_peered":"2024-09-05T07:57:10.355863+0000","last_clean":"2024-09-05T07:57:10.355863+0000","last_became_active":"2024-09-05T07:29:30.641243+0000","last_became_peered":"2024-09-05T07:29:30.641243+0000","last_unstale":"2024-09-05T07:57:10.355863+0000","last_undegraded":"2024-09-05T07:57:10.355863+0000","last_fullsized":"2024-09-05T07:57:10.355863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":3733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"24'325","reported_seq":356,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:13.252744+0000","last_change":"2024-09-05T07:29:29.479329+0000","last_active":"2024-09-05T07:57:13.252744+0000","last_peered":"2024-09-05T07:57:13.252744+0000","last_clean":"2024-09-05T07:57:13.252744+0000","last_became_active":"2024-09-05T07:29:29.479005+0000","last_became_peered":"2024-09-05T07:29:29.479005+0000","last_unstale":"2024-09-05T07:57:13.252744+0000","last_undegraded":"2024-09-05T07:57:13.252744+0000","last_fullsized":"2024-09-05T07:57:13.252744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:49:39.187534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3481379,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":316,"num_write_kb":3556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"24'55","reported_seq":84,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.295183+0000","last_change":"2024-09-05T07:29:30.641557+0000","last_active":"2024-09-05T07:57:10.295183+0000","last_peered":"2024-09-05T07:57:10.295183+0000","last_clean":"2024-09-05T07:57:10.295183+0000","last_became_active":"2024-09-05T07:29:30.641269+0000","last_became_peered":"2024-09-05T07:29:30.641269+0000","last_unstale":"2024-09-05T07:57:10.295183+0000","last_undegraded":"2024-09-05T07:57:10.295183+0000","last_fullsized":"2024-09-05T07:57:10.295183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:32:30.263430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":2599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"24'880","reported_seq":1780,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.687136+0000","last_change":"2024-09-05T07:29:29.568835+0000","last_active":"2024-09-05T07:57:10.687136+0000","last_peered":"2024-09-05T07:57:10.687136+0000","last_clean":"2024-09-05T07:57:10.687136+0000","last_became_active":"2024-09-05T07:29:29.568576+0000","last_became_peered":"2024-09-05T07:29:29.568576+0000","last_unstale":"2024-09-05T07:57:10.687136+0000","last_undegraded":"2024-09-05T07:57:10.687136+0000","last_fullsized":"2024-09-05T07:57:10.687136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:05:05.417016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182215,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":869,"num_read_kb":916,"num_write":877,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"24'71","reported_seq":100,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.317538+0000","last_change":"2024-09-05T07:29:30.660008+0000","last_active":"2024-09-05T07:57:10.317538+0000","last_peered":"2024-09-05T07:57:10.317538+0000","last_clean":"2024-09-05T07:57:10.317538+0000","last_became_active":"2024-09-05T07:29:30.659720+0000","last_became_peered":"2024-09-05T07:29:30.659720+0000","last_unstale":"2024-09-05T07:57:10.317538+0000","last_undegraded":"2024-09-05T07:57:10.317538+0000","last_fullsized":"2024-09-05T07:57:10.317538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:42:04.216273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":2450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"24'8","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:00.601508+0000","last_change":"2024-09-05T07:29:29.568569+0000","last_active":"2024-09-05T07:57:00.601508+0000","last_peered":"2024-09-05T07:57:00.601508+0000","last_clean":"2024-09-05T07:57:00.601508+0000","last_became_active":"2024-09-05T07:29:29.568307+0000","last_became_peered":"2024-09-05T07:29:29.568307+0000","last_unstale":"2024-09-05T07:57:00.601508+0000","last_undegraded":"2024-09-05T07:57:00.601508+0000","last_fullsized":"2024-09-05T07:57:00.601508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:12:38.814463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"24'89","reported_seq":119,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.341626+0000","last_change":"2024-09-05T07:29:30.642687+0000","last_active":"2024-09-05T07:57:10.341626+0000","last_peered":"2024-09-05T07:57:10.341626+0000","last_clean":"2024-09-05T07:57:10.341626+0000","last_became_active":"2024-09-05T07:29:30.642414+0000","last_became_peered":"2024-09-05T07:29:30.642414+0000","last_unstale":"2024-09-05T07:57:10.341626+0000","last_undegraded":"2024-09-05T07:57:10.341626+0000","last_fullsized":"2024-09-05T07:57:10.341626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":7430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"24'5","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:02.684653+0000","last_change":"2024-09-05T07:29:29.568739+0000","last_active":"2024-09-05T07:57:02.684653+0000","last_peered":"2024-09-05T07:57:02.684653+0000","last_clean":"2024-09-05T07:57:02.684653+0000","last_became_active":"2024-09-05T07:29:29.568499+0000","last_became_peered":"2024-09-05T07:29:29.568499+0000","last_unstale":"2024-09-05T07:57:02.684653+0000","last_undegraded":"2024-09-05T07:57:02.684653+0000","last_fullsized":"2024-09-05T07:57:02.684653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:05:05.417016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"24'66","reported_seq":95,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.351595+0000","last_change":"2024-09-05T07:29:30.641340+0000","last_active":"2024-09-05T07:57:10.351595+0000","last_peered":"2024-09-05T07:57:10.351595+0000","last_clean":"2024-09-05T07:57:10.351595+0000","last_became_active":"2024-09-05T07:29:30.640805+0000","last_became_peered":"2024-09-05T07:29:30.640805+0000","last_unstale":"2024-09-05T07:57:10.351595+0000","last_undegraded":"2024-09-05T07:57:10.351595+0000","last_fullsized":"2024-09-05T07:57:10.351595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:59.653492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":1781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"24'8","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:04.908697+0000","last_change":"2024-09-05T07:29:29.525212+0000","last_active":"2024-09-05T07:57:04.908697+0000","last_peered":"2024-09-05T07:57:04.908697+0000","last_clean":"2024-09-05T07:57:04.908697+0000","last_became_active":"2024-09-05T07:29:29.524918+0000","last_became_peered":"2024-09-05T07:29:29.524918+0000","last_unstale":"2024-09-05T07:57:04.908697+0000","last_undegraded":"2024-09-05T07:57:04.908697+0000","last_fullsized":"2024-09-05T07:57:04.908697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:09:35.771241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"24'64","reported_seq":93,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.294385+0000","last_change":"2024-09-05T07:29:30.658407+0000","last_active":"2024-09-05T07:57:10.294385+0000","last_peered":"2024-09-05T07:57:10.294385+0000","last_clean":"2024-09-05T07:57:10.294385+0000","last_became_active":"2024-09-05T07:29:30.658155+0000","last_became_peered":"2024-09-05T07:29:30.658155+0000","last_unstale":"2024-09-05T07:57:10.294385+0000","last_undegraded":"2024-09-05T07:57:10.294385+0000","last_fullsized":"2024-09-05T07:57:10.294385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:52:56.756904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":2545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"24'1349","reported_seq":1380,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.622291+0000","last_change":"2024-09-05T07:29:29.526674+0000","last_active":"2024-09-05T07:57:10.622291+0000","last_peered":"2024-09-05T07:57:10.622291+0000","last_clean":"2024-09-05T07:57:10.622291+0000","last_became_active":"2024-09-05T07:29:29.526421+0000","last_became_peered":"2024-09-05T07:29:29.526421+0000","last_unstale":"2024-09-05T07:57:10.622291+0000","last_undegraded":"2024-09-05T07:57:10.622291+0000","last_fullsized":"2024-09-05T07:57:10.622291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":1349,"log_dups_size":0,"ondisk_log_size":1349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3429,"num_write_kb":1221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"24'72","reported_seq":101,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.357371+0000","last_change":"2024-09-05T07:29:30.633806+0000","last_active":"2024-09-05T07:57:10.357371+0000","last_peered":"2024-09-05T07:57:10.357371+0000","last_clean":"2024-09-05T07:57:10.357371+0000","last_became_active":"2024-09-05T07:29:30.633535+0000","last_became_peered":"2024-09-05T07:29:30.633535+0000","last_unstale":"2024-09-05T07:57:10.357371+0000","last_undegraded":"2024-09-05T07:57:10.357371+0000","last_fullsized":"2024-09-05T07:57:10.357371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"24'12","reported_seq":42,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:04.909123+0000","last_change":"2024-09-05T07:29:29.524532+0000","last_active":"2024-09-05T07:57:04.909123+0000","last_peered":"2024-09-05T07:57:04.909123+0000","last_clean":"2024-09-05T07:57:04.909123+0000","last_became_active":"2024-09-05T07:29:29.524268+0000","last_became_peered":"2024-09-05T07:29:29.524268+0000","last_unstale":"2024-09-05T07:57:04.909123+0000","last_undegraded":"2024-09-05T07:57:04.909123+0000","last_fullsized":"2024-09-05T07:57:04.909123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:58.513308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'84","reported_seq":113,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.358076+0000","last_change":"2024-09-05T07:29:30.624431+0000","last_active":"2024-09-05T07:57:10.358076+0000","last_peered":"2024-09-05T07:57:10.358076+0000","last_clean":"2024-09-05T07:57:10.358076+0000","last_became_active":"2024-09-05T07:29:30.624117+0000","last_became_peered":"2024-09-05T07:29:30.624117+0000","last_unstale":"2024-09-05T07:57:10.358076+0000","last_undegraded":"2024-09-05T07:57:10.358076+0000","last_fullsized":"2024-09-05T07:57:10.358076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":5195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'9","reported_seq":40,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:07.781603+0000","last_change":"2024-09-05T07:29:29.561285+0000","last_active":"2024-09-05T07:57:07.781603+0000","last_peered":"2024-09-05T07:57:07.781603+0000","last_clean":"2024-09-05T07:57:07.781603+0000","last_became_active":"2024-09-05T07:29:29.561026+0000","last_became_peered":"2024-09-05T07:29:29.561026+0000","last_unstale":"2024-09-05T07:57:07.781603+0000","last_undegraded":"2024-09-05T07:57:07.781603+0000","last_fullsized":"2024-09-05T07:57:07.781603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"24'80","reported_seq":108,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:56:44.931312+0000","last_change":"2024-09-05T07:29:30.556889+0000","last_active":"2024-09-05T07:56:44.931312+0000","last_peered":"2024-09-05T07:56:44.931312+0000","last_clean":"2024-09-05T07:56:44.931312+0000","last_became_active":"2024-09-05T07:29:30.556627+0000","last_became_peered":"2024-09-05T07:29:30.556627+0000","last_unstale":"2024-09-05T07:56:44.931312+0000","last_undegraded":"2024-09-05T07:56:44.931312+0000","last_fullsized":"2024-09-05T07:56:44.931312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:20:01.152157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":7503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"24'11","reported_seq":42,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:00.515692+0000","last_change":"2024-09-05T07:29:29.526873+0000","last_active":"2024-09-05T07:57:00.515692+0000","last_peered":"2024-09-05T07:57:00.515692+0000","last_clean":"2024-09-05T07:57:00.515692+0000","last_became_active":"2024-09-05T07:29:29.526572+0000","last_became_peered":"2024-09-05T07:29:29.526572+0000","last_unstale":"2024-09-05T07:57:00.515692+0000","last_undegraded":"2024-09-05T07:57:00.515692+0000","last_fullsized":"2024-09-05T07:57:00.515692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"24'71","reported_seq":100,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.357907+0000","last_change":"2024-09-05T07:29:30.624592+0000","last_active":"2024-09-05T07:57:10.357907+0000","last_peered":"2024-09-05T07:57:10.357907+0000","last_clean":"2024-09-05T07:57:10.357907+0000","last_became_active":"2024-09-05T07:29:30.624109+0000","last_became_peered":"2024-09-05T07:29:30.624109+0000","last_unstale":"2024-09-05T07:57:10.357907+0000","last_undegraded":"2024-09-05T07:57:10.357907+0000","last_fullsized":"2024-09-05T07:57:10.357907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":2208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"24'5","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:56:47.894301+0000","last_change":"2024-09-05T07:29:29.569816+0000","last_active":"2024-09-05T07:56:47.894301+0000","last_peered":"2024-09-05T07:56:47.894301+0000","last_clean":"2024-09-05T07:56:47.894301+0000","last_became_active":"2024-09-05T07:29:29.569536+0000","last_became_peered":"2024-09-05T07:29:29.569536+0000","last_unstale":"2024-09-05T07:56:47.894301+0000","last_undegraded":"2024-09-05T07:56:47.894301+0000","last_fullsized":"2024-09-05T07:56:47.894301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:59:18.418220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"24'86","reported_seq":114,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.326387+0000","last_change":"2024-09-05T07:29:30.632805+0000","last_active":"2024-09-05T07:57:10.326387+0000","last_peered":"2024-09-05T07:57:10.326387+0000","last_clean":"2024-09-05T07:57:10.326387+0000","last_became_active":"2024-09-05T07:29:30.632502+0000","last_became_peered":"2024-09-05T07:29:30.632502+0000","last_unstale":"2024-09-05T07:57:10.326387+0000","last_undegraded":"2024-09-05T07:57:10.326387+0000","last_fullsized":"2024-09-05T07:57:10.326387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:59.653492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":4049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"24'545","reported_seq":575,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:02.691674+0000","last_change":"2024-09-05T07:29:29.563821+0000","last_active":"2024-09-05T07:57:02.691674+0000","last_peered":"2024-09-05T07:57:02.691674+0000","last_clean":"2024-09-05T07:57:02.691674+0000","last_became_active":"2024-09-05T07:29:29.563316+0000","last_became_peered":"2024-09-05T07:29:29.563316+0000","last_unstale":"2024-09-05T07:57:02.691674+0000","last_undegraded":"2024-09-05T07:57:02.691674+0000","last_fullsized":"2024-09-05T07:57:02.691674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:38.961328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":542,"num_write_kb":4368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"24'76","reported_seq":104,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.303070+0000","last_change":"2024-09-05T07:29:30.563106+0000","last_active":"2024-09-05T07:57:10.303070+0000","last_peered":"2024-09-05T07:57:10.303070+0000","last_clean":"2024-09-05T07:57:10.303070+0000","last_became_active":"2024-09-05T07:29:30.562776+0000","last_became_peered":"2024-09-05T07:29:30.562776+0000","last_unstale":"2024-09-05T07:57:10.303070+0000","last_undegraded":"2024-09-05T07:57:10.303070+0000","last_fullsized":"2024-09-05T07:57:10.303070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:37:16.174244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":1880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"24'79","reported_seq":106,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.297970+0000","last_change":"2024-09-05T07:29:30.558029+0000","last_active":"2024-09-05T07:57:10.297970+0000","last_peered":"2024-09-05T07:57:10.297970+0000","last_clean":"2024-09-05T07:57:10.297970+0000","last_became_active":"2024-09-05T07:29:30.557747+0000","last_became_peered":"2024-09-05T07:29:30.557747+0000","last_unstale":"2024-09-05T07:57:10.297970+0000","last_undegraded":"2024-09-05T07:57:10.297970+0000","last_fullsized":"2024-09-05T07:57:10.297970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:55:28.983976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":6364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"24'9","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:07.727426+0000","last_change":"2024-09-05T07:29:29.561333+0000","last_active":"2024-09-05T07:57:07.727426+0000","last_peered":"2024-09-05T07:57:07.727426+0000","last_clean":"2024-09-05T07:57:07.727426+0000","last_became_active":"2024-09-05T07:29:29.561065+0000","last_became_peered":"2024-09-05T07:29:29.561065+0000","last_unstale":"2024-09-05T07:57:07.727426+0000","last_undegraded":"2024-09-05T07:57:07.727426+0000","last_fullsized":"2024-09-05T07:57:07.727426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"24'45","reported_seq":73,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.321488+0000","last_change":"2024-09-05T07:29:30.566028+0000","last_active":"2024-09-05T07:57:10.321488+0000","last_peered":"2024-09-05T07:57:10.321488+0000","last_clean":"2024-09-05T07:57:10.321488+0000","last_became_active":"2024-09-05T07:29:30.565787+0000","last_became_peered":"2024-09-05T07:29:30.565787+0000","last_unstale":"2024-09-05T07:57:10.321488+0000","last_undegraded":"2024-09-05T07:57:10.321488+0000","last_fullsized":"2024-09-05T07:57:10.321488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":3021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"24'1204","reported_seq":1234,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:05.051024+0000","last_change":"2024-09-05T07:29:29.559969+0000","last_active":"2024-09-05T07:57:05.051024+0000","last_peered":"2024-09-05T07:57:05.051024+0000","last_clean":"2024-09-05T07:57:05.051024+0000","last_became_active":"2024-09-05T07:29:29.559675+0000","last_became_peered":"2024-09-05T07:29:29.559675+0000","last_unstale":"2024-09-05T07:57:05.051024+0000","last_undegraded":"2024-09-05T07:57:05.051024+0000","last_fullsized":"2024-09-05T07:57:05.051024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":1204,"log_dups_size":0,"ondisk_log_size":1204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1200,"num_write_kb":8869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"24'101","reported_seq":130,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.316956+0000","last_change":"2024-09-05T07:29:30.657369+0000","last_active":"2024-09-05T07:57:10.316956+0000","last_peered":"2024-09-05T07:57:10.316956+0000","last_clean":"2024-09-05T07:57:10.316956+0000","last_became_active":"2024-09-05T07:29:30.656876+0000","last_became_peered":"2024-09-05T07:29:30.656876+0000","last_unstale":"2024-09-05T07:57:10.316956+0000","last_undegraded":"2024-09-05T07:57:10.316956+0000","last_fullsized":"2024-09-05T07:57:10.316956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:09:22.026287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":8259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"24'716","reported_seq":747,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:56:58.419911+0000","last_change":"2024-09-05T07:29:29.567440+0000","last_active":"2024-09-05T07:56:58.419911+0000","last_peered":"2024-09-05T07:56:58.419911+0000","last_clean":"2024-09-05T07:56:58.419911+0000","last_became_active":"2024-09-05T07:29:29.567129+0000","last_became_peered":"2024-09-05T07:29:29.567129+0000","last_unstale":"2024-09-05T07:56:58.419911+0000","last_undegraded":"2024-09-05T07:56:58.419911+0000","last_fullsized":"2024-09-05T07:56:58.419911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:28.170849+0000","last_clean_scrub_stamp":"2024-09-05T07:29:28.170849+0000","objects_scrubbed":0,"log_size":716,"log_dups_size":0,"ondisk_log_size":716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:54:00.339029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":711,"num_write_kb":4517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"24'60","reported_seq":89,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.313108+0000","last_change":"2024-09-05T07:29:30.657929+0000","last_active":"2024-09-05T07:57:10.313108+0000","last_peered":"2024-09-05T07:57:10.313108+0000","last_clean":"2024-09-05T07:57:10.313108+0000","last_became_active":"2024-09-05T07:29:30.657625+0000","last_became_peered":"2024-09-05T07:29:30.657625+0000","last_unstale":"2024-09-05T07:57:10.313108+0000","last_undegraded":"2024-09-05T07:57:10.313108+0000","last_fullsized":"2024-09-05T07:57:10.313108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:37:46.507371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":2166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"24'594","reported_seq":634,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:25.514937+0000","last_change":"2024-09-05T07:57:25.514971+0000","last_active":"2024-09-05T07:57:25.514937+0000","last_peered":"2024-09-05T07:57:25.514937+0000","last_clean":"2024-09-05T07:57:25.514937+0000","last_became_active":"2024-09-05T07:29:29.525832+0000","last_became_peered":"2024-09-05T07:29:29.525832+0000","last_unstale":"2024-09-05T07:57:25.514937+0000","last_undegraded":"2024-09-05T07:57:25.514937+0000","last_fullsized":"2024-09-05T07:57:25.514937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'594","last_scrub_stamp":"2024-09-05T07:57:25.514845+0000","last_deep_scrub":"24'594","last_deep_scrub_stamp":"2024-09-05T07:57:25.514845+0000","last_clean_scrub_stamp":"2024-09-05T07:57:25.514845+0000","objects_scrubbed":7,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:20:29.961094+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3789,"num_write_kb":295314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4716,"ondisk_log_size":4716,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":37226760,"num_objects":107,"num_object_clones":0,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":869,"num_read_kb":916,"num_write":10472,"num_write_kb":41821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":74694656,"data_stored":74453520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8504,"ondisk_log_size":8504,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719477080,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61848,"kb_used_data":12616,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94309992,"statfs":{"total":96636764160,"available":96573431808,"internally_reserved":0,"allocated":12918784,"data_stored":12732533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509783,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35736,"kb_used_data":4552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94336104,"statfs":{"total":96636764160,"available":96600170496,"internally_reserved":0,"allocated":4661248,"data_stored":4466126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509783,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47156,"kb_used_data":15972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94324684,"statfs":{"total":96636764160,"available":96588476416,"internally_reserved":0,"allocated":16355328,"data_stored":16156262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509783,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47952,"kb_used_data":8448,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323888,"statfs":{"total":96636764160,"available":96587661312,"internally_reserved":0,"allocated":8650752,"data_stored":8478013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509782,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48536,"kb_used_data":9032,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323304,"statfs":{"total":96636764160,"available":96587063296,"internally_reserved":0,"allocated":9248768,"data_stored":9069055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509782,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47908,"kb_used_data":12564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323932,"statfs":{"total":96636764160,"available":96587706368,"internally_reserved":0,"allocated":12865536,"data_stored":12675287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542488,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43860,"kb_used_data":4356,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327980,"statfs":{"total":96636764160,"available":96591851520,"internally_reserved":0,"allocated":4460544,"data_stored":4286517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542487,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43828,"kb_used_data":8484,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94328012,"statfs":{"total":96636764160,"available":96591884288,"internally_reserved":0,"allocated":8687616,"data_stored":8479783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12619776,"data_stored":12586622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8409088,"data_stored":8390022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16109568,"data_stored":16067597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8441856,"data_stored":8391118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12079104,"data_stored":12053500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4214784,"data_stored":4197852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4415488,"data_stored":4377461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T07:57:27.113 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.114 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.114 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.114 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.114 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.114 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.114 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.114 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.115 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.115 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.115 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.115 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.115 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.115 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.115 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.115 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.115 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.116 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.116 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.116 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.116 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.116 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.116 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.116 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.116 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.117 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.117 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.117 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.117 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.117 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.117 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.117 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.117 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.118 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-09-05T07:29:28.170849+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.118 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.118 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-09-05T07:29:28.170849+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.118 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-09-05T07:29:28.170849+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.118 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.118 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-09-05T07:29:28.170849+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.118 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.119 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-09-05T07:29:28.170849+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.119 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.119 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-09-05T07:29:28.170849+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.119 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.119 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-09-05T07:29:28.170849+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.119 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.119 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-09-05T07:29:28.170849+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.119 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.120 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-09-05T07:29:28.170849+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.120 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.120 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-09-05T07:29:28.170849+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.120 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.120 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-09-05T07:29:28.170849+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.120 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.120 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-09-05T07:29:28.170849+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.120 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.121 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.121 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.121 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-09-05T07:29:28.170849+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.121 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.121 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-09-05T07:29:28.170849+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.121 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.121 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-05T07:29:10.874807+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=10, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.121 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-05T07:29:28.170849+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.122 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.122 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-05T07:29:28.170849+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.122 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.122 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-05T07:29:28.170849+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.122 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.122 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-05T07:29:28.170849+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.122 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.122 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-05T07:29:28.170849+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.123 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.123 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-05T07:29:28.170849+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.123 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.123 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-05T07:29:28.170849+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.123 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.123 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-05T07:29:28.170849+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.123 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.123 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-09-05T07:29:28.170849+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.124 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.124 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-09-05T07:29:28.170849+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.124 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.124 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-09-05T07:29:28.170849+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.124 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.124 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-09-05T07:29:28.170849+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.124 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.124 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.124 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-09-05T07:29:28.170849+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.125 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.125 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-09-05T07:29:28.170849+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.125 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.125 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-09-05T07:29:28.170849+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.125 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:27.125 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-05T07:57:41.050 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:57:41.053 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:57:47.126 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T07:57:47.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.232+0000 7fc38e7cd640 1 Processor -- start 2024-09-05T07:57:47.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.233+0000 7fc38e7cd640 1 -- start start 2024-09-05T07:57:47.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.233+0000 7fc38e7cd640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc388154770 0x7fc38815b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:47.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.233+0000 7fc38e7cd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc3880cafa0 0x7fc3880d05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:47.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.233+0000 7fc38e7cd640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc38806c8c0 con 0x7fc3880d0b00 2024-09-05T07:57:47.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.233+0000 7fc38e7cd640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fc3880c5310 con 0x7fc3880cafa0 2024-09-05T07:57:47.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.234+0000 7fc38e7cd640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fc3880cb950 con 0x7fc388154770 2024-09-05T07:57:47.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.234+0000 7fc3877fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc3880cafa0 0x7fc3880d05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:47.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.234+0000 7fc387fff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc388154770 0x7fc38815b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:47.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.235+0000 7fc387fff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc388154770 0x7fc38815b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:57000/0 (socket says 172.21.15.17:57000) 2024-09-05T07:57:47.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.235+0000 7fc387fff640 1 -- 172.21.15.17:0/4134607009 learned_addr learned my addr 172.21.15.17:0/4134607009 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:47.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.237+0000 7fc387fff640 1 -- 172.21.15.17:0/4134607009 >> v2:172.21.15.17:3300/0 conn(0x7fc3880cafa0 msgr2=0x7fc3880d05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:57:47.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.237+0000 7fc387fff640 1 --2- 172.21.15.17:0/4134607009 >> v2:172.21.15.17:3300/0 conn(0x7fc3880cafa0 0x7fc3880d05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:47.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.237+0000 7fc387fff640 1 -- 172.21.15.17:0/4134607009 >> v1:172.21.15.17:6789/0 conn(0x7fc3880d0b00 legacy=0x7fc3880c5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:47.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.237+0000 7fc387fff640 1 -- 172.21.15.17:0/4134607009 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc38806cb60 con 0x7fc388154770 2024-09-05T07:57:47.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.240+0000 7fc387fff640 1 --2- 172.21.15.17:0/4134607009 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc388154770 0x7fc38815b240 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc3880c5490 tx=0x7fc37802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=973b52f6129c43c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:47.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.244+0000 7fc386ffd640 1 -- 172.21.15.17:0/4134607009 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc378037070 con 0x7fc388154770 2024-09-05T07:57:47.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.244+0000 7fc386ffd640 1 -- 172.21.15.17:0/4134607009 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc378032440 con 0x7fc388154770 2024-09-05T07:57:47.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.244+0000 7fc386ffd640 1 -- 172.21.15.17:0/4134607009 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc378032810 con 0x7fc388154770 2024-09-05T07:57:47.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.245+0000 7fc38e7cd640 1 -- 172.21.15.17:0/4134607009 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc388154770 msgr2=0x7fc38815b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:47.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.245+0000 7fc38e7cd640 1 --2- 172.21.15.17:0/4134607009 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc388154770 0x7fc38815b240 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc3880c5490 tx=0x7fc37802a250 comp rx=0 tx=0).stop 2024-09-05T07:57:47.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.245+0000 7fc38e7cd640 1 -- 172.21.15.17:0/4134607009 shutdown_connections 2024-09-05T07:57:47.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.245+0000 7fc38e7cd640 1 --2- 172.21.15.17:0/4134607009 >> v2:172.21.15.17:3300/0 conn(0x7fc3880cafa0 0x7fc3880d05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:47.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.245+0000 7fc38e7cd640 1 --2- 172.21.15.17:0/4134607009 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc388154770 0x7fc38815b240 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:47.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.245+0000 7fc38e7cd640 1 -- 172.21.15.17:0/4134607009 >> 172.21.15.17:0/4134607009 conn(0x7fc388073710 msgr2=0x7fc388073b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:47.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.245+0000 7fc38e7cd640 1 -- 172.21.15.17:0/4134607009 shutdown_connections 2024-09-05T07:57:47.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.245+0000 7fc38e7cd640 1 -- 172.21.15.17:0/4134607009 wait complete. 2024-09-05T07:57:47.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.246+0000 7fc38e7cd640 1 Processor -- start 2024-09-05T07:57:47.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.246+0000 7fc38e7cd640 1 -- start start 2024-09-05T07:57:47.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.247+0000 7fc38e7cd640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc3880cafa0 0x7fc3881503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:47.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.247+0000 7fc38e7cd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3880d0b00 0x7fc3881e5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:47.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.247+0000 7fc38e7cd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc388154770 0x7fc3881f0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:47.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.247+0000 7fc38e7cd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc388154b50 con 0x7fc3880d0b00 2024-09-05T07:57:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.247+0000 7fc38e7cd640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc3880cbc30 con 0x7fc388154770 2024-09-05T07:57:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.247+0000 7fc38e7cd640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fc38806bca0 con 0x7fc3880cafa0 2024-09-05T07:57:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.247+0000 7fc3877fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3880d0b00 0x7fc3881e5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.248+0000 7fc387fff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc3880cafa0 0x7fc3881503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.248+0000 7fc3877fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3880d0b00 0x7fc3881e5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41428/0 (socket says 172.21.15.17:41428) 2024-09-05T07:57:47.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.248+0000 7fc3877fe640 1 -- 172.21.15.17:0/1876104217 learned_addr learned my addr 172.21.15.17:0/1876104217 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:57:47.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.248+0000 7fc38cd6a640 1 --2- 172.21.15.17:0/1876104217 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc388154770 0x7fc3881f0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:47.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.251+0000 7fc3877fe640 1 -- 172.21.15.17:0/1876104217 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc3880cafa0 msgr2=0x7fc3881503a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:47.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.251+0000 7fc3877fe640 1 --2- 172.21.15.17:0/1876104217 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc3880cafa0 0x7fc3881503a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:47.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.251+0000 7fc3877fe640 1 -- 172.21.15.17:0/1876104217 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc388154770 msgr2=0x7fc3881f0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:47.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.251+0000 7fc3877fe640 1 --2- 172.21.15.17:0/1876104217 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc388154770 0x7fc3881f0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:47.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.251+0000 7fc3877fe640 1 -- 172.21.15.17:0/1876104217 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3881f40f0 con 0x7fc3880d0b00 2024-09-05T07:57:47.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.253+0000 7fc3877fe640 1 --2- 172.21.15.17:0/1876104217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3880d0b00 0x7fc3881e5930 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc37c00e840 tx=0x7fc37c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:47.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.257+0000 7fc384ff9640 1 -- 172.21.15.17:0/1876104217 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37c017070 con 0x7fc3880d0b00 2024-09-05T07:57:47.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.257+0000 7fc384ff9640 1 -- 172.21.15.17:0/1876104217 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc37c00c940 con 0x7fc3880d0b00 2024-09-05T07:57:47.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.257+0000 7fc384ff9640 1 -- 172.21.15.17:0/1876104217 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37c00cd10 con 0x7fc3880d0b00 2024-09-05T07:57:47.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.257+0000 7fc38e7cd640 1 -- 172.21.15.17:0/1876104217 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3881f4390 con 0x7fc3880d0b00 2024-09-05T07:57:47.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.257+0000 7fc38e7cd640 1 -- 172.21.15.17:0/1876104217 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc388157e80 con 0x7fc3880d0b00 2024-09-05T07:57:47.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.258+0000 7fc38e7cd640 1 -- 172.21.15.17:0/1876104217 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3880d05c0 con 0x7fc3880d0b00 2024-09-05T07:57:47.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.277+0000 7fc384ff9640 1 -- 172.21.15.17:0/1876104217 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc37c01a070 con 0x7fc3880d0b00 2024-09-05T07:57:47.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.277+0000 7fc384ff9640 1 --2- 172.21.15.17:0/1876104217 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc37406be80 0x7fc37406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:57:47.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.278+0000 7fc387fff640 1 --2- 172.21.15.17:0/1876104217 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc37406be80 0x7fc37406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:57:47.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.278+0000 7fc387fff640 1 --2- 172.21.15.17:0/1876104217 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc37406be80 0x7fc37406e340 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc378034000 tx=0x7fc37802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:57:47.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.282+0000 7fc384ff9640 1 -- 172.21.15.17:0/1876104217 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7fc37c0577c0 con 0x7fc3880d0b00 2024-09-05T07:57:47.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.547+0000 7fc384ff9640 1 -- 172.21.15.17:0/1876104217 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc37c059720 con 0x7fc3880d0b00 2024-09-05T07:57:47.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.719+0000 7fc38e7cd640 1 -- 172.21.15.17:0/1876104217 --> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc3881e6ad0 con 0x7fc37406be80 2024-09-05T07:57:47.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.726+0000 7fc384ff9640 1 -- 172.21.15.17:0/1876104217 <== mgr.4099 v2:172.21.15.26:6800/2736912541 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253169 (secure 0 0 0) 0x7fc3881e6ad0 con 0x7fc37406be80 2024-09-05T07:57:47.730 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:57:47.732 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-05T07:57:47.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.729+0000 7fc38e7cd640 1 -- 172.21.15.17:0/1876104217 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc37406be80 msgr2=0x7fc37406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:47.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.729+0000 7fc38e7cd640 1 --2- 172.21.15.17:0/1876104217 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc37406be80 0x7fc37406e340 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc378034000 tx=0x7fc37802e000 comp rx=0 tx=0).stop 2024-09-05T07:57:47.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.729+0000 7fc38e7cd640 1 -- 172.21.15.17:0/1876104217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3880d0b00 msgr2=0x7fc3881e5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:57:47.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.729+0000 7fc38e7cd640 1 --2- 172.21.15.17:0/1876104217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3880d0b00 0x7fc3881e5930 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc37c00e840 tx=0x7fc37c00ed00 comp rx=0 tx=0).stop 2024-09-05T07:57:47.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.729+0000 7fc38e7cd640 1 -- 172.21.15.17:0/1876104217 shutdown_connections 2024-09-05T07:57:47.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.729+0000 7fc38e7cd640 1 --2- 172.21.15.17:0/1876104217 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fc37406be80 0x7fc37406e340 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:47.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.729+0000 7fc38e7cd640 1 --2- 172.21.15.17:0/1876104217 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc388154770 0x7fc3881f0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:47.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.729+0000 7fc38e7cd640 1 --2- 172.21.15.17:0/1876104217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3880d0b00 0x7fc3881e5930 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:47.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.729+0000 7fc38e7cd640 1 --2- 172.21.15.17:0/1876104217 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc3880cafa0 0x7fc3881503a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:57:47.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.729+0000 7fc38e7cd640 1 -- 172.21.15.17:0/1876104217 >> 172.21.15.17:0/1876104217 conn(0x7fc388073710 msgr2=0x7fc388158c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:57:47.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.729+0000 7fc38e7cd640 1 -- 172.21.15.17:0/1876104217 shutdown_connections 2024-09-05T07:57:47.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:57:47.729+0000 7fc38e7cd640 1 -- 172.21.15.17:0/1876104217 wait complete. 2024-09-05T07:57:47.741 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":876,"stamp":"2024-09-05T07:57:46.217395+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":37817128,"num_objects":109,"num_object_clones":0,"num_object_copies":218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":0,"num_read":985,"num_read_kb":1016,"num_write":14420,"num_write_kb":339551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13424,"ondisk_log_size":13424,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":376824,"kb_used_data":76024,"kb_used_omap":12,"kb_used_meta":300659,"kb_avail":754597896,"statfs":{"total":773094113280,"available":772708245504,"internally_reserved":0,"allocated":77848576,"data_stored":76343576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":307875377},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003314"},"pg_stats":[{"pgid":"3.3f","version":"24'52","reported_seq":84,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:32.500150+0000","last_change":"2024-09-05T07:57:32.500177+0000","last_active":"2024-09-05T07:57:32.500150+0000","last_peered":"2024-09-05T07:57:32.500150+0000","last_clean":"2024-09-05T07:57:32.500150+0000","last_became_active":"2024-09-05T07:30:02.494878+0000","last_became_peered":"2024-09-05T07:30:02.494878+0000","last_unstale":"2024-09-05T07:57:32.500150+0000","last_undegraded":"2024-09-05T07:57:32.500150+0000","last_fullsized":"2024-09-05T07:57:32.500150+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'52","last_scrub_stamp":"2024-09-05T07:57:32.500066+0000","last_deep_scrub":"24'52","last_deep_scrub_stamp":"2024-09-05T07:57:32.500066+0000","last_clean_scrub_stamp":"2024-09-05T07:57:32.500066+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:25:23.684553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":2980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"24'95","reported_seq":133,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:37.859102+0000","last_change":"2024-09-05T07:57:37.859125+0000","last_active":"2024-09-05T07:57:37.859102+0000","last_peered":"2024-09-05T07:57:37.859102+0000","last_clean":"2024-09-05T07:57:37.859102+0000","last_became_active":"2024-09-05T07:29:30.658225+0000","last_became_peered":"2024-09-05T07:29:30.658225+0000","last_unstale":"2024-09-05T07:57:37.859102+0000","last_undegraded":"2024-09-05T07:57:37.859102+0000","last_fullsized":"2024-09-05T07:57:37.859102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'95","last_scrub_stamp":"2024-09-05T07:57:37.859009+0000","last_deep_scrub":"24'95","last_deep_scrub_stamp":"2024-09-05T07:57:37.859009+0000","last_clean_scrub_stamp":"2024-09-05T07:57:37.859009+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:31:41.748244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":7017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"24'86","reported_seq":124,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:38.908535+0000","last_change":"2024-09-05T07:57:38.908563+0000","last_active":"2024-09-05T07:57:38.908535+0000","last_peered":"2024-09-05T07:57:38.908535+0000","last_clean":"2024-09-05T07:57:38.908535+0000","last_became_active":"2024-09-05T07:29:30.659042+0000","last_became_peered":"2024-09-05T07:29:30.659042+0000","last_unstale":"2024-09-05T07:57:38.908535+0000","last_undegraded":"2024-09-05T07:57:38.908535+0000","last_fullsized":"2024-09-05T07:57:38.908535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'86","last_scrub_stamp":"2024-09-05T07:57:38.908432+0000","last_deep_scrub":"24'86","last_deep_scrub_stamp":"2024-09-05T07:57:38.908432+0000","last_clean_scrub_stamp":"2024-09-05T07:57:38.908432+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:58:22.250905+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":4627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"24'50","reported_seq":89,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:23.938624+0000","last_change":"2024-09-05T07:57:23.938624+0000","last_active":"2024-09-05T07:57:23.938624+0000","last_peered":"2024-09-05T07:57:23.938624+0000","last_clean":"2024-09-05T07:57:23.938624+0000","last_became_active":"2024-09-05T07:29:30.640141+0000","last_became_peered":"2024-09-05T07:29:30.640141+0000","last_unstale":"2024-09-05T07:57:23.938624+0000","last_undegraded":"2024-09-05T07:57:23.938624+0000","last_fullsized":"2024-09-05T07:57:23.938624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'50","last_scrub_stamp":"2024-09-05T07:57:23.938531+0000","last_deep_scrub":"24'50","last_deep_scrub_stamp":"2024-09-05T07:57:23.938531+0000","last_clean_scrub_stamp":"2024-09-05T07:57:23.938531+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:59:52.665686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":3092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"24'51","reported_seq":87,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:36.474711+0000","last_change":"2024-09-05T07:57:36.474743+0000","last_active":"2024-09-05T07:57:36.474711+0000","last_peered":"2024-09-05T07:57:36.474711+0000","last_clean":"2024-09-05T07:57:36.474711+0000","last_became_active":"2024-09-05T07:29:30.658981+0000","last_became_peered":"2024-09-05T07:29:30.658981+0000","last_unstale":"2024-09-05T07:57:36.474711+0000","last_undegraded":"2024-09-05T07:57:36.474711+0000","last_fullsized":"2024-09-05T07:57:36.474711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'51","last_scrub_stamp":"2024-09-05T07:57:36.474628+0000","last_deep_scrub":"24'51","last_deep_scrub_stamp":"2024-09-05T07:57:36.474628+0000","last_clean_scrub_stamp":"2024-09-05T07:57:36.474628+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:15:18.385138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":3119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"24'102","reported_seq":138,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:25.979677+0000","last_change":"2024-09-05T07:57:25.979702+0000","last_active":"2024-09-05T07:57:25.979677+0000","last_peered":"2024-09-05T07:57:25.979677+0000","last_clean":"2024-09-05T07:57:25.979677+0000","last_became_active":"2024-09-05T07:29:30.641255+0000","last_became_peered":"2024-09-05T07:29:30.641255+0000","last_unstale":"2024-09-05T07:57:25.979677+0000","last_undegraded":"2024-09-05T07:57:25.979677+0000","last_fullsized":"2024-09-05T07:57:25.979677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'102","last_scrub_stamp":"2024-09-05T07:57:25.979602+0000","last_deep_scrub":"24'102","last_deep_scrub_stamp":"2024-09-05T07:57:25.979602+0000","last_clean_scrub_stamp":"2024-09-05T07:57:25.979602+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:25:19.377544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":5219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"24'87","reported_seq":123,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:27.439764+0000","last_change":"2024-09-05T07:57:27.439805+0000","last_active":"2024-09-05T07:57:27.439764+0000","last_peered":"2024-09-05T07:57:27.439764+0000","last_clean":"2024-09-05T07:57:27.439764+0000","last_became_active":"2024-09-05T07:29:30.555796+0000","last_became_peered":"2024-09-05T07:29:30.555796+0000","last_unstale":"2024-09-05T07:57:27.439764+0000","last_undegraded":"2024-09-05T07:57:27.439764+0000","last_fullsized":"2024-09-05T07:57:27.439764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'87","last_scrub_stamp":"2024-09-05T07:57:27.439662+0000","last_deep_scrub":"24'87","last_deep_scrub_stamp":"2024-09-05T07:57:27.439662+0000","last_clean_scrub_stamp":"2024-09-05T07:57:27.439662+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:10:08.044130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":6302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"24'64","reported_seq":100,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:39.939575+0000","last_change":"2024-09-05T07:57:39.939601+0000","last_active":"2024-09-05T07:57:39.939575+0000","last_peered":"2024-09-05T07:57:39.939575+0000","last_clean":"2024-09-05T07:57:39.939575+0000","last_became_active":"2024-09-05T07:29:30.659070+0000","last_became_peered":"2024-09-05T07:29:30.659070+0000","last_unstale":"2024-09-05T07:57:39.939575+0000","last_undegraded":"2024-09-05T07:57:39.939575+0000","last_fullsized":"2024-09-05T07:57:39.939575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'64","last_scrub_stamp":"2024-09-05T07:57:39.939475+0000","last_deep_scrub":"24'64","last_deep_scrub_stamp":"2024-09-05T07:57:39.939475+0000","last_clean_scrub_stamp":"2024-09-05T07:57:39.939475+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:00:12.338605+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"24'73","reported_seq":109,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:25.257251+0000","last_change":"2024-09-05T07:57:25.257301+0000","last_active":"2024-09-05T07:57:25.257251+0000","last_peered":"2024-09-05T07:57:25.257251+0000","last_clean":"2024-09-05T07:57:25.257251+0000","last_became_active":"2024-09-05T07:29:30.565408+0000","last_became_peered":"2024-09-05T07:29:30.565408+0000","last_unstale":"2024-09-05T07:57:25.257251+0000","last_undegraded":"2024-09-05T07:57:25.257251+0000","last_fullsized":"2024-09-05T07:57:25.257251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'73","last_scrub_stamp":"2024-09-05T07:57:25.257127+0000","last_deep_scrub":"24'73","last_deep_scrub_stamp":"2024-09-05T07:57:25.257127+0000","last_clean_scrub_stamp":"2024-09-05T07:57:25.257127+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:33:18.691763+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":5244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"24'70","reported_seq":106,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:35.488064+0000","last_change":"2024-09-05T07:57:35.488087+0000","last_active":"2024-09-05T07:57:35.488064+0000","last_peered":"2024-09-05T07:57:35.488064+0000","last_clean":"2024-09-05T07:57:35.488064+0000","last_became_active":"2024-09-05T07:29:30.643587+0000","last_became_peered":"2024-09-05T07:29:30.643587+0000","last_unstale":"2024-09-05T07:57:35.488064+0000","last_undegraded":"2024-09-05T07:57:35.488064+0000","last_fullsized":"2024-09-05T07:57:35.488064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'70","last_scrub_stamp":"2024-09-05T07:57:35.487975+0000","last_deep_scrub":"24'70","last_deep_scrub_stamp":"2024-09-05T07:57:35.487975+0000","last_clean_scrub_stamp":"2024-09-05T07:57:35.487975+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:16:51.606266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":1781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"24'68","reported_seq":104,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:28.457961+0000","last_change":"2024-09-05T07:57:28.457996+0000","last_active":"2024-09-05T07:57:28.457961+0000","last_peered":"2024-09-05T07:57:28.457961+0000","last_clean":"2024-09-05T07:57:28.457961+0000","last_became_active":"2024-09-05T07:29:30.557039+0000","last_became_peered":"2024-09-05T07:29:30.557039+0000","last_unstale":"2024-09-05T07:57:28.457961+0000","last_undegraded":"2024-09-05T07:57:28.457961+0000","last_fullsized":"2024-09-05T07:57:28.457961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'68","last_scrub_stamp":"2024-09-05T07:57:28.457888+0000","last_deep_scrub":"24'68","last_deep_scrub_stamp":"2024-09-05T07:57:28.457888+0000","last_clean_scrub_stamp":"2024-09-05T07:57:28.457888+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:01:54.579747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"24'49","reported_seq":85,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:31.497859+0000","last_change":"2024-09-05T07:57:31.497882+0000","last_active":"2024-09-05T07:57:31.497859+0000","last_peered":"2024-09-05T07:57:31.497859+0000","last_clean":"2024-09-05T07:57:31.497859+0000","last_became_active":"2024-09-05T07:29:30.564271+0000","last_became_peered":"2024-09-05T07:29:30.564271+0000","last_unstale":"2024-09-05T07:57:31.497859+0000","last_undegraded":"2024-09-05T07:57:31.497859+0000","last_fullsized":"2024-09-05T07:57:31.497859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'49","last_scrub_stamp":"2024-09-05T07:57:31.497779+0000","last_deep_scrub":"24'49","last_deep_scrub_stamp":"2024-09-05T07:57:31.497779+0000","last_clean_scrub_stamp":"2024-09-05T07:57:31.497779+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:28:10.863512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":2250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"24'77","reported_seq":113,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:29.373004+0000","last_change":"2024-09-05T07:57:29.373040+0000","last_active":"2024-09-05T07:57:29.373004+0000","last_peered":"2024-09-05T07:57:29.373004+0000","last_clean":"2024-09-05T07:57:29.373004+0000","last_became_active":"2024-09-05T07:29:30.631588+0000","last_became_peered":"2024-09-05T07:29:30.631588+0000","last_unstale":"2024-09-05T07:57:29.373004+0000","last_undegraded":"2024-09-05T07:57:29.373004+0000","last_fullsized":"2024-09-05T07:57:29.373004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'77","last_scrub_stamp":"2024-09-05T07:57:29.372909+0000","last_deep_scrub":"24'77","last_deep_scrub_stamp":"2024-09-05T07:57:29.372909+0000","last_clean_scrub_stamp":"2024-09-05T07:57:29.372909+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:33:02.016733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"24'67","reported_seq":104,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:32.425864+0000","last_change":"2024-09-05T07:57:32.425889+0000","last_active":"2024-09-05T07:57:32.425864+0000","last_peered":"2024-09-05T07:57:32.425864+0000","last_clean":"2024-09-05T07:57:32.425864+0000","last_became_active":"2024-09-05T07:29:30.632528+0000","last_became_peered":"2024-09-05T07:29:30.632528+0000","last_unstale":"2024-09-05T07:57:32.425864+0000","last_undegraded":"2024-09-05T07:57:32.425864+0000","last_fullsized":"2024-09-05T07:57:32.425864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'67","last_scrub_stamp":"2024-09-05T07:57:32.425778+0000","last_deep_scrub":"24'67","last_deep_scrub_stamp":"2024-09-05T07:57:32.425778+0000","last_clean_scrub_stamp":"2024-09-05T07:57:32.425778+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:05:26.285452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":4207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"24'87","reported_seq":124,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:31.799955+0000","last_change":"2024-09-05T07:57:31.799955+0000","last_active":"2024-09-05T07:57:31.799955+0000","last_peered":"2024-09-05T07:57:31.799955+0000","last_clean":"2024-09-05T07:57:31.799955+0000","last_became_active":"2024-09-05T07:29:30.656997+0000","last_became_peered":"2024-09-05T07:29:30.656997+0000","last_unstale":"2024-09-05T07:57:31.799955+0000","last_undegraded":"2024-09-05T07:57:31.799955+0000","last_fullsized":"2024-09-05T07:57:31.799955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'87","last_scrub_stamp":"2024-09-05T07:57:31.799829+0000","last_deep_scrub":"24'87","last_deep_scrub_stamp":"2024-09-05T07:57:31.799829+0000","last_clean_scrub_stamp":"2024-09-05T07:57:31.799829+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:16:20.255930+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"24'76","reported_seq":113,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:39.857429+0000","last_change":"2024-09-05T07:57:39.857454+0000","last_active":"2024-09-05T07:57:39.857429+0000","last_peered":"2024-09-05T07:57:39.857429+0000","last_clean":"2024-09-05T07:57:39.857429+0000","last_became_active":"2024-09-05T07:29:30.641283+0000","last_became_peered":"2024-09-05T07:29:30.641283+0000","last_unstale":"2024-09-05T07:57:39.857429+0000","last_undegraded":"2024-09-05T07:57:39.857429+0000","last_fullsized":"2024-09-05T07:57:39.857429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'76","last_scrub_stamp":"2024-09-05T07:57:39.857327+0000","last_deep_scrub":"24'76","last_deep_scrub_stamp":"2024-09-05T07:57:39.857327+0000","last_clean_scrub_stamp":"2024-09-05T07:57:39.857327+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:17:52.923159+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"24'92","reported_seq":129,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:26.912048+0000","last_change":"2024-09-05T07:57:26.912048+0000","last_active":"2024-09-05T07:57:26.912048+0000","last_peered":"2024-09-05T07:57:26.912048+0000","last_clean":"2024-09-05T07:57:26.912048+0000","last_became_active":"2024-09-05T07:29:30.558105+0000","last_became_peered":"2024-09-05T07:29:30.558105+0000","last_unstale":"2024-09-05T07:57:26.912048+0000","last_undegraded":"2024-09-05T07:57:26.912048+0000","last_fullsized":"2024-09-05T07:57:26.912048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'92","last_scrub_stamp":"2024-09-05T07:57:26.911890+0000","last_deep_scrub":"24'92","last_deep_scrub_stamp":"2024-09-05T07:57:26.911890+0000","last_clean_scrub_stamp":"2024-09-05T07:57:26.911890+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:46:19.449549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":4227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"24'95","reported_seq":132,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:31.461592+0000","last_change":"2024-09-05T07:57:31.461592+0000","last_active":"2024-09-05T07:57:31.461592+0000","last_peered":"2024-09-05T07:57:31.461592+0000","last_clean":"2024-09-05T07:57:31.461592+0000","last_became_active":"2024-09-05T07:29:30.642876+0000","last_became_peered":"2024-09-05T07:29:30.642876+0000","last_unstale":"2024-09-05T07:57:31.461592+0000","last_undegraded":"2024-09-05T07:57:31.461592+0000","last_fullsized":"2024-09-05T07:57:31.461592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'95","last_scrub_stamp":"2024-09-05T07:57:31.461488+0000","last_deep_scrub":"24'95","last_deep_scrub_stamp":"2024-09-05T07:57:31.461488+0000","last_clean_scrub_stamp":"2024-09-05T07:57:31.461488+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:24:10.914726+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":9001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"24'66","reported_seq":103,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:23.894157+0000","last_change":"2024-09-05T07:57:23.894183+0000","last_active":"2024-09-05T07:57:23.894157+0000","last_peered":"2024-09-05T07:57:23.894157+0000","last_clean":"2024-09-05T07:57:23.894157+0000","last_became_active":"2024-09-05T07:29:30.556969+0000","last_became_peered":"2024-09-05T07:29:30.556969+0000","last_unstale":"2024-09-05T07:57:23.894157+0000","last_undegraded":"2024-09-05T07:57:23.894157+0000","last_fullsized":"2024-09-05T07:57:23.894157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'66","last_scrub_stamp":"2024-09-05T07:57:23.894068+0000","last_deep_scrub":"24'66","last_deep_scrub_stamp":"2024-09-05T07:57:23.894068+0000","last_clean_scrub_stamp":"2024-09-05T07:57:23.894068+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:42:59.867698+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":2884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"24'78","reported_seq":115,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:30.459151+0000","last_change":"2024-09-05T07:57:30.459175+0000","last_active":"2024-09-05T07:57:30.459151+0000","last_peered":"2024-09-05T07:57:30.459151+0000","last_clean":"2024-09-05T07:57:30.459151+0000","last_became_active":"2024-09-05T07:29:30.563808+0000","last_became_peered":"2024-09-05T07:29:30.563808+0000","last_unstale":"2024-09-05T07:57:30.459151+0000","last_undegraded":"2024-09-05T07:57:30.459151+0000","last_fullsized":"2024-09-05T07:57:30.459151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'78","last_scrub_stamp":"2024-09-05T07:57:30.459061+0000","last_deep_scrub":"24'78","last_deep_scrub_stamp":"2024-09-05T07:57:30.459061+0000","last_clean_scrub_stamp":"2024-09-05T07:57:30.459061+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:39:41.583547+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":5103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"24'109","reported_seq":146,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:35.628973+0000","last_change":"2024-09-05T07:57:35.629043+0000","last_active":"2024-09-05T07:57:35.628973+0000","last_peered":"2024-09-05T07:57:35.628973+0000","last_clean":"2024-09-05T07:57:35.628973+0000","last_became_active":"2024-09-05T07:29:30.643559+0000","last_became_peered":"2024-09-05T07:29:30.643559+0000","last_unstale":"2024-09-05T07:57:35.628973+0000","last_undegraded":"2024-09-05T07:57:35.628973+0000","last_fullsized":"2024-09-05T07:57:35.628973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'109","last_scrub_stamp":"2024-09-05T07:57:35.628868+0000","last_deep_scrub":"24'109","last_deep_scrub_stamp":"2024-09-05T07:57:35.628868+0000","last_clean_scrub_stamp":"2024-09-05T07:57:35.628868+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:42.944534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":8204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"24'68","reported_seq":105,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:24.253974+0000","last_change":"2024-09-05T07:57:24.254011+0000","last_active":"2024-09-05T07:57:24.253974+0000","last_peered":"2024-09-05T07:57:24.253974+0000","last_clean":"2024-09-05T07:57:24.253974+0000","last_became_active":"2024-09-05T07:29:30.564669+0000","last_became_peered":"2024-09-05T07:29:30.564669+0000","last_unstale":"2024-09-05T07:57:24.253974+0000","last_undegraded":"2024-09-05T07:57:24.253974+0000","last_fullsized":"2024-09-05T07:57:24.253974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'68","last_scrub_stamp":"2024-09-05T07:57:24.253885+0000","last_deep_scrub":"24'68","last_deep_scrub_stamp":"2024-09-05T07:57:24.253885+0000","last_clean_scrub_stamp":"2024-09-05T07:57:24.253885+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:03:17.647323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":2069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"24'75","reported_seq":112,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:30.783695+0000","last_change":"2024-09-05T07:57:30.783741+0000","last_active":"2024-09-05T07:57:30.783695+0000","last_peered":"2024-09-05T07:57:30.783695+0000","last_clean":"2024-09-05T07:57:30.783695+0000","last_became_active":"2024-09-05T07:29:30.656451+0000","last_became_peered":"2024-09-05T07:29:30.656451+0000","last_unstale":"2024-09-05T07:57:30.783695+0000","last_undegraded":"2024-09-05T07:57:30.783695+0000","last_fullsized":"2024-09-05T07:57:30.783695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'75","last_scrub_stamp":"2024-09-05T07:57:30.783571+0000","last_deep_scrub":"24'75","last_deep_scrub_stamp":"2024-09-05T07:57:30.783571+0000","last_clean_scrub_stamp":"2024-09-05T07:57:30.783571+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:43:06.757200+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":3632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"24'60","reported_seq":89,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.293137+0000","last_change":"2024-09-05T07:29:30.658481+0000","last_active":"2024-09-05T07:57:10.293137+0000","last_peered":"2024-09-05T07:57:10.293137+0000","last_clean":"2024-09-05T07:57:10.293137+0000","last_became_active":"2024-09-05T07:29:30.658207+0000","last_became_peered":"2024-09-05T07:29:30.658207+0000","last_unstale":"2024-09-05T07:57:10.293137+0000","last_undegraded":"2024-09-05T07:57:10.293137+0000","last_fullsized":"2024-09-05T07:57:10.293137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":3656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"24'76","reported_seq":114,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:36.838769+0000","last_change":"2024-09-05T07:57:36.838769+0000","last_active":"2024-09-05T07:57:36.838769+0000","last_peered":"2024-09-05T07:57:36.838769+0000","last_clean":"2024-09-05T07:57:36.838769+0000","last_became_active":"2024-09-05T07:29:30.657177+0000","last_became_peered":"2024-09-05T07:29:30.657177+0000","last_unstale":"2024-09-05T07:57:36.838769+0000","last_undegraded":"2024-09-05T07:57:36.838769+0000","last_fullsized":"2024-09-05T07:57:36.838769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'76","last_scrub_stamp":"2024-09-05T07:57:36.838651+0000","last_deep_scrub":"24'76","last_deep_scrub_stamp":"2024-09-05T07:57:36.838651+0000","last_clean_scrub_stamp":"2024-09-05T07:57:36.838651+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:28:16.204384+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":7413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"24'76","reported_seq":114,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:30.022364+0000","last_change":"2024-09-05T07:57:30.022364+0000","last_active":"2024-09-05T07:57:30.022364+0000","last_peered":"2024-09-05T07:57:30.022364+0000","last_clean":"2024-09-05T07:57:30.022364+0000","last_became_active":"2024-09-05T07:29:30.641834+0000","last_became_peered":"2024-09-05T07:29:30.641834+0000","last_unstale":"2024-09-05T07:57:30.022364+0000","last_undegraded":"2024-09-05T07:57:30.022364+0000","last_fullsized":"2024-09-05T07:57:30.022364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'76","last_scrub_stamp":"2024-09-05T07:57:30.022252+0000","last_deep_scrub":"24'76","last_deep_scrub_stamp":"2024-09-05T07:57:30.022252+0000","last_clean_scrub_stamp":"2024-09-05T07:57:30.022252+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:02:51.707881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":3360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"24'83","reported_seq":121,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:33.423931+0000","last_change":"2024-09-05T07:57:33.423931+0000","last_active":"2024-09-05T07:57:33.423931+0000","last_peered":"2024-09-05T07:57:33.423931+0000","last_clean":"2024-09-05T07:57:33.423931+0000","last_became_active":"2024-09-05T07:29:30.633507+0000","last_became_peered":"2024-09-05T07:29:30.633507+0000","last_unstale":"2024-09-05T07:57:33.423931+0000","last_undegraded":"2024-09-05T07:57:33.423931+0000","last_fullsized":"2024-09-05T07:57:33.423931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'83","last_scrub_stamp":"2024-09-05T07:57:33.423826+0000","last_deep_scrub":"24'83","last_deep_scrub_stamp":"2024-09-05T07:57:33.423826+0000","last_clean_scrub_stamp":"2024-09-05T07:57:33.423826+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:36:12.958763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":5040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"24'50","reported_seq":88,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:31.434025+0000","last_change":"2024-09-05T07:57:31.434025+0000","last_active":"2024-09-05T07:57:31.434025+0000","last_peered":"2024-09-05T07:57:31.434025+0000","last_clean":"2024-09-05T07:57:31.434025+0000","last_became_active":"2024-09-05T07:29:30.632269+0000","last_became_peered":"2024-09-05T07:29:30.632269+0000","last_unstale":"2024-09-05T07:57:31.434025+0000","last_undegraded":"2024-09-05T07:57:31.434025+0000","last_fullsized":"2024-09-05T07:57:31.434025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'50","last_scrub_stamp":"2024-09-05T07:57:31.433866+0000","last_deep_scrub":"24'50","last_deep_scrub_stamp":"2024-09-05T07:57:31.433866+0000","last_clean_scrub_stamp":"2024-09-05T07:57:31.433866+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:37:01.245300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":6253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"24'73","reported_seq":111,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:29.799981+0000","last_change":"2024-09-05T07:57:29.800004+0000","last_active":"2024-09-05T07:57:29.799981+0000","last_peered":"2024-09-05T07:57:29.799981+0000","last_clean":"2024-09-05T07:57:29.799981+0000","last_became_active":"2024-09-05T07:29:30.656382+0000","last_became_peered":"2024-09-05T07:29:30.656382+0000","last_unstale":"2024-09-05T07:57:29.799981+0000","last_undegraded":"2024-09-05T07:57:29.799981+0000","last_fullsized":"2024-09-05T07:57:29.799981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'73","last_scrub_stamp":"2024-09-05T07:57:29.799892+0000","last_deep_scrub":"24'73","last_deep_scrub_stamp":"2024-09-05T07:57:29.799892+0000","last_clean_scrub_stamp":"2024-09-05T07:57:29.799892+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:09:01.558269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":7725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"24'117","reported_seq":147,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:10.298665+0000","last_change":"2024-09-05T07:29:30.657421+0000","last_active":"2024-09-05T07:57:10.298665+0000","last_peered":"2024-09-05T07:57:10.298665+0000","last_clean":"2024-09-05T07:57:10.298665+0000","last_became_active":"2024-09-05T07:29:30.657159+0000","last_became_peered":"2024-09-05T07:29:30.657159+0000","last_unstale":"2024-09-05T07:57:10.298665+0000","last_undegraded":"2024-09-05T07:57:10.298665+0000","last_fullsized":"2024-09-05T07:57:10.298665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":4986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"24'92","reported_seq":130,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:29.547761+0000","last_change":"2024-09-05T07:57:29.547788+0000","last_active":"2024-09-05T07:57:29.547761+0000","last_peered":"2024-09-05T07:57:29.547761+0000","last_clean":"2024-09-05T07:57:29.547761+0000","last_became_active":"2024-09-05T07:29:30.624605+0000","last_became_peered":"2024-09-05T07:29:30.624605+0000","last_unstale":"2024-09-05T07:57:29.547761+0000","last_undegraded":"2024-09-05T07:57:29.547761+0000","last_fullsized":"2024-09-05T07:57:29.547761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'92","last_scrub_stamp":"2024-09-05T07:57:29.547667+0000","last_deep_scrub":"24'92","last_deep_scrub_stamp":"2024-09-05T07:57:29.547667+0000","last_clean_scrub_stamp":"2024-09-05T07:57:29.547667+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:26:33.535477+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":7891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"24'80","reported_seq":118,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:28.056617+0000","last_change":"2024-09-05T07:57:28.056640+0000","last_active":"2024-09-05T07:57:28.056617+0000","last_peered":"2024-09-05T07:57:28.056617+0000","last_clean":"2024-09-05T07:57:28.056617+0000","last_became_active":"2024-09-05T07:29:30.642084+0000","last_became_peered":"2024-09-05T07:29:30.642084+0000","last_unstale":"2024-09-05T07:57:28.056617+0000","last_undegraded":"2024-09-05T07:57:28.056617+0000","last_fullsized":"2024-09-05T07:57:28.056617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'80","last_scrub_stamp":"2024-09-05T07:57:28.056542+0000","last_deep_scrub":"24'80","last_deep_scrub_stamp":"2024-09-05T07:57:28.056542+0000","last_clean_scrub_stamp":"2024-09-05T07:57:28.056542+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:25:19.241029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":4235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"24'60","reported_seq":96,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:27.276172+0000","last_change":"2024-09-05T07:57:27.276195+0000","last_active":"2024-09-05T07:57:27.276172+0000","last_peered":"2024-09-05T07:57:27.276172+0000","last_clean":"2024-09-05T07:57:27.276172+0000","last_became_active":"2024-09-05T07:29:30.657117+0000","last_became_peered":"2024-09-05T07:29:30.657117+0000","last_unstale":"2024-09-05T07:57:27.276172+0000","last_undegraded":"2024-09-05T07:57:27.276172+0000","last_fullsized":"2024-09-05T07:57:27.276172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'60","last_scrub_stamp":"2024-09-05T07:57:27.276093+0000","last_deep_scrub":"24'60","last_deep_scrub_stamp":"2024-09-05T07:57:27.276093+0000","last_clean_scrub_stamp":"2024-09-05T07:57:27.276093+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:44:52.571698+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":3534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"24'649","reported_seq":687,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:27.805468+0000","last_change":"2024-09-05T07:57:27.805515+0000","last_active":"2024-09-05T07:57:27.805468+0000","last_peered":"2024-09-05T07:57:27.805468+0000","last_clean":"2024-09-05T07:57:27.805468+0000","last_became_active":"2024-09-05T07:29:29.567846+0000","last_became_peered":"2024-09-05T07:29:29.567846+0000","last_unstale":"2024-09-05T07:57:27.805468+0000","last_undegraded":"2024-09-05T07:57:27.805468+0000","last_fullsized":"2024-09-05T07:57:27.805468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'649","last_scrub_stamp":"2024-09-05T07:57:27.805361+0000","last_deep_scrub":"24'649","last_deep_scrub_stamp":"2024-09-05T07:57:27.805361+0000","last_clean_scrub_stamp":"2024-09-05T07:57:27.805361+0000","objects_scrubbed":3,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:55:18.667411+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195510,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":639,"num_write_kb":4403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"24'89","reported_seq":125,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:29.575490+0000","last_change":"2024-09-05T07:57:29.575540+0000","last_active":"2024-09-05T07:57:29.575490+0000","last_peered":"2024-09-05T07:57:29.575490+0000","last_clean":"2024-09-05T07:57:29.575490+0000","last_became_active":"2024-09-05T07:29:30.557203+0000","last_became_peered":"2024-09-05T07:29:30.557203+0000","last_unstale":"2024-09-05T07:57:29.575490+0000","last_undegraded":"2024-09-05T07:57:29.575490+0000","last_fullsized":"2024-09-05T07:57:29.575490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'89","last_scrub_stamp":"2024-09-05T07:57:29.575356+0000","last_deep_scrub":"24'89","last_deep_scrub_stamp":"2024-09-05T07:57:29.575356+0000","last_clean_scrub_stamp":"2024-09-05T07:57:29.575356+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:14:42.985016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":6286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"24'602","reported_seq":640,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:30.872412+0000","last_change":"2024-09-05T07:57:30.872445+0000","last_active":"2024-09-05T07:57:30.872412+0000","last_peered":"2024-09-05T07:57:30.872412+0000","last_clean":"2024-09-05T07:57:30.872412+0000","last_became_active":"2024-09-05T07:29:29.524321+0000","last_became_peered":"2024-09-05T07:29:29.524321+0000","last_unstale":"2024-09-05T07:57:30.872412+0000","last_undegraded":"2024-09-05T07:57:30.872412+0000","last_fullsized":"2024-09-05T07:57:30.872412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'602","last_scrub_stamp":"2024-09-05T07:57:30.872328+0000","last_deep_scrub":"24'602","last_deep_scrub_stamp":"2024-09-05T07:57:30.872328+0000","last_clean_scrub_stamp":"2024-09-05T07:57:30.872328+0000","objects_scrubbed":4,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:58:14.214800+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"24'8","reported_seq":46,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:27.352100+0000","last_change":"2024-09-05T07:57:27.352131+0000","last_active":"2024-09-05T07:57:27.352100+0000","last_peered":"2024-09-05T07:57:27.352100+0000","last_clean":"2024-09-05T07:57:27.352100+0000","last_became_active":"2024-09-05T07:29:29.570456+0000","last_became_peered":"2024-09-05T07:29:29.570456+0000","last_unstale":"2024-09-05T07:57:27.352100+0000","last_undegraded":"2024-09-05T07:57:27.352100+0000","last_fullsized":"2024-09-05T07:57:27.352100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'8","last_scrub_stamp":"2024-09-05T07:57:27.352023+0000","last_deep_scrub":"24'8","last_deep_scrub_stamp":"2024-09-05T07:57:27.352023+0000","last_clean_scrub_stamp":"2024-09-05T07:57:27.352023+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:46:14.421308+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"24'84","reported_seq":120,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:32.801644+0000","last_change":"2024-09-05T07:57:32.801669+0000","last_active":"2024-09-05T07:57:32.801644+0000","last_peered":"2024-09-05T07:57:32.801644+0000","last_clean":"2024-09-05T07:57:32.801644+0000","last_became_active":"2024-09-05T07:29:30.657008+0000","last_became_peered":"2024-09-05T07:29:30.657008+0000","last_unstale":"2024-09-05T07:57:32.801644+0000","last_undegraded":"2024-09-05T07:57:32.801644+0000","last_fullsized":"2024-09-05T07:57:32.801644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'84","last_scrub_stamp":"2024-09-05T07:57:32.801543+0000","last_deep_scrub":"24'84","last_deep_scrub_stamp":"2024-09-05T07:57:32.801543+0000","last_clean_scrub_stamp":"2024-09-05T07:57:32.801543+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:52:08.741255+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":7830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"24'8","reported_seq":46,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:32.850082+0000","last_change":"2024-09-05T07:57:32.850182+0000","last_active":"2024-09-05T07:57:32.850082+0000","last_peered":"2024-09-05T07:57:32.850082+0000","last_clean":"2024-09-05T07:57:32.850082+0000","last_became_active":"2024-09-05T07:29:29.562520+0000","last_became_peered":"2024-09-05T07:29:29.562520+0000","last_unstale":"2024-09-05T07:57:32.850082+0000","last_undegraded":"2024-09-05T07:57:32.850082+0000","last_fullsized":"2024-09-05T07:57:32.850082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'8","last_scrub_stamp":"2024-09-05T07:57:32.849947+0000","last_deep_scrub":"24'8","last_deep_scrub_stamp":"2024-09-05T07:57:32.849947+0000","last_clean_scrub_stamp":"2024-09-05T07:57:32.849947+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:37:45.714232+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"24'88","reported_seq":124,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:30.601950+0000","last_change":"2024-09-05T07:57:30.601996+0000","last_active":"2024-09-05T07:57:30.601950+0000","last_peered":"2024-09-05T07:57:30.601950+0000","last_clean":"2024-09-05T07:57:30.601950+0000","last_became_active":"2024-09-05T07:29:30.562945+0000","last_became_peered":"2024-09-05T07:29:30.562945+0000","last_unstale":"2024-09-05T07:57:30.601950+0000","last_undegraded":"2024-09-05T07:57:30.601950+0000","last_fullsized":"2024-09-05T07:57:30.601950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'88","last_scrub_stamp":"2024-09-05T07:57:30.601825+0000","last_deep_scrub":"24'88","last_deep_scrub_stamp":"2024-09-05T07:57:30.601825+0000","last_clean_scrub_stamp":"2024-09-05T07:57:30.601825+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:18:02.325680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"24'15","reported_seq":53,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:23.243991+0000","last_change":"2024-09-05T07:57:23.244015+0000","last_active":"2024-09-05T07:57:23.243991+0000","last_peered":"2024-09-05T07:57:23.243991+0000","last_clean":"2024-09-05T07:57:23.243991+0000","last_became_active":"2024-09-05T07:29:29.558744+0000","last_became_peered":"2024-09-05T07:29:29.558744+0000","last_unstale":"2024-09-05T07:57:23.243991+0000","last_undegraded":"2024-09-05T07:57:23.243991+0000","last_fullsized":"2024-09-05T07:57:23.243991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'15","last_scrub_stamp":"2024-09-05T07:57:23.243924+0000","last_deep_scrub":"24'15","last_deep_scrub_stamp":"2024-09-05T07:57:23.243924+0000","last_clean_scrub_stamp":"2024-09-05T07:57:23.243924+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:42:29.701541+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"24'98","reported_seq":134,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:27.013551+0000","last_change":"2024-09-05T07:57:27.013577+0000","last_active":"2024-09-05T07:57:27.013551+0000","last_peered":"2024-09-05T07:57:27.013551+0000","last_clean":"2024-09-05T07:57:27.013551+0000","last_became_active":"2024-09-05T07:29:30.641360+0000","last_became_peered":"2024-09-05T07:29:30.641360+0000","last_unstale":"2024-09-05T07:57:27.013551+0000","last_undegraded":"2024-09-05T07:57:27.013551+0000","last_fullsized":"2024-09-05T07:57:27.013551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'98","last_scrub_stamp":"2024-09-05T07:57:27.013469+0000","last_deep_scrub":"24'98","last_deep_scrub_stamp":"2024-09-05T07:57:27.013469+0000","last_clean_scrub_stamp":"2024-09-05T07:57:27.013469+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:44:52.309074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":5807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"24'10","reported_seq":48,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:24.510047+0000","last_change":"2024-09-05T07:57:24.510091+0000","last_active":"2024-09-05T07:57:24.510047+0000","last_peered":"2024-09-05T07:57:24.510047+0000","last_clean":"2024-09-05T07:57:24.510047+0000","last_became_active":"2024-09-05T07:29:29.559717+0000","last_became_peered":"2024-09-05T07:29:29.559717+0000","last_unstale":"2024-09-05T07:57:24.510047+0000","last_undegraded":"2024-09-05T07:57:24.510047+0000","last_fullsized":"2024-09-05T07:57:24.510047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'10","last_scrub_stamp":"2024-09-05T07:57:24.509935+0000","last_deep_scrub":"24'10","last_deep_scrub_stamp":"2024-09-05T07:57:24.509935+0000","last_clean_scrub_stamp":"2024-09-05T07:57:24.509935+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:13:21.596151+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"24'57","reported_seq":93,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:34.824294+0000","last_change":"2024-09-05T07:57:34.824325+0000","last_active":"2024-09-05T07:57:34.824294+0000","last_peered":"2024-09-05T07:57:34.824294+0000","last_clean":"2024-09-05T07:57:34.824294+0000","last_became_active":"2024-09-05T07:29:30.657038+0000","last_became_peered":"2024-09-05T07:29:30.657038+0000","last_unstale":"2024-09-05T07:57:34.824294+0000","last_undegraded":"2024-09-05T07:57:34.824294+0000","last_fullsized":"2024-09-05T07:57:34.824294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'57","last_scrub_stamp":"2024-09-05T07:57:34.824190+0000","last_deep_scrub":"24'57","last_deep_scrub_stamp":"2024-09-05T07:57:34.824190+0000","last_clean_scrub_stamp":"2024-09-05T07:57:34.824190+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:50:49.770438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":3450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"24'616","reported_seq":654,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:26.538566+0000","last_change":"2024-09-05T07:57:26.538618+0000","last_active":"2024-09-05T07:57:26.538566+0000","last_peered":"2024-09-05T07:57:26.538566+0000","last_clean":"2024-09-05T07:57:26.538566+0000","last_became_active":"2024-09-05T07:29:29.566501+0000","last_became_peered":"2024-09-05T07:29:29.566501+0000","last_unstale":"2024-09-05T07:57:26.538566+0000","last_undegraded":"2024-09-05T07:57:26.538566+0000","last_fullsized":"2024-09-05T07:57:26.538566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'616","last_scrub_stamp":"2024-09-05T07:57:26.538461+0000","last_deep_scrub":"24'616","last_deep_scrub_stamp":"2024-09-05T07:57:26.538461+0000","last_clean_scrub_stamp":"2024-09-05T07:57:26.538461+0000","objects_scrubbed":4,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:33:38.471672+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":613,"num_write_kb":614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"24'72","reported_seq":101,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:23.159520+0000","last_change":"2024-09-05T07:29:30.642252+0000","last_active":"2024-09-05T07:57:23.159520+0000","last_peered":"2024-09-05T07:57:23.159520+0000","last_clean":"2024-09-05T07:57:23.159520+0000","last_became_active":"2024-09-05T07:29:30.641991+0000","last_became_peered":"2024-09-05T07:29:30.641991+0000","last_unstale":"2024-09-05T07:57:23.159520+0000","last_undegraded":"2024-09-05T07:57:23.159520+0000","last_fullsized":"2024-09-05T07:57:23.159520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T07:29:29.311033+0000","last_clean_scrub_stamp":"2024-09-05T07:29:29.311033+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":2982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"24'837","reported_seq":876,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:22.971983+0000","last_change":"2024-09-05T07:57:22.971983+0000","last_active":"2024-09-05T07:57:22.971983+0000","last_peered":"2024-09-05T07:57:22.971983+0000","last_clean":"2024-09-05T07:57:22.971983+0000","last_became_active":"2024-09-05T07:29:29.562136+0000","last_became_peered":"2024-09-05T07:29:29.562136+0000","last_unstale":"2024-09-05T07:57:22.971983+0000","last_undegraded":"2024-09-05T07:57:22.971983+0000","last_fullsized":"2024-09-05T07:57:22.971983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'837","last_scrub_stamp":"2024-09-05T07:57:22.971866+0000","last_deep_scrub":"24'837","last_deep_scrub_stamp":"2024-09-05T07:57:22.971866+0000","last_clean_scrub_stamp":"2024-09-05T07:57:22.971866+0000","objects_scrubbed":6,"log_size":837,"log_dups_size":0,"ondisk_log_size":837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:46:11.796235+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":830,"num_write_kb":4536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"24'66","reported_seq":102,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:33.458942+0000","last_change":"2024-09-05T07:57:33.458983+0000","last_active":"2024-09-05T07:57:33.458942+0000","last_peered":"2024-09-05T07:57:33.458942+0000","last_clean":"2024-09-05T07:57:33.458942+0000","last_became_active":"2024-09-05T07:29:30.632784+0000","last_became_peered":"2024-09-05T07:29:30.632784+0000","last_unstale":"2024-09-05T07:57:33.458942+0000","last_undegraded":"2024-09-05T07:57:33.458942+0000","last_fullsized":"2024-09-05T07:57:33.458942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'66","last_scrub_stamp":"2024-09-05T07:57:33.458860+0000","last_deep_scrub":"24'66","last_deep_scrub_stamp":"2024-09-05T07:57:33.458860+0000","last_clean_scrub_stamp":"2024-09-05T07:57:33.458860+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:58:16.801333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":3605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'20","reported_seq":59,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:27.573326+0000","last_change":"2024-09-05T07:57:27.573326+0000","last_active":"2024-09-05T07:57:27.573326+0000","last_peered":"2024-09-05T07:57:27.573326+0000","last_clean":"2024-09-05T07:57:27.573326+0000","last_became_active":"2024-09-05T07:29:29.566934+0000","last_became_peered":"2024-09-05T07:29:29.566934+0000","last_unstale":"2024-09-05T07:57:27.573326+0000","last_undegraded":"2024-09-05T07:57:27.573326+0000","last_fullsized":"2024-09-05T07:57:27.573326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'20","last_scrub_stamp":"2024-09-05T07:57:27.573210+0000","last_deep_scrub":"24'20","last_deep_scrub_stamp":"2024-09-05T07:57:27.573210+0000","last_clean_scrub_stamp":"2024-09-05T07:57:27.573210+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:03:20.966648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"24'76","reported_seq":113,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:30.415157+0000","last_change":"2024-09-05T07:57:30.415157+0000","last_active":"2024-09-05T07:57:30.415157+0000","last_peered":"2024-09-05T07:57:30.415157+0000","last_clean":"2024-09-05T07:57:30.415157+0000","last_became_active":"2024-09-05T07:29:30.631974+0000","last_became_peered":"2024-09-05T07:29:30.631974+0000","last_unstale":"2024-09-05T07:57:30.415157+0000","last_undegraded":"2024-09-05T07:57:30.415157+0000","last_fullsized":"2024-09-05T07:57:30.415157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'76","last_scrub_stamp":"2024-09-05T07:57:30.415029+0000","last_deep_scrub":"24'76","last_deep_scrub_stamp":"2024-09-05T07:57:30.415029+0000","last_clean_scrub_stamp":"2024-09-05T07:57:30.415029+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:32:42.635981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"24'13","reported_seq":52,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:35.842659+0000","last_change":"2024-09-05T07:57:35.842687+0000","last_active":"2024-09-05T07:57:35.842659+0000","last_peered":"2024-09-05T07:57:35.842659+0000","last_clean":"2024-09-05T07:57:35.842659+0000","last_became_active":"2024-09-05T07:29:29.566754+0000","last_became_peered":"2024-09-05T07:29:29.566754+0000","last_unstale":"2024-09-05T07:57:35.842659+0000","last_undegraded":"2024-09-05T07:57:35.842659+0000","last_fullsized":"2024-09-05T07:57:35.842659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'13","last_scrub_stamp":"2024-09-05T07:57:35.842576+0000","last_deep_scrub":"24'13","last_deep_scrub_stamp":"2024-09-05T07:57:35.842576+0000","last_clean_scrub_stamp":"2024-09-05T07:57:35.842576+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:51:46.302451+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"24'97","reported_seq":134,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:36.840436+0000","last_change":"2024-09-05T07:57:36.840482+0000","last_active":"2024-09-05T07:57:36.840436+0000","last_peered":"2024-09-05T07:57:36.840436+0000","last_clean":"2024-09-05T07:57:36.840436+0000","last_became_active":"2024-09-05T07:29:30.558179+0000","last_became_peered":"2024-09-05T07:29:30.558179+0000","last_unstale":"2024-09-05T07:57:36.840436+0000","last_undegraded":"2024-09-05T07:57:36.840436+0000","last_fullsized":"2024-09-05T07:57:36.840436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'97","last_scrub_stamp":"2024-09-05T07:57:36.840327+0000","last_deep_scrub":"24'97","last_deep_scrub_stamp":"2024-09-05T07:57:36.840327+0000","last_clean_scrub_stamp":"2024-09-05T07:57:36.840327+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:16:16.764033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":15470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"24'12","reported_seq":51,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:22.554961+0000","last_change":"2024-09-05T07:57:22.554961+0000","last_active":"2024-09-05T07:57:22.554961+0000","last_peered":"2024-09-05T07:57:22.554961+0000","last_clean":"2024-09-05T07:57:22.554961+0000","last_became_active":"2024-09-05T07:29:29.525139+0000","last_became_peered":"2024-09-05T07:29:29.525139+0000","last_unstale":"2024-09-05T07:57:22.554961+0000","last_undegraded":"2024-09-05T07:57:22.554961+0000","last_fullsized":"2024-09-05T07:57:22.554961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'12","last_scrub_stamp":"2024-09-05T07:57:22.554806+0000","last_deep_scrub":"24'12","last_deep_scrub_stamp":"2024-09-05T07:57:22.554806+0000","last_clean_scrub_stamp":"2024-09-05T07:57:22.554806+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:21:10.839197+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1172,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"24'53","reported_seq":90,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:28.250327+0000","last_change":"2024-09-05T07:57:28.250327+0000","last_active":"2024-09-05T07:57:28.250327+0000","last_peered":"2024-09-05T07:57:28.250327+0000","last_clean":"2024-09-05T07:57:28.250327+0000","last_became_active":"2024-09-05T07:29:30.659311+0000","last_became_peered":"2024-09-05T07:29:30.659311+0000","last_unstale":"2024-09-05T07:57:28.250327+0000","last_undegraded":"2024-09-05T07:57:28.250327+0000","last_fullsized":"2024-09-05T07:57:28.250327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'53","last_scrub_stamp":"2024-09-05T07:57:28.250172+0000","last_deep_scrub":"24'53","last_deep_scrub_stamp":"2024-09-05T07:57:28.250172+0000","last_clean_scrub_stamp":"2024-09-05T07:57:28.250172+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:49:19.066773+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":2804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"24'30","reported_seq":69,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:28.559813+0000","last_change":"2024-09-05T07:57:28.559813+0000","last_active":"2024-09-05T07:57:28.559813+0000","last_peered":"2024-09-05T07:57:28.559813+0000","last_clean":"2024-09-05T07:57:28.559813+0000","last_became_active":"2024-09-05T07:29:29.566503+0000","last_became_peered":"2024-09-05T07:29:29.566503+0000","last_unstale":"2024-09-05T07:57:28.559813+0000","last_undegraded":"2024-09-05T07:57:28.559813+0000","last_fullsized":"2024-09-05T07:57:28.559813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'30","last_scrub_stamp":"2024-09-05T07:57:28.559652+0000","last_deep_scrub":"24'30","last_deep_scrub_stamp":"2024-09-05T07:57:28.559652+0000","last_clean_scrub_stamp":"2024-09-05T07:57:28.559652+0000","objects_scrubbed":8,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:14:30.243682+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"24'65","reported_seq":102,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:40.880473+0000","last_change":"2024-09-05T07:57:40.880497+0000","last_active":"2024-09-05T07:57:40.880473+0000","last_peered":"2024-09-05T07:57:40.880473+0000","last_clean":"2024-09-05T07:57:40.880473+0000","last_became_active":"2024-09-05T07:29:30.641309+0000","last_became_peered":"2024-09-05T07:29:30.641309+0000","last_unstale":"2024-09-05T07:57:40.880473+0000","last_undegraded":"2024-09-05T07:57:40.880473+0000","last_fullsized":"2024-09-05T07:57:40.880473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'65","last_scrub_stamp":"2024-09-05T07:57:40.880389+0000","last_deep_scrub":"24'65","last_deep_scrub_stamp":"2024-09-05T07:57:40.880389+0000","last_clean_scrub_stamp":"2024-09-05T07:57:40.880389+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:51:48.318350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":5311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"24'8","reported_seq":47,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:21.584696+0000","last_change":"2024-09-05T07:57:21.584725+0000","last_active":"2024-09-05T07:57:21.584696+0000","last_peered":"2024-09-05T07:57:21.584696+0000","last_clean":"2024-09-05T07:57:21.584696+0000","last_became_active":"2024-09-05T07:29:29.524522+0000","last_became_peered":"2024-09-05T07:29:29.524522+0000","last_unstale":"2024-09-05T07:57:21.584696+0000","last_undegraded":"2024-09-05T07:57:21.584696+0000","last_fullsized":"2024-09-05T07:57:21.584696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'8","last_scrub_stamp":"2024-09-05T07:57:21.584620+0000","last_deep_scrub":"24'8","last_deep_scrub_stamp":"2024-09-05T07:57:21.584620+0000","last_clean_scrub_stamp":"2024-09-05T07:57:21.584620+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:25:12.769108+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"24'36","reported_seq":73,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:29.025194+0000","last_change":"2024-09-05T07:57:29.025217+0000","last_active":"2024-09-05T07:57:29.025194+0000","last_peered":"2024-09-05T07:57:29.025194+0000","last_clean":"2024-09-05T07:57:29.025194+0000","last_became_active":"2024-09-05T07:29:30.641774+0000","last_became_peered":"2024-09-05T07:29:30.641774+0000","last_unstale":"2024-09-05T07:57:29.025194+0000","last_undegraded":"2024-09-05T07:57:29.025194+0000","last_fullsized":"2024-09-05T07:57:29.025194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'36","last_scrub_stamp":"2024-09-05T07:57:29.025120+0000","last_deep_scrub":"24'36","last_deep_scrub_stamp":"2024-09-05T07:57:29.025120+0000","last_clean_scrub_stamp":"2024-09-05T07:57:29.025120+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:21:17.309511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"24'9","reported_seq":48,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:24.496483+0000","last_change":"2024-09-05T07:57:24.496520+0000","last_active":"2024-09-05T07:57:24.496483+0000","last_peered":"2024-09-05T07:57:24.496483+0000","last_clean":"2024-09-05T07:57:24.496483+0000","last_became_active":"2024-09-05T07:29:29.525044+0000","last_became_peered":"2024-09-05T07:29:29.525044+0000","last_unstale":"2024-09-05T07:57:24.496483+0000","last_undegraded":"2024-09-05T07:57:24.496483+0000","last_fullsized":"2024-09-05T07:57:24.496483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'9","last_scrub_stamp":"2024-09-05T07:57:24.496406+0000","last_deep_scrub":"24'9","last_deep_scrub_stamp":"2024-09-05T07:57:24.496406+0000","last_clean_scrub_stamp":"2024-09-05T07:57:24.496406+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:46:11.565692+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"24'52","reported_seq":89,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:29.464753+0000","last_change":"2024-09-05T07:57:29.464777+0000","last_active":"2024-09-05T07:57:29.464753+0000","last_peered":"2024-09-05T07:57:29.464753+0000","last_clean":"2024-09-05T07:57:29.464753+0000","last_became_active":"2024-09-05T07:29:30.563408+0000","last_became_peered":"2024-09-05T07:29:30.563408+0000","last_unstale":"2024-09-05T07:57:29.464753+0000","last_undegraded":"2024-09-05T07:57:29.464753+0000","last_fullsized":"2024-09-05T07:57:29.464753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'52","last_scrub_stamp":"2024-09-05T07:57:29.464665+0000","last_deep_scrub":"24'52","last_deep_scrub_stamp":"2024-09-05T07:57:29.464665+0000","last_clean_scrub_stamp":"2024-09-05T07:57:29.464665+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:37:11.861995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":3705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'7","reported_seq":46,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:25.809370+0000","last_change":"2024-09-05T07:57:25.809413+0000","last_active":"2024-09-05T07:57:25.809370+0000","last_peered":"2024-09-05T07:57:25.809370+0000","last_clean":"2024-09-05T07:57:25.809370+0000","last_became_active":"2024-09-05T07:29:29.558856+0000","last_became_peered":"2024-09-05T07:29:29.558856+0000","last_unstale":"2024-09-05T07:57:25.809370+0000","last_undegraded":"2024-09-05T07:57:25.809370+0000","last_fullsized":"2024-09-05T07:57:25.809370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'7","last_scrub_stamp":"2024-09-05T07:57:25.809250+0000","last_deep_scrub":"24'7","last_deep_scrub_stamp":"2024-09-05T07:57:25.809250+0000","last_clean_scrub_stamp":"2024-09-05T07:57:25.809250+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:25:16.993737+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"24'61","reported_seq":98,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:32.452006+0000","last_change":"2024-09-05T07:57:32.452049+0000","last_active":"2024-09-05T07:57:32.452006+0000","last_peered":"2024-09-05T07:57:32.452006+0000","last_clean":"2024-09-05T07:57:32.452006+0000","last_became_active":"2024-09-05T07:29:30.624057+0000","last_became_peered":"2024-09-05T07:29:30.624057+0000","last_unstale":"2024-09-05T07:57:32.452006+0000","last_undegraded":"2024-09-05T07:57:32.452006+0000","last_fullsized":"2024-09-05T07:57:32.452006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'61","last_scrub_stamp":"2024-09-05T07:57:32.451885+0000","last_deep_scrub":"24'61","last_deep_scrub_stamp":"2024-09-05T07:57:32.451885+0000","last_clean_scrub_stamp":"2024-09-05T07:57:32.451885+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:01:09.469203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":4070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"24'16","reported_seq":55,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:28.385265+0000","last_change":"2024-09-05T07:57:28.385296+0000","last_active":"2024-09-05T07:57:28.385265+0000","last_peered":"2024-09-05T07:57:28.385265+0000","last_clean":"2024-09-05T07:57:28.385265+0000","last_became_active":"2024-09-05T07:29:29.570478+0000","last_became_peered":"2024-09-05T07:29:29.570478+0000","last_unstale":"2024-09-05T07:57:28.385265+0000","last_undegraded":"2024-09-05T07:57:28.385265+0000","last_fullsized":"2024-09-05T07:57:28.385265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'16","last_scrub_stamp":"2024-09-05T07:57:28.385191+0000","last_deep_scrub":"24'16","last_deep_scrub_stamp":"2024-09-05T07:57:28.385191+0000","last_clean_scrub_stamp":"2024-09-05T07:57:28.385191+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:20:32.831441+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1754,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"24'65","reported_seq":102,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:38.838664+0000","last_change":"2024-09-05T07:57:38.838689+0000","last_active":"2024-09-05T07:57:38.838664+0000","last_peered":"2024-09-05T07:57:38.838664+0000","last_clean":"2024-09-05T07:57:38.838664+0000","last_became_active":"2024-09-05T07:29:30.562824+0000","last_became_peered":"2024-09-05T07:29:30.562824+0000","last_unstale":"2024-09-05T07:57:38.838664+0000","last_undegraded":"2024-09-05T07:57:38.838664+0000","last_fullsized":"2024-09-05T07:57:38.838664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'65","last_scrub_stamp":"2024-09-05T07:57:38.838576+0000","last_deep_scrub":"24'65","last_deep_scrub_stamp":"2024-09-05T07:57:38.838576+0000","last_clean_scrub_stamp":"2024-09-05T07:57:38.838576+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:05:13.694244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":2542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"24'119","reported_seq":200,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:22.254530+0000","last_change":"2024-09-05T07:57:22.254581+0000","last_active":"2024-09-05T07:57:22.254530+0000","last_peered":"2024-09-05T07:57:22.254530+0000","last_clean":"2024-09-05T07:57:22.254530+0000","last_became_active":"2024-09-05T07:29:13.365841+0000","last_became_peered":"2024-09-05T07:29:13.365841+0000","last_unstale":"2024-09-05T07:57:22.254530+0000","last_undegraded":"2024-09-05T07:57:22.254530+0000","last_fullsized":"2024-09-05T07:57:22.254530+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'119","last_scrub_stamp":"2024-09-05T07:57:22.254416+0000","last_deep_scrub":"24'119","last_deep_scrub_stamp":"2024-09-05T07:57:22.254416+0000","last_clean_scrub_stamp":"2024-09-05T07:57:22.254416+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:31:10.108926+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"24'11","reported_seq":51,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:33.874793+0000","last_change":"2024-09-05T07:57:33.874831+0000","last_active":"2024-09-05T07:57:33.874793+0000","last_peered":"2024-09-05T07:57:33.874793+0000","last_clean":"2024-09-05T07:57:33.874793+0000","last_became_active":"2024-09-05T07:29:29.562956+0000","last_became_peered":"2024-09-05T07:29:29.562956+0000","last_unstale":"2024-09-05T07:57:33.874793+0000","last_undegraded":"2024-09-05T07:57:33.874793+0000","last_fullsized":"2024-09-05T07:57:33.874793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'11","last_scrub_stamp":"2024-09-05T07:57:33.874714+0000","last_deep_scrub":"24'11","last_deep_scrub_stamp":"2024-09-05T07:57:33.874714+0000","last_clean_scrub_stamp":"2024-09-05T07:57:33.874714+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:14:40.855054+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"24'54","reported_seq":92,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:34.612038+0000","last_change":"2024-09-05T07:57:34.612064+0000","last_active":"2024-09-05T07:57:34.612038+0000","last_peered":"2024-09-05T07:57:34.612038+0000","last_clean":"2024-09-05T07:57:34.612038+0000","last_became_active":"2024-09-05T07:29:30.641243+0000","last_became_peered":"2024-09-05T07:29:30.641243+0000","last_unstale":"2024-09-05T07:57:34.612038+0000","last_undegraded":"2024-09-05T07:57:34.612038+0000","last_fullsized":"2024-09-05T07:57:34.612038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'54","last_scrub_stamp":"2024-09-05T07:57:34.611944+0000","last_deep_scrub":"24'54","last_deep_scrub_stamp":"2024-09-05T07:57:34.611944+0000","last_clean_scrub_stamp":"2024-09-05T07:57:34.611944+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:33:16.262114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":3733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"24'326","reported_seq":367,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:28.914039+0000","last_change":"2024-09-05T07:57:28.914039+0000","last_active":"2024-09-05T07:57:28.914039+0000","last_peered":"2024-09-05T07:57:28.914039+0000","last_clean":"2024-09-05T07:57:28.914039+0000","last_became_active":"2024-09-05T07:29:29.479005+0000","last_became_peered":"2024-09-05T07:29:29.479005+0000","last_unstale":"2024-09-05T07:57:28.914039+0000","last_undegraded":"2024-09-05T07:57:28.914039+0000","last_fullsized":"2024-09-05T07:57:28.914039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'326","last_scrub_stamp":"2024-09-05T07:57:28.913931+0000","last_deep_scrub":"24'326","last_deep_scrub_stamp":"2024-09-05T07:57:28.913931+0000","last_clean_scrub_stamp":"2024-09-05T07:57:28.913931+0000","objects_scrubbed":2,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:28:08.279664+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3481379,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":316,"num_write_kb":3556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"24'55","reported_seq":93,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:34.395254+0000","last_change":"2024-09-05T07:57:34.395279+0000","last_active":"2024-09-05T07:57:34.395254+0000","last_peered":"2024-09-05T07:57:34.395254+0000","last_clean":"2024-09-05T07:57:34.395254+0000","last_became_active":"2024-09-05T07:29:30.641269+0000","last_became_peered":"2024-09-05T07:29:30.641269+0000","last_unstale":"2024-09-05T07:57:34.395254+0000","last_undegraded":"2024-09-05T07:57:34.395254+0000","last_fullsized":"2024-09-05T07:57:34.395254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'55","last_scrub_stamp":"2024-09-05T07:57:34.395171+0000","last_deep_scrub":"24'55","last_deep_scrub_stamp":"2024-09-05T07:57:34.395171+0000","last_clean_scrub_stamp":"2024-09-05T07:57:34.395171+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:18:22.840909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":2599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"24'882","reported_seq":1791,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:28.526046+0000","last_change":"2024-09-05T07:57:28.526101+0000","last_active":"2024-09-05T07:57:28.526046+0000","last_peered":"2024-09-05T07:57:28.526046+0000","last_clean":"2024-09-05T07:57:28.526046+0000","last_became_active":"2024-09-05T07:29:29.568576+0000","last_became_peered":"2024-09-05T07:29:29.568576+0000","last_unstale":"2024-09-05T07:57:28.526046+0000","last_undegraded":"2024-09-05T07:57:28.526046+0000","last_fullsized":"2024-09-05T07:57:28.526046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'882","last_scrub_stamp":"2024-09-05T07:57:28.525946+0000","last_deep_scrub":"24'882","last_deep_scrub_stamp":"2024-09-05T07:57:28.525946+0000","last_clean_scrub_stamp":"2024-09-05T07:57:28.525946+0000","objects_scrubbed":4,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:10:24.071012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182215,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":869,"num_read_kb":916,"num_write":877,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"24'71","reported_seq":110,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:40.979148+0000","last_change":"2024-09-05T07:57:40.979176+0000","last_active":"2024-09-05T07:57:40.979148+0000","last_peered":"2024-09-05T07:57:40.979148+0000","last_clean":"2024-09-05T07:57:40.979148+0000","last_became_active":"2024-09-05T07:29:30.659720+0000","last_became_peered":"2024-09-05T07:29:30.659720+0000","last_unstale":"2024-09-05T07:57:40.979148+0000","last_undegraded":"2024-09-05T07:57:40.979148+0000","last_fullsized":"2024-09-05T07:57:40.979148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'71","last_scrub_stamp":"2024-09-05T07:57:40.979052+0000","last_deep_scrub":"24'71","last_deep_scrub_stamp":"2024-09-05T07:57:40.979052+0000","last_clean_scrub_stamp":"2024-09-05T07:57:40.979052+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:37:53.843337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":2450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"24'10","reported_seq":50,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:27.950576+0000","last_change":"2024-09-05T07:57:27.950624+0000","last_active":"2024-09-05T07:57:27.950576+0000","last_peered":"2024-09-05T07:57:27.950576+0000","last_clean":"2024-09-05T07:57:27.950576+0000","last_became_active":"2024-09-05T07:29:29.568307+0000","last_became_peered":"2024-09-05T07:29:29.568307+0000","last_unstale":"2024-09-05T07:57:27.950576+0000","last_undegraded":"2024-09-05T07:57:27.950576+0000","last_fullsized":"2024-09-05T07:57:27.950576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'10","last_scrub_stamp":"2024-09-05T07:57:27.950485+0000","last_deep_scrub":"24'10","last_deep_scrub_stamp":"2024-09-05T07:57:27.950485+0000","last_clean_scrub_stamp":"2024-09-05T07:57:27.950485+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:39:39.074971+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"24'89","reported_seq":127,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:34.448403+0000","last_change":"2024-09-05T07:57:34.448429+0000","last_active":"2024-09-05T07:57:34.448403+0000","last_peered":"2024-09-05T07:57:34.448403+0000","last_clean":"2024-09-05T07:57:34.448403+0000","last_became_active":"2024-09-05T07:29:30.642414+0000","last_became_peered":"2024-09-05T07:29:30.642414+0000","last_unstale":"2024-09-05T07:57:34.448403+0000","last_undegraded":"2024-09-05T07:57:34.448403+0000","last_fullsized":"2024-09-05T07:57:34.448403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'89","last_scrub_stamp":"2024-09-05T07:57:34.448308+0000","last_deep_scrub":"24'89","last_deep_scrub_stamp":"2024-09-05T07:57:34.448308+0000","last_clean_scrub_stamp":"2024-09-05T07:57:34.448308+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:24:06.040697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":7430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"24'5","reported_seq":45,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:28.813463+0000","last_change":"2024-09-05T07:57:28.813486+0000","last_active":"2024-09-05T07:57:28.813463+0000","last_peered":"2024-09-05T07:57:28.813463+0000","last_clean":"2024-09-05T07:57:28.813463+0000","last_became_active":"2024-09-05T07:29:29.568499+0000","last_became_peered":"2024-09-05T07:29:29.568499+0000","last_unstale":"2024-09-05T07:57:28.813463+0000","last_undegraded":"2024-09-05T07:57:28.813463+0000","last_fullsized":"2024-09-05T07:57:28.813463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'5","last_scrub_stamp":"2024-09-05T07:57:28.813379+0000","last_deep_scrub":"24'5","last_deep_scrub_stamp":"2024-09-05T07:57:28.813379+0000","last_clean_scrub_stamp":"2024-09-05T07:57:28.813379+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:13:25.899595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"24'66","reported_seq":104,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:24.976104+0000","last_change":"2024-09-05T07:57:24.976133+0000","last_active":"2024-09-05T07:57:24.976104+0000","last_peered":"2024-09-05T07:57:24.976104+0000","last_clean":"2024-09-05T07:57:24.976104+0000","last_became_active":"2024-09-05T07:29:30.640805+0000","last_became_peered":"2024-09-05T07:29:30.640805+0000","last_unstale":"2024-09-05T07:57:24.976104+0000","last_undegraded":"2024-09-05T07:57:24.976104+0000","last_fullsized":"2024-09-05T07:57:24.976104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'66","last_scrub_stamp":"2024-09-05T07:57:24.976013+0000","last_deep_scrub":"24'66","last_deep_scrub_stamp":"2024-09-05T07:57:24.976013+0000","last_clean_scrub_stamp":"2024-09-05T07:57:24.976013+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:33:18.410649+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":1781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"24'11","reported_seq":51,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:31.841829+0000","last_change":"2024-09-05T07:57:31.841897+0000","last_active":"2024-09-05T07:57:31.841829+0000","last_peered":"2024-09-05T07:57:31.841829+0000","last_clean":"2024-09-05T07:57:31.841829+0000","last_became_active":"2024-09-05T07:29:29.524918+0000","last_became_peered":"2024-09-05T07:29:29.524918+0000","last_unstale":"2024-09-05T07:57:31.841829+0000","last_undegraded":"2024-09-05T07:57:31.841829+0000","last_fullsized":"2024-09-05T07:57:31.841829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'11","last_scrub_stamp":"2024-09-05T07:57:31.841706+0000","last_deep_scrub":"24'11","last_deep_scrub_stamp":"2024-09-05T07:57:31.841706+0000","last_clean_scrub_stamp":"2024-09-05T07:57:31.841706+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:00:04.240836+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"24'64","reported_seq":102,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:35.414702+0000","last_change":"2024-09-05T07:57:35.414757+0000","last_active":"2024-09-05T07:57:35.414702+0000","last_peered":"2024-09-05T07:57:35.414702+0000","last_clean":"2024-09-05T07:57:35.414702+0000","last_became_active":"2024-09-05T07:29:30.658155+0000","last_became_peered":"2024-09-05T07:29:30.658155+0000","last_unstale":"2024-09-05T07:57:35.414702+0000","last_undegraded":"2024-09-05T07:57:35.414702+0000","last_fullsized":"2024-09-05T07:57:35.414702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'64","last_scrub_stamp":"2024-09-05T07:57:35.414603+0000","last_deep_scrub":"24'64","last_deep_scrub_stamp":"2024-09-05T07:57:35.414603+0000","last_clean_scrub_stamp":"2024-09-05T07:57:35.414603+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:09:54.791121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":2545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"24'1352","reported_seq":1392,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:26.488637+0000","last_change":"2024-09-05T07:57:26.488637+0000","last_active":"2024-09-05T07:57:26.488637+0000","last_peered":"2024-09-05T07:57:26.488637+0000","last_clean":"2024-09-05T07:57:26.488637+0000","last_became_active":"2024-09-05T07:29:29.526421+0000","last_became_peered":"2024-09-05T07:29:29.526421+0000","last_unstale":"2024-09-05T07:57:26.488637+0000","last_undegraded":"2024-09-05T07:57:26.488637+0000","last_fullsized":"2024-09-05T07:57:26.488637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'1352","last_scrub_stamp":"2024-09-05T07:57:26.488499+0000","last_deep_scrub":"24'1352","last_deep_scrub_stamp":"2024-09-05T07:57:26.488499+0000","last_clean_scrub_stamp":"2024-09-05T07:57:26.488499+0000","objects_scrubbed":4,"log_size":1352,"log_dups_size":0,"ondisk_log_size":1352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:32:59.132324+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3429,"num_write_kb":1221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"24'72","reported_seq":110,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:33.649756+0000","last_change":"2024-09-05T07:57:33.649756+0000","last_active":"2024-09-05T07:57:33.649756+0000","last_peered":"2024-09-05T07:57:33.649756+0000","last_clean":"2024-09-05T07:57:33.649756+0000","last_became_active":"2024-09-05T07:29:30.633535+0000","last_became_peered":"2024-09-05T07:29:30.633535+0000","last_unstale":"2024-09-05T07:57:33.649756+0000","last_undegraded":"2024-09-05T07:57:33.649756+0000","last_fullsized":"2024-09-05T07:57:33.649756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'72","last_scrub_stamp":"2024-09-05T07:57:33.649637+0000","last_deep_scrub":"24'72","last_deep_scrub_stamp":"2024-09-05T07:57:33.649637+0000","last_clean_scrub_stamp":"2024-09-05T07:57:33.649637+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:09:38.832653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"24'16","reported_seq":56,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:29.893611+0000","last_change":"2024-09-05T07:57:29.893611+0000","last_active":"2024-09-05T07:57:29.893611+0000","last_peered":"2024-09-05T07:57:29.893611+0000","last_clean":"2024-09-05T07:57:29.893611+0000","last_became_active":"2024-09-05T07:29:29.524268+0000","last_became_peered":"2024-09-05T07:29:29.524268+0000","last_unstale":"2024-09-05T07:57:29.893611+0000","last_undegraded":"2024-09-05T07:57:29.893611+0000","last_fullsized":"2024-09-05T07:57:29.893611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'16","last_scrub_stamp":"2024-09-05T07:57:29.893498+0000","last_deep_scrub":"24'16","last_deep_scrub_stamp":"2024-09-05T07:57:29.893498+0000","last_clean_scrub_stamp":"2024-09-05T07:57:29.893498+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:31:33.782733+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'84","reported_seq":122,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:31.589425+0000","last_change":"2024-09-05T07:57:31.589425+0000","last_active":"2024-09-05T07:57:31.589425+0000","last_peered":"2024-09-05T07:57:31.589425+0000","last_clean":"2024-09-05T07:57:31.589425+0000","last_became_active":"2024-09-05T07:29:30.624117+0000","last_became_peered":"2024-09-05T07:29:30.624117+0000","last_unstale":"2024-09-05T07:57:31.589425+0000","last_undegraded":"2024-09-05T07:57:31.589425+0000","last_fullsized":"2024-09-05T07:57:31.589425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'84","last_scrub_stamp":"2024-09-05T07:57:31.589309+0000","last_deep_scrub":"24'84","last_deep_scrub_stamp":"2024-09-05T07:57:31.589309+0000","last_clean_scrub_stamp":"2024-09-05T07:57:31.589309+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:02:13.811981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":5195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'10","reported_seq":50,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:25.459897+0000","last_change":"2024-09-05T07:57:25.459897+0000","last_active":"2024-09-05T07:57:25.459897+0000","last_peered":"2024-09-05T07:57:25.459897+0000","last_clean":"2024-09-05T07:57:25.459897+0000","last_became_active":"2024-09-05T07:29:29.561026+0000","last_became_peered":"2024-09-05T07:29:29.561026+0000","last_unstale":"2024-09-05T07:57:25.459897+0000","last_undegraded":"2024-09-05T07:57:25.459897+0000","last_fullsized":"2024-09-05T07:57:25.459897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'10","last_scrub_stamp":"2024-09-05T07:57:25.459803+0000","last_deep_scrub":"24'10","last_deep_scrub_stamp":"2024-09-05T07:57:25.459803+0000","last_clean_scrub_stamp":"2024-09-05T07:57:25.459803+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:43:01.433432+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"24'80","reported_seq":118,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:25.875993+0000","last_change":"2024-09-05T07:57:25.875993+0000","last_active":"2024-09-05T07:57:25.875993+0000","last_peered":"2024-09-05T07:57:25.875993+0000","last_clean":"2024-09-05T07:57:25.875993+0000","last_became_active":"2024-09-05T07:29:30.556627+0000","last_became_peered":"2024-09-05T07:29:30.556627+0000","last_unstale":"2024-09-05T07:57:25.875993+0000","last_undegraded":"2024-09-05T07:57:25.875993+0000","last_fullsized":"2024-09-05T07:57:25.875993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'80","last_scrub_stamp":"2024-09-05T07:57:25.875888+0000","last_deep_scrub":"24'80","last_deep_scrub_stamp":"2024-09-05T07:57:25.875888+0000","last_clean_scrub_stamp":"2024-09-05T07:57:25.875888+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:10:06.480356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":7503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"24'15","reported_seq":55,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:27.536913+0000","last_change":"2024-09-05T07:57:27.536913+0000","last_active":"2024-09-05T07:57:27.536913+0000","last_peered":"2024-09-05T07:57:27.536913+0000","last_clean":"2024-09-05T07:57:27.536913+0000","last_became_active":"2024-09-05T07:29:29.526572+0000","last_became_peered":"2024-09-05T07:29:29.526572+0000","last_unstale":"2024-09-05T07:57:27.536913+0000","last_undegraded":"2024-09-05T07:57:27.536913+0000","last_fullsized":"2024-09-05T07:57:27.536913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'15","last_scrub_stamp":"2024-09-05T07:57:27.536801+0000","last_deep_scrub":"24'15","last_deep_scrub_stamp":"2024-09-05T07:57:27.536801+0000","last_clean_scrub_stamp":"2024-09-05T07:57:27.536801+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:56:55.931527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"24'71","reported_seq":109,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:32.628607+0000","last_change":"2024-09-05T07:57:32.628607+0000","last_active":"2024-09-05T07:57:32.628607+0000","last_peered":"2024-09-05T07:57:32.628607+0000","last_clean":"2024-09-05T07:57:32.628607+0000","last_became_active":"2024-09-05T07:29:30.624109+0000","last_became_peered":"2024-09-05T07:29:30.624109+0000","last_unstale":"2024-09-05T07:57:32.628607+0000","last_undegraded":"2024-09-05T07:57:32.628607+0000","last_fullsized":"2024-09-05T07:57:32.628607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'71","last_scrub_stamp":"2024-09-05T07:57:32.628472+0000","last_deep_scrub":"24'71","last_deep_scrub_stamp":"2024-09-05T07:57:32.628472+0000","last_clean_scrub_stamp":"2024-09-05T07:57:32.628472+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:29:23.564777+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":2208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"24'7","reported_seq":47,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:26.384758+0000","last_change":"2024-09-05T07:57:26.384758+0000","last_active":"2024-09-05T07:57:26.384758+0000","last_peered":"2024-09-05T07:57:26.384758+0000","last_clean":"2024-09-05T07:57:26.384758+0000","last_became_active":"2024-09-05T07:29:29.569536+0000","last_became_peered":"2024-09-05T07:29:29.569536+0000","last_unstale":"2024-09-05T07:57:26.384758+0000","last_undegraded":"2024-09-05T07:57:26.384758+0000","last_fullsized":"2024-09-05T07:57:26.384758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'7","last_scrub_stamp":"2024-09-05T07:57:26.384641+0000","last_deep_scrub":"24'7","last_deep_scrub_stamp":"2024-09-05T07:57:26.384641+0000","last_clean_scrub_stamp":"2024-09-05T07:57:26.384641+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:19:38.647034+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"24'86","reported_seq":123,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:30.510675+0000","last_change":"2024-09-05T07:57:30.510702+0000","last_active":"2024-09-05T07:57:30.510675+0000","last_peered":"2024-09-05T07:57:30.510675+0000","last_clean":"2024-09-05T07:57:30.510675+0000","last_became_active":"2024-09-05T07:29:30.632502+0000","last_became_peered":"2024-09-05T07:29:30.632502+0000","last_unstale":"2024-09-05T07:57:30.510675+0000","last_undegraded":"2024-09-05T07:57:30.510675+0000","last_fullsized":"2024-09-05T07:57:30.510675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'86","last_scrub_stamp":"2024-09-05T07:57:30.510577+0000","last_deep_scrub":"24'86","last_deep_scrub_stamp":"2024-09-05T07:57:30.510577+0000","last_clean_scrub_stamp":"2024-09-05T07:57:30.510577+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:30:28.162182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":4049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"24'548","reported_seq":587,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:34.850475+0000","last_change":"2024-09-05T07:57:34.850546+0000","last_active":"2024-09-05T07:57:34.850475+0000","last_peered":"2024-09-05T07:57:34.850475+0000","last_clean":"2024-09-05T07:57:34.850475+0000","last_became_active":"2024-09-05T07:29:29.563316+0000","last_became_peered":"2024-09-05T07:29:29.563316+0000","last_unstale":"2024-09-05T07:57:34.850475+0000","last_undegraded":"2024-09-05T07:57:34.850475+0000","last_fullsized":"2024-09-05T07:57:34.850475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'548","last_scrub_stamp":"2024-09-05T07:57:34.850360+0000","last_deep_scrub":"24'548","last_deep_scrub_stamp":"2024-09-05T07:57:34.850360+0000","last_clean_scrub_stamp":"2024-09-05T07:57:34.850360+0000","objects_scrubbed":3,"log_size":548,"log_dups_size":0,"ondisk_log_size":548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:21:26.021314+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":542,"num_write_kb":4368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"24'76","reported_seq":113,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:37.814880+0000","last_change":"2024-09-05T07:57:37.814904+0000","last_active":"2024-09-05T07:57:37.814880+0000","last_peered":"2024-09-05T07:57:37.814880+0000","last_clean":"2024-09-05T07:57:37.814880+0000","last_became_active":"2024-09-05T07:29:30.562776+0000","last_became_peered":"2024-09-05T07:29:30.562776+0000","last_unstale":"2024-09-05T07:57:37.814880+0000","last_undegraded":"2024-09-05T07:57:37.814880+0000","last_fullsized":"2024-09-05T07:57:37.814880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'76","last_scrub_stamp":"2024-09-05T07:57:37.814788+0000","last_deep_scrub":"24'76","last_deep_scrub_stamp":"2024-09-05T07:57:37.814788+0000","last_clean_scrub_stamp":"2024-09-05T07:57:37.814788+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:54:04.184644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":1880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"24'79","reported_seq":115,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:24.857320+0000","last_change":"2024-09-05T07:57:24.857344+0000","last_active":"2024-09-05T07:57:24.857320+0000","last_peered":"2024-09-05T07:57:24.857320+0000","last_clean":"2024-09-05T07:57:24.857320+0000","last_became_active":"2024-09-05T07:29:30.557747+0000","last_became_peered":"2024-09-05T07:29:30.557747+0000","last_unstale":"2024-09-05T07:57:24.857320+0000","last_undegraded":"2024-09-05T07:57:24.857320+0000","last_fullsized":"2024-09-05T07:57:24.857320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'79","last_scrub_stamp":"2024-09-05T07:57:24.857247+0000","last_deep_scrub":"24'79","last_deep_scrub_stamp":"2024-09-05T07:57:24.857247+0000","last_clean_scrub_stamp":"2024-09-05T07:57:24.857247+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:16:13.313348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":6364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"24'12","reported_seq":50,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:26.464427+0000","last_change":"2024-09-05T07:57:26.464476+0000","last_active":"2024-09-05T07:57:26.464427+0000","last_peered":"2024-09-05T07:57:26.464427+0000","last_clean":"2024-09-05T07:57:26.464427+0000","last_became_active":"2024-09-05T07:29:29.561065+0000","last_became_peered":"2024-09-05T07:29:29.561065+0000","last_unstale":"2024-09-05T07:57:26.464427+0000","last_undegraded":"2024-09-05T07:57:26.464427+0000","last_fullsized":"2024-09-05T07:57:26.464427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'12","last_scrub_stamp":"2024-09-05T07:57:26.464322+0000","last_deep_scrub":"24'12","last_deep_scrub_stamp":"2024-09-05T07:57:26.464322+0000","last_clean_scrub_stamp":"2024-09-05T07:57:26.464322+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:16:14.920422+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"24'45","reported_seq":81,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:26.266422+0000","last_change":"2024-09-05T07:57:26.266466+0000","last_active":"2024-09-05T07:57:26.266422+0000","last_peered":"2024-09-05T07:57:26.266422+0000","last_clean":"2024-09-05T07:57:26.266422+0000","last_became_active":"2024-09-05T07:29:30.565787+0000","last_became_peered":"2024-09-05T07:29:30.565787+0000","last_unstale":"2024-09-05T07:57:26.266422+0000","last_undegraded":"2024-09-05T07:57:26.266422+0000","last_fullsized":"2024-09-05T07:57:26.266422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'45","last_scrub_stamp":"2024-09-05T07:57:26.266317+0000","last_deep_scrub":"24'45","last_deep_scrub_stamp":"2024-09-05T07:57:26.266317+0000","last_clean_scrub_stamp":"2024-09-05T07:57:26.266317+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:25:19.664259+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":3021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"24'1213","reported_seq":1251,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:23.550010+0000","last_change":"2024-09-05T07:57:23.550048+0000","last_active":"2024-09-05T07:57:23.550010+0000","last_peered":"2024-09-05T07:57:23.550010+0000","last_clean":"2024-09-05T07:57:23.550010+0000","last_became_active":"2024-09-05T07:29:29.559675+0000","last_became_peered":"2024-09-05T07:29:29.559675+0000","last_unstale":"2024-09-05T07:57:23.550010+0000","last_undegraded":"2024-09-05T07:57:23.550010+0000","last_fullsized":"2024-09-05T07:57:23.550010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'1213","last_scrub_stamp":"2024-09-05T07:57:23.549927+0000","last_deep_scrub":"24'1213","last_deep_scrub_stamp":"2024-09-05T07:57:23.549927+0000","last_clean_scrub_stamp":"2024-09-05T07:57:23.549927+0000","objects_scrubbed":9,"log_size":1213,"log_dups_size":0,"ondisk_log_size":1213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:02:45.235555+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1200,"num_write_kb":8869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"24'101","reported_seq":139,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:33.779947+0000","last_change":"2024-09-05T07:57:33.779973+0000","last_active":"2024-09-05T07:57:33.779947+0000","last_peered":"2024-09-05T07:57:33.779947+0000","last_clean":"2024-09-05T07:57:33.779947+0000","last_became_active":"2024-09-05T07:29:30.656876+0000","last_became_peered":"2024-09-05T07:29:30.656876+0000","last_unstale":"2024-09-05T07:57:33.779947+0000","last_undegraded":"2024-09-05T07:57:33.779947+0000","last_fullsized":"2024-09-05T07:57:33.779947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'101","last_scrub_stamp":"2024-09-05T07:57:33.779856+0000","last_deep_scrub":"24'101","last_deep_scrub_stamp":"2024-09-05T07:57:33.779856+0000","last_clean_scrub_stamp":"2024-09-05T07:57:33.779856+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:46:26.317515+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":8259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"24'717","reported_seq":758,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:26.823865+0000","last_change":"2024-09-05T07:57:26.823865+0000","last_active":"2024-09-05T07:57:26.823865+0000","last_peered":"2024-09-05T07:57:26.823865+0000","last_clean":"2024-09-05T07:57:26.823865+0000","last_became_active":"2024-09-05T07:29:29.567129+0000","last_became_peered":"2024-09-05T07:29:29.567129+0000","last_unstale":"2024-09-05T07:57:26.823865+0000","last_undegraded":"2024-09-05T07:57:26.823865+0000","last_fullsized":"2024-09-05T07:57:26.823865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'717","last_scrub_stamp":"2024-09-05T07:57:26.823777+0000","last_deep_scrub":"24'717","last_deep_scrub_stamp":"2024-09-05T07:57:26.823777+0000","last_clean_scrub_stamp":"2024-09-05T07:57:26.823777+0000","objects_scrubbed":1,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:21:15.108168+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":711,"num_write_kb":4517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"24'60","reported_seq":99,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:35.857690+0000","last_change":"2024-09-05T07:57:35.857713+0000","last_active":"2024-09-05T07:57:35.857690+0000","last_peered":"2024-09-05T07:57:35.857690+0000","last_clean":"2024-09-05T07:57:35.857690+0000","last_became_active":"2024-09-05T07:29:30.657625+0000","last_became_peered":"2024-09-05T07:29:30.657625+0000","last_unstale":"2024-09-05T07:57:35.857690+0000","last_undegraded":"2024-09-05T07:57:35.857690+0000","last_fullsized":"2024-09-05T07:57:35.857690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'60","last_scrub_stamp":"2024-09-05T07:57:35.857607+0000","last_deep_scrub":"24'60","last_deep_scrub_stamp":"2024-09-05T07:57:35.857607+0000","last_clean_scrub_stamp":"2024-09-05T07:57:35.857607+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:39:46.982093+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":2166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"24'594","reported_seq":634,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:25.514937+0000","last_change":"2024-09-05T07:57:25.514971+0000","last_active":"2024-09-05T07:57:25.514937+0000","last_peered":"2024-09-05T07:57:25.514937+0000","last_clean":"2024-09-05T07:57:25.514937+0000","last_became_active":"2024-09-05T07:29:29.525832+0000","last_became_peered":"2024-09-05T07:29:29.525832+0000","last_unstale":"2024-09-05T07:57:25.514937+0000","last_undegraded":"2024-09-05T07:57:25.514937+0000","last_fullsized":"2024-09-05T07:57:25.514937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'594","last_scrub_stamp":"2024-09-05T07:57:25.514845+0000","last_deep_scrub":"24'594","last_deep_scrub_stamp":"2024-09-05T07:57:25.514845+0000","last_clean_scrub_stamp":"2024-09-05T07:57:25.514845+0000","objects_scrubbed":7,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:20:29.961094+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3789,"num_write_kb":295314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4716,"ondisk_log_size":4716,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":37226760,"num_objects":107,"num_object_clones":0,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":869,"num_read_kb":916,"num_write":10472,"num_write_kb":41821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":74694656,"data_stored":74453520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8589,"ondisk_log_size":8589,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719477084,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61848,"kb_used_data":12616,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94309992,"statfs":{"total":96636764160,"available":96573431808,"internally_reserved":0,"allocated":12918784,"data_stored":12732533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509787,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35736,"kb_used_data":4552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94336104,"statfs":{"total":96636764160,"available":96600170496,"internally_reserved":0,"allocated":4661248,"data_stored":4466126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509787,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47156,"kb_used_data":15972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94324684,"statfs":{"total":96636764160,"available":96588476416,"internally_reserved":0,"allocated":16355328,"data_stored":16156262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509787,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47952,"kb_used_data":8448,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323888,"statfs":{"total":96636764160,"available":96587661312,"internally_reserved":0,"allocated":8650752,"data_stored":8478013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509786,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48536,"kb_used_data":9032,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323304,"statfs":{"total":96636764160,"available":96587063296,"internally_reserved":0,"allocated":9248768,"data_stored":9069055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509786,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47908,"kb_used_data":12564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323932,"statfs":{"total":96636764160,"available":96587706368,"internally_reserved":0,"allocated":12865536,"data_stored":12675287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542492,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43860,"kb_used_data":4356,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327980,"statfs":{"total":96636764160,"available":96591851520,"internally_reserved":0,"allocated":4460544,"data_stored":4286517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542491,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43828,"kb_used_data":8484,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94328012,"statfs":{"total":96636764160,"available":96591884288,"internally_reserved":0,"allocated":8687616,"data_stored":8479783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12619776,"data_stored":12586622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8409088,"data_stored":8390022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16109568,"data_stored":16067597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8441856,"data_stored":8391118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12079104,"data_stored":12053500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4214784,"data_stored":4197852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4415488,"data_stored":4377461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T07:57:47.746 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:47.746 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:47.747 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-05T07:29:29.311033+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=7, tm_min=57, tm_sec=18, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T07:57:47.747 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-05T07:58:07.749 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T07:58:07.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.862+0000 7f68ff247640 1 Processor -- start 2024-09-05T07:58:07.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.862+0000 7f68ff247640 1 -- start start 2024-09-05T07:58:07.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.863+0000 7f68ff247640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f68f80cae80 0x7f68f815b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:07.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.863+0000 7f68ff247640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f68f80cb260 0x7f68f80c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:07.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.863+0000 7f68ff247640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68f80c4100 con 0x7f68f80c9620 2024-09-05T07:58:07.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.863+0000 7f68ff247640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f68f815b950 con 0x7f68f80cae80 2024-09-05T07:58:07.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.863+0000 7f68ff247640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f68f80c4370 con 0x7f68f80cb260 2024-09-05T07:58:07.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.863+0000 7f68fcfe3640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f68f80cae80 0x7f68f815b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:07.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.863+0000 7f68fd7e4640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f68f80c9620 0x7f68f80c9ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.17:34284/0 (socket says 172.21.15.17:34284) 2024-09-05T07:58:07.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.863+0000 7f68fd7e4640 1 -- 172.21.15.17:0/1335794666 learned_addr learned my addr 172.21.15.17:0/1335794666 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:58:07.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.864+0000 7f68effff640 1 --2- 172.21.15.17:0/1335794666 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f68f80cb260 0x7f68f80c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:07.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.866+0000 7f68fcfe3640 1 -- 172.21.15.17:0/1335794666 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f68f80cb260 msgr2=0x7f68f80c3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:58:07.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.866+0000 7f68fcfe3640 1 --2- 172.21.15.17:0/1335794666 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f68f80cb260 0x7f68f80c3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:07.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.866+0000 7f68fcfe3640 1 -- 172.21.15.17:0/1335794666 >> v1:172.21.15.26:6789/0 conn(0x7f68f80c9620 legacy=0x7f68f80c9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:07.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.866+0000 7f68fcfe3640 1 -- 172.21.15.17:0/1335794666 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f80c4610 con 0x7f68f80cae80 2024-09-05T07:58:07.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.870+0000 7f68fcfe3640 1 --2- 172.21.15.17:0/1335794666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68f80cae80 0x7f68f815b410 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f68f40097a0 tx=0x7f68f402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b600e56511c2f4d server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:58:07.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.876+0000 7f68ef7fe640 1 -- 172.21.15.17:0/1335794666 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f4037070 con 0x7f68f80cae80 2024-09-05T07:58:07.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.876+0000 7f68ef7fe640 1 -- 172.21.15.17:0/1335794666 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68f4032440 con 0x7f68f80cae80 2024-09-05T07:58:07.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.876+0000 7f68ef7fe640 1 -- 172.21.15.17:0/1335794666 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f4032810 con 0x7f68f80cae80 2024-09-05T07:58:07.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.877+0000 7f68ff247640 1 -- 172.21.15.17:0/1335794666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68f80cae80 msgr2=0x7f68f815b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:07.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.877+0000 7f68ff247640 1 --2- 172.21.15.17:0/1335794666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68f80cae80 0x7f68f815b410 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f68f40097a0 tx=0x7f68f402a210 comp rx=0 tx=0).stop 2024-09-05T07:58:07.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.877+0000 7f68ff247640 1 -- 172.21.15.17:0/1335794666 shutdown_connections 2024-09-05T07:58:07.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.877+0000 7f68ff247640 1 --2- 172.21.15.17:0/1335794666 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f68f80cb260 0x7f68f80c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:07.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.877+0000 7f68ff247640 1 --2- 172.21.15.17:0/1335794666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68f80cae80 0x7f68f815b410 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:07.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.877+0000 7f68ff247640 1 -- 172.21.15.17:0/1335794666 >> 172.21.15.17:0/1335794666 conn(0x7f68f80715f0 msgr2=0x7f68f80719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:58:07.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.877+0000 7f68ff247640 1 -- 172.21.15.17:0/1335794666 shutdown_connections 2024-09-05T07:58:07.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.877+0000 7f68ff247640 1 -- 172.21.15.17:0/1335794666 wait complete. 2024-09-05T07:58:07.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.878+0000 7f68ff247640 1 Processor -- start 2024-09-05T07:58:07.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.878+0000 7f68ff247640 1 -- start start 2024-09-05T07:58:07.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.879+0000 7f68ff247640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68f80c9620 0x7f68f81e5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:07.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.879+0000 7f68ff247640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f68f80cae80 0x7f68f8147cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:07.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.879+0000 7f68ff247640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68f80cb260 0x7f68f81e25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:07.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.879+0000 7f68ff247640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f68f80c8e20 con 0x7f68f80cb260 2024-09-05T07:58:07.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.879+0000 7f68ff247640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f68f80c4bd0 con 0x7f68f80c9620 2024-09-05T07:58:07.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.879+0000 7f68ff247640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f68f80c9100 con 0x7f68f80cae80 2024-09-05T07:58:07.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.880+0000 7f68effff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f68f80cae80 0x7f68f8147cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:07.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.880+0000 7f68fcfe3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68f80c9620 0x7f68f81e5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:07.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.880+0000 7f68effff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f68f80cae80 0x7f68f8147cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:46316/0 (socket says 172.21.15.17:46316) 2024-09-05T07:58:07.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.880+0000 7f68effff640 1 -- 172.21.15.17:0/1551601682 learned_addr learned my addr 172.21.15.17:0/1551601682 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:58:07.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.884+0000 7f68effff640 1 -- 172.21.15.17:0/1551601682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68f80c9620 msgr2=0x7f68f81e5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:07.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.884+0000 7f68effff640 1 --2- 172.21.15.17:0/1551601682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68f80c9620 0x7f68f81e5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:07.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.884+0000 7f68effff640 1 -- 172.21.15.17:0/1551601682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68f80cb260 msgr2=0x7f68f81e25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:07.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.884+0000 7f68effff640 1 --2- 172.21.15.17:0/1551601682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68f80cb260 0x7f68f81e25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:07.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.884+0000 7f68effff640 1 -- 172.21.15.17:0/1551601682 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f81e6500 con 0x7f68f80cae80 2024-09-05T07:58:07.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.887+0000 7f68effff640 1 --2- 172.21.15.17:0/1551601682 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f68f80cae80 0x7f68f8147cf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f68e800e980 tx=0x7f68e800ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:58:07.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.891+0000 7f68ed7fa640 1 -- 172.21.15.17:0/1551601682 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e8017070 con 0x7f68f80cae80 2024-09-05T07:58:07.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.891+0000 7f68ed7fa640 1 -- 172.21.15.17:0/1551601682 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68e800ca00 con 0x7f68f80cae80 2024-09-05T07:58:07.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.891+0000 7f68ed7fa640 1 -- 172.21.15.17:0/1551601682 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e800cdd0 con 0x7f68f80cae80 2024-09-05T07:58:07.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.891+0000 7f68ff247640 1 -- 172.21.15.17:0/1551601682 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68f81f4340 con 0x7f68f80cae80 2024-09-05T07:58:07.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.891+0000 7f68ff247640 1 -- 172.21.15.17:0/1551601682 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f68f81e1db0 con 0x7f68f80cae80 2024-09-05T07:58:07.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:07.892+0000 7f68ff247640 1 -- 172.21.15.17:0/1551601682 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68f80c3900 con 0x7f68f80cae80 2024-09-05T07:58:08.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.169+0000 7f68ed7fa640 1 -- 172.21.15.17:0/1551601682 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f68e801a070 con 0x7f68f80cae80 2024-09-05T07:58:08.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.169+0000 7f68ed7fa640 1 --2- 172.21.15.17:0/1551601682 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f68e406be80 0x7f68e406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:08.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.169+0000 7f68fcfe3640 1 --2- 172.21.15.17:0/1551601682 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f68e406be80 0x7f68e406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:08.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.170+0000 7f68fcfe3640 1 --2- 172.21.15.17:0/1551601682 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f68e406be80 0x7f68e406e340 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f68f4034000 tx=0x7f68f402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:58:08.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.188+0000 7f68ed7fa640 1 -- 172.21.15.17:0/1551601682 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f68e8057960 con 0x7f68f80cae80 2024-09-05T07:58:08.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.198+0000 7f68ed7fa640 1 -- 172.21.15.17:0/1551601682 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f68e80598c0 con 0x7f68f80cae80 2024-09-05T07:58:08.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.373+0000 7f68ff247640 1 -- 172.21.15.17:0/1551601682 --> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f68f8075770 con 0x7f68e406be80 2024-09-05T07:58:08.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.380+0000 7f68ed7fa640 1 -- 172.21.15.17:0/1551601682 <== mgr.4099 v2:172.21.15.26:6800/2736912541 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253290 (secure 0 0 0) 0x7f68f8075770 con 0x7f68e406be80 2024-09-05T07:58:08.383 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:58:08.385 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-05T07:58:08.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.383+0000 7f68ff247640 1 -- 172.21.15.17:0/1551601682 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f68e406be80 msgr2=0x7f68e406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:08.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.383+0000 7f68ff247640 1 --2- 172.21.15.17:0/1551601682 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f68e406be80 0x7f68e406e340 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f68f4034000 tx=0x7f68f402e000 comp rx=0 tx=0).stop 2024-09-05T07:58:08.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.383+0000 7f68ff247640 1 -- 172.21.15.17:0/1551601682 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f68f80cae80 msgr2=0x7f68f8147cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:08.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.383+0000 7f68ff247640 1 --2- 172.21.15.17:0/1551601682 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f68f80cae80 0x7f68f8147cf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f68e800e980 tx=0x7f68e800ee40 comp rx=0 tx=0).stop 2024-09-05T07:58:08.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.383+0000 7f68ff247640 1 -- 172.21.15.17:0/1551601682 shutdown_connections 2024-09-05T07:58:08.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.383+0000 7f68ff247640 1 --2- 172.21.15.17:0/1551601682 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f68e406be80 0x7f68e406e340 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:08.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.383+0000 7f68ff247640 1 --2- 172.21.15.17:0/1551601682 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f68f80cae80 0x7f68f8147cf0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:08.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.383+0000 7f68ff247640 1 --2- 172.21.15.17:0/1551601682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68f80cb260 0x7f68f81e25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:08.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.383+0000 7f68ff247640 1 --2- 172.21.15.17:0/1551601682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68f80c9620 0x7f68f81e5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:08.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.383+0000 7f68ff247640 1 -- 172.21.15.17:0/1551601682 >> 172.21.15.17:0/1551601682 conn(0x7f68f80715f0 msgr2=0x7f68f80ce190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:58:08.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.383+0000 7f68ff247640 1 -- 172.21.15.17:0/1551601682 shutdown_connections 2024-09-05T07:58:08.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.383+0000 7f68ff247640 1 -- 172.21.15.17:0/1551601682 wait complete. 2024-09-05T07:58:08.395 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":887,"stamp":"2024-09-05T07:58:08.223098+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":37817128,"num_objects":109,"num_object_clones":0,"num_object_copies":218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":0,"num_read":985,"num_read_kb":1016,"num_write":14420,"num_write_kb":339551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13424,"ondisk_log_size":13424,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":376824,"kb_used_data":76024,"kb_used_omap":12,"kb_used_meta":300659,"kb_avail":754597896,"statfs":{"total":773094113280,"available":772708245504,"internally_reserved":0,"allocated":77848576,"data_stored":76343576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":307875377},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003104"},"pg_stats":[{"pgid":"3.3f","version":"24'52","reported_seq":84,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:32.500150+0000","last_change":"2024-09-05T07:57:32.500177+0000","last_active":"2024-09-05T07:57:32.500150+0000","last_peered":"2024-09-05T07:57:32.500150+0000","last_clean":"2024-09-05T07:57:32.500150+0000","last_became_active":"2024-09-05T07:30:02.494878+0000","last_became_peered":"2024-09-05T07:30:02.494878+0000","last_unstale":"2024-09-05T07:57:32.500150+0000","last_undegraded":"2024-09-05T07:57:32.500150+0000","last_fullsized":"2024-09-05T07:57:32.500150+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'52","last_scrub_stamp":"2024-09-05T07:57:32.500066+0000","last_deep_scrub":"24'52","last_deep_scrub_stamp":"2024-09-05T07:57:32.500066+0000","last_clean_scrub_stamp":"2024-09-05T07:57:32.500066+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:25:23.684553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":2980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"24'95","reported_seq":133,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:37.859102+0000","last_change":"2024-09-05T07:57:37.859125+0000","last_active":"2024-09-05T07:57:37.859102+0000","last_peered":"2024-09-05T07:57:37.859102+0000","last_clean":"2024-09-05T07:57:37.859102+0000","last_became_active":"2024-09-05T07:29:30.658225+0000","last_became_peered":"2024-09-05T07:29:30.658225+0000","last_unstale":"2024-09-05T07:57:37.859102+0000","last_undegraded":"2024-09-05T07:57:37.859102+0000","last_fullsized":"2024-09-05T07:57:37.859102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'95","last_scrub_stamp":"2024-09-05T07:57:37.859009+0000","last_deep_scrub":"24'95","last_deep_scrub_stamp":"2024-09-05T07:57:37.859009+0000","last_clean_scrub_stamp":"2024-09-05T07:57:37.859009+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:31:41.748244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":7017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"24'86","reported_seq":124,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:38.908535+0000","last_change":"2024-09-05T07:57:38.908563+0000","last_active":"2024-09-05T07:57:38.908535+0000","last_peered":"2024-09-05T07:57:38.908535+0000","last_clean":"2024-09-05T07:57:38.908535+0000","last_became_active":"2024-09-05T07:29:30.659042+0000","last_became_peered":"2024-09-05T07:29:30.659042+0000","last_unstale":"2024-09-05T07:57:38.908535+0000","last_undegraded":"2024-09-05T07:57:38.908535+0000","last_fullsized":"2024-09-05T07:57:38.908535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'86","last_scrub_stamp":"2024-09-05T07:57:38.908432+0000","last_deep_scrub":"24'86","last_deep_scrub_stamp":"2024-09-05T07:57:38.908432+0000","last_clean_scrub_stamp":"2024-09-05T07:57:38.908432+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:58:22.250905+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":4627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"24'50","reported_seq":89,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:23.938624+0000","last_change":"2024-09-05T07:57:23.938624+0000","last_active":"2024-09-05T07:57:23.938624+0000","last_peered":"2024-09-05T07:57:23.938624+0000","last_clean":"2024-09-05T07:57:23.938624+0000","last_became_active":"2024-09-05T07:29:30.640141+0000","last_became_peered":"2024-09-05T07:29:30.640141+0000","last_unstale":"2024-09-05T07:57:23.938624+0000","last_undegraded":"2024-09-05T07:57:23.938624+0000","last_fullsized":"2024-09-05T07:57:23.938624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'50","last_scrub_stamp":"2024-09-05T07:57:23.938531+0000","last_deep_scrub":"24'50","last_deep_scrub_stamp":"2024-09-05T07:57:23.938531+0000","last_clean_scrub_stamp":"2024-09-05T07:57:23.938531+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:59:52.665686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":3092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"24'51","reported_seq":87,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:36.474711+0000","last_change":"2024-09-05T07:57:36.474743+0000","last_active":"2024-09-05T07:57:36.474711+0000","last_peered":"2024-09-05T07:57:36.474711+0000","last_clean":"2024-09-05T07:57:36.474711+0000","last_became_active":"2024-09-05T07:29:30.658981+0000","last_became_peered":"2024-09-05T07:29:30.658981+0000","last_unstale":"2024-09-05T07:57:36.474711+0000","last_undegraded":"2024-09-05T07:57:36.474711+0000","last_fullsized":"2024-09-05T07:57:36.474711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'51","last_scrub_stamp":"2024-09-05T07:57:36.474628+0000","last_deep_scrub":"24'51","last_deep_scrub_stamp":"2024-09-05T07:57:36.474628+0000","last_clean_scrub_stamp":"2024-09-05T07:57:36.474628+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:15:18.385138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":3119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"24'102","reported_seq":138,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:25.979677+0000","last_change":"2024-09-05T07:57:25.979702+0000","last_active":"2024-09-05T07:57:25.979677+0000","last_peered":"2024-09-05T07:57:25.979677+0000","last_clean":"2024-09-05T07:57:25.979677+0000","last_became_active":"2024-09-05T07:29:30.641255+0000","last_became_peered":"2024-09-05T07:29:30.641255+0000","last_unstale":"2024-09-05T07:57:25.979677+0000","last_undegraded":"2024-09-05T07:57:25.979677+0000","last_fullsized":"2024-09-05T07:57:25.979677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'102","last_scrub_stamp":"2024-09-05T07:57:25.979602+0000","last_deep_scrub":"24'102","last_deep_scrub_stamp":"2024-09-05T07:57:25.979602+0000","last_clean_scrub_stamp":"2024-09-05T07:57:25.979602+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:25:19.377544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":5219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"24'87","reported_seq":123,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:27.439764+0000","last_change":"2024-09-05T07:57:27.439805+0000","last_active":"2024-09-05T07:57:27.439764+0000","last_peered":"2024-09-05T07:57:27.439764+0000","last_clean":"2024-09-05T07:57:27.439764+0000","last_became_active":"2024-09-05T07:29:30.555796+0000","last_became_peered":"2024-09-05T07:29:30.555796+0000","last_unstale":"2024-09-05T07:57:27.439764+0000","last_undegraded":"2024-09-05T07:57:27.439764+0000","last_fullsized":"2024-09-05T07:57:27.439764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'87","last_scrub_stamp":"2024-09-05T07:57:27.439662+0000","last_deep_scrub":"24'87","last_deep_scrub_stamp":"2024-09-05T07:57:27.439662+0000","last_clean_scrub_stamp":"2024-09-05T07:57:27.439662+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:10:08.044130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":6302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"24'64","reported_seq":100,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:39.939575+0000","last_change":"2024-09-05T07:57:39.939601+0000","last_active":"2024-09-05T07:57:39.939575+0000","last_peered":"2024-09-05T07:57:39.939575+0000","last_clean":"2024-09-05T07:57:39.939575+0000","last_became_active":"2024-09-05T07:29:30.659070+0000","last_became_peered":"2024-09-05T07:29:30.659070+0000","last_unstale":"2024-09-05T07:57:39.939575+0000","last_undegraded":"2024-09-05T07:57:39.939575+0000","last_fullsized":"2024-09-05T07:57:39.939575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'64","last_scrub_stamp":"2024-09-05T07:57:39.939475+0000","last_deep_scrub":"24'64","last_deep_scrub_stamp":"2024-09-05T07:57:39.939475+0000","last_clean_scrub_stamp":"2024-09-05T07:57:39.939475+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:00:12.338605+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"24'73","reported_seq":109,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:25.257251+0000","last_change":"2024-09-05T07:57:25.257301+0000","last_active":"2024-09-05T07:57:25.257251+0000","last_peered":"2024-09-05T07:57:25.257251+0000","last_clean":"2024-09-05T07:57:25.257251+0000","last_became_active":"2024-09-05T07:29:30.565408+0000","last_became_peered":"2024-09-05T07:29:30.565408+0000","last_unstale":"2024-09-05T07:57:25.257251+0000","last_undegraded":"2024-09-05T07:57:25.257251+0000","last_fullsized":"2024-09-05T07:57:25.257251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'73","last_scrub_stamp":"2024-09-05T07:57:25.257127+0000","last_deep_scrub":"24'73","last_deep_scrub_stamp":"2024-09-05T07:57:25.257127+0000","last_clean_scrub_stamp":"2024-09-05T07:57:25.257127+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:33:18.691763+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":5244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"24'70","reported_seq":106,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:35.488064+0000","last_change":"2024-09-05T07:57:35.488087+0000","last_active":"2024-09-05T07:57:35.488064+0000","last_peered":"2024-09-05T07:57:35.488064+0000","last_clean":"2024-09-05T07:57:35.488064+0000","last_became_active":"2024-09-05T07:29:30.643587+0000","last_became_peered":"2024-09-05T07:29:30.643587+0000","last_unstale":"2024-09-05T07:57:35.488064+0000","last_undegraded":"2024-09-05T07:57:35.488064+0000","last_fullsized":"2024-09-05T07:57:35.488064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'70","last_scrub_stamp":"2024-09-05T07:57:35.487975+0000","last_deep_scrub":"24'70","last_deep_scrub_stamp":"2024-09-05T07:57:35.487975+0000","last_clean_scrub_stamp":"2024-09-05T07:57:35.487975+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:16:51.606266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":1781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"24'68","reported_seq":104,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:28.457961+0000","last_change":"2024-09-05T07:57:28.457996+0000","last_active":"2024-09-05T07:57:28.457961+0000","last_peered":"2024-09-05T07:57:28.457961+0000","last_clean":"2024-09-05T07:57:28.457961+0000","last_became_active":"2024-09-05T07:29:30.557039+0000","last_became_peered":"2024-09-05T07:29:30.557039+0000","last_unstale":"2024-09-05T07:57:28.457961+0000","last_undegraded":"2024-09-05T07:57:28.457961+0000","last_fullsized":"2024-09-05T07:57:28.457961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'68","last_scrub_stamp":"2024-09-05T07:57:28.457888+0000","last_deep_scrub":"24'68","last_deep_scrub_stamp":"2024-09-05T07:57:28.457888+0000","last_clean_scrub_stamp":"2024-09-05T07:57:28.457888+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:01:54.579747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"24'49","reported_seq":85,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:31.497859+0000","last_change":"2024-09-05T07:57:31.497882+0000","last_active":"2024-09-05T07:57:31.497859+0000","last_peered":"2024-09-05T07:57:31.497859+0000","last_clean":"2024-09-05T07:57:31.497859+0000","last_became_active":"2024-09-05T07:29:30.564271+0000","last_became_peered":"2024-09-05T07:29:30.564271+0000","last_unstale":"2024-09-05T07:57:31.497859+0000","last_undegraded":"2024-09-05T07:57:31.497859+0000","last_fullsized":"2024-09-05T07:57:31.497859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'49","last_scrub_stamp":"2024-09-05T07:57:31.497779+0000","last_deep_scrub":"24'49","last_deep_scrub_stamp":"2024-09-05T07:57:31.497779+0000","last_clean_scrub_stamp":"2024-09-05T07:57:31.497779+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:28:10.863512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":2250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"24'77","reported_seq":113,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:29.373004+0000","last_change":"2024-09-05T07:57:29.373040+0000","last_active":"2024-09-05T07:57:29.373004+0000","last_peered":"2024-09-05T07:57:29.373004+0000","last_clean":"2024-09-05T07:57:29.373004+0000","last_became_active":"2024-09-05T07:29:30.631588+0000","last_became_peered":"2024-09-05T07:29:30.631588+0000","last_unstale":"2024-09-05T07:57:29.373004+0000","last_undegraded":"2024-09-05T07:57:29.373004+0000","last_fullsized":"2024-09-05T07:57:29.373004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'77","last_scrub_stamp":"2024-09-05T07:57:29.372909+0000","last_deep_scrub":"24'77","last_deep_scrub_stamp":"2024-09-05T07:57:29.372909+0000","last_clean_scrub_stamp":"2024-09-05T07:57:29.372909+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:33:02.016733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"24'67","reported_seq":104,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:32.425864+0000","last_change":"2024-09-05T07:57:32.425889+0000","last_active":"2024-09-05T07:57:32.425864+0000","last_peered":"2024-09-05T07:57:32.425864+0000","last_clean":"2024-09-05T07:57:32.425864+0000","last_became_active":"2024-09-05T07:29:30.632528+0000","last_became_peered":"2024-09-05T07:29:30.632528+0000","last_unstale":"2024-09-05T07:57:32.425864+0000","last_undegraded":"2024-09-05T07:57:32.425864+0000","last_fullsized":"2024-09-05T07:57:32.425864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'67","last_scrub_stamp":"2024-09-05T07:57:32.425778+0000","last_deep_scrub":"24'67","last_deep_scrub_stamp":"2024-09-05T07:57:32.425778+0000","last_clean_scrub_stamp":"2024-09-05T07:57:32.425778+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:05:26.285452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":4207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"24'87","reported_seq":124,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:31.799955+0000","last_change":"2024-09-05T07:57:31.799955+0000","last_active":"2024-09-05T07:57:31.799955+0000","last_peered":"2024-09-05T07:57:31.799955+0000","last_clean":"2024-09-05T07:57:31.799955+0000","last_became_active":"2024-09-05T07:29:30.656997+0000","last_became_peered":"2024-09-05T07:29:30.656997+0000","last_unstale":"2024-09-05T07:57:31.799955+0000","last_undegraded":"2024-09-05T07:57:31.799955+0000","last_fullsized":"2024-09-05T07:57:31.799955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'87","last_scrub_stamp":"2024-09-05T07:57:31.799829+0000","last_deep_scrub":"24'87","last_deep_scrub_stamp":"2024-09-05T07:57:31.799829+0000","last_clean_scrub_stamp":"2024-09-05T07:57:31.799829+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:16:20.255930+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"24'76","reported_seq":113,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:39.857429+0000","last_change":"2024-09-05T07:57:39.857454+0000","last_active":"2024-09-05T07:57:39.857429+0000","last_peered":"2024-09-05T07:57:39.857429+0000","last_clean":"2024-09-05T07:57:39.857429+0000","last_became_active":"2024-09-05T07:29:30.641283+0000","last_became_peered":"2024-09-05T07:29:30.641283+0000","last_unstale":"2024-09-05T07:57:39.857429+0000","last_undegraded":"2024-09-05T07:57:39.857429+0000","last_fullsized":"2024-09-05T07:57:39.857429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'76","last_scrub_stamp":"2024-09-05T07:57:39.857327+0000","last_deep_scrub":"24'76","last_deep_scrub_stamp":"2024-09-05T07:57:39.857327+0000","last_clean_scrub_stamp":"2024-09-05T07:57:39.857327+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:17:52.923159+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"24'92","reported_seq":129,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:26.912048+0000","last_change":"2024-09-05T07:57:26.912048+0000","last_active":"2024-09-05T07:57:26.912048+0000","last_peered":"2024-09-05T07:57:26.912048+0000","last_clean":"2024-09-05T07:57:26.912048+0000","last_became_active":"2024-09-05T07:29:30.558105+0000","last_became_peered":"2024-09-05T07:29:30.558105+0000","last_unstale":"2024-09-05T07:57:26.912048+0000","last_undegraded":"2024-09-05T07:57:26.912048+0000","last_fullsized":"2024-09-05T07:57:26.912048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'92","last_scrub_stamp":"2024-09-05T07:57:26.911890+0000","last_deep_scrub":"24'92","last_deep_scrub_stamp":"2024-09-05T07:57:26.911890+0000","last_clean_scrub_stamp":"2024-09-05T07:57:26.911890+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:46:19.449549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":4227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"24'95","reported_seq":132,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:31.461592+0000","last_change":"2024-09-05T07:57:31.461592+0000","last_active":"2024-09-05T07:57:31.461592+0000","last_peered":"2024-09-05T07:57:31.461592+0000","last_clean":"2024-09-05T07:57:31.461592+0000","last_became_active":"2024-09-05T07:29:30.642876+0000","last_became_peered":"2024-09-05T07:29:30.642876+0000","last_unstale":"2024-09-05T07:57:31.461592+0000","last_undegraded":"2024-09-05T07:57:31.461592+0000","last_fullsized":"2024-09-05T07:57:31.461592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'95","last_scrub_stamp":"2024-09-05T07:57:31.461488+0000","last_deep_scrub":"24'95","last_deep_scrub_stamp":"2024-09-05T07:57:31.461488+0000","last_clean_scrub_stamp":"2024-09-05T07:57:31.461488+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:24:10.914726+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":9001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"24'66","reported_seq":103,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:23.894157+0000","last_change":"2024-09-05T07:57:23.894183+0000","last_active":"2024-09-05T07:57:23.894157+0000","last_peered":"2024-09-05T07:57:23.894157+0000","last_clean":"2024-09-05T07:57:23.894157+0000","last_became_active":"2024-09-05T07:29:30.556969+0000","last_became_peered":"2024-09-05T07:29:30.556969+0000","last_unstale":"2024-09-05T07:57:23.894157+0000","last_undegraded":"2024-09-05T07:57:23.894157+0000","last_fullsized":"2024-09-05T07:57:23.894157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'66","last_scrub_stamp":"2024-09-05T07:57:23.894068+0000","last_deep_scrub":"24'66","last_deep_scrub_stamp":"2024-09-05T07:57:23.894068+0000","last_clean_scrub_stamp":"2024-09-05T07:57:23.894068+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:42:59.867698+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":2884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"24'78","reported_seq":115,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:30.459151+0000","last_change":"2024-09-05T07:57:30.459175+0000","last_active":"2024-09-05T07:57:30.459151+0000","last_peered":"2024-09-05T07:57:30.459151+0000","last_clean":"2024-09-05T07:57:30.459151+0000","last_became_active":"2024-09-05T07:29:30.563808+0000","last_became_peered":"2024-09-05T07:29:30.563808+0000","last_unstale":"2024-09-05T07:57:30.459151+0000","last_undegraded":"2024-09-05T07:57:30.459151+0000","last_fullsized":"2024-09-05T07:57:30.459151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'78","last_scrub_stamp":"2024-09-05T07:57:30.459061+0000","last_deep_scrub":"24'78","last_deep_scrub_stamp":"2024-09-05T07:57:30.459061+0000","last_clean_scrub_stamp":"2024-09-05T07:57:30.459061+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:39:41.583547+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":5103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"24'109","reported_seq":146,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:35.628973+0000","last_change":"2024-09-05T07:57:35.629043+0000","last_active":"2024-09-05T07:57:35.628973+0000","last_peered":"2024-09-05T07:57:35.628973+0000","last_clean":"2024-09-05T07:57:35.628973+0000","last_became_active":"2024-09-05T07:29:30.643559+0000","last_became_peered":"2024-09-05T07:29:30.643559+0000","last_unstale":"2024-09-05T07:57:35.628973+0000","last_undegraded":"2024-09-05T07:57:35.628973+0000","last_fullsized":"2024-09-05T07:57:35.628973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'109","last_scrub_stamp":"2024-09-05T07:57:35.628868+0000","last_deep_scrub":"24'109","last_deep_scrub_stamp":"2024-09-05T07:57:35.628868+0000","last_clean_scrub_stamp":"2024-09-05T07:57:35.628868+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:42.944534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":8204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"24'68","reported_seq":105,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:24.253974+0000","last_change":"2024-09-05T07:57:24.254011+0000","last_active":"2024-09-05T07:57:24.253974+0000","last_peered":"2024-09-05T07:57:24.253974+0000","last_clean":"2024-09-05T07:57:24.253974+0000","last_became_active":"2024-09-05T07:29:30.564669+0000","last_became_peered":"2024-09-05T07:29:30.564669+0000","last_unstale":"2024-09-05T07:57:24.253974+0000","last_undegraded":"2024-09-05T07:57:24.253974+0000","last_fullsized":"2024-09-05T07:57:24.253974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'68","last_scrub_stamp":"2024-09-05T07:57:24.253885+0000","last_deep_scrub":"24'68","last_deep_scrub_stamp":"2024-09-05T07:57:24.253885+0000","last_clean_scrub_stamp":"2024-09-05T07:57:24.253885+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:03:17.647323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":2069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"24'75","reported_seq":112,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:30.783695+0000","last_change":"2024-09-05T07:57:30.783741+0000","last_active":"2024-09-05T07:57:30.783695+0000","last_peered":"2024-09-05T07:57:30.783695+0000","last_clean":"2024-09-05T07:57:30.783695+0000","last_became_active":"2024-09-05T07:29:30.656451+0000","last_became_peered":"2024-09-05T07:29:30.656451+0000","last_unstale":"2024-09-05T07:57:30.783695+0000","last_undegraded":"2024-09-05T07:57:30.783695+0000","last_fullsized":"2024-09-05T07:57:30.783695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'75","last_scrub_stamp":"2024-09-05T07:57:30.783571+0000","last_deep_scrub":"24'75","last_deep_scrub_stamp":"2024-09-05T07:57:30.783571+0000","last_clean_scrub_stamp":"2024-09-05T07:57:30.783571+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:43:06.757200+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":3632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"24'60","reported_seq":98,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:43.987173+0000","last_change":"2024-09-05T07:57:43.987173+0000","last_active":"2024-09-05T07:57:43.987173+0000","last_peered":"2024-09-05T07:57:43.987173+0000","last_clean":"2024-09-05T07:57:43.987173+0000","last_became_active":"2024-09-05T07:29:30.658207+0000","last_became_peered":"2024-09-05T07:29:30.658207+0000","last_unstale":"2024-09-05T07:57:43.987173+0000","last_undegraded":"2024-09-05T07:57:43.987173+0000","last_fullsized":"2024-09-05T07:57:43.987173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'60","last_scrub_stamp":"2024-09-05T07:57:43.986977+0000","last_deep_scrub":"24'60","last_deep_scrub_stamp":"2024-09-05T07:57:43.986977+0000","last_clean_scrub_stamp":"2024-09-05T07:57:43.986977+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:46:59.366939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":3656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"24'76","reported_seq":114,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:36.838769+0000","last_change":"2024-09-05T07:57:36.838769+0000","last_active":"2024-09-05T07:57:36.838769+0000","last_peered":"2024-09-05T07:57:36.838769+0000","last_clean":"2024-09-05T07:57:36.838769+0000","last_became_active":"2024-09-05T07:29:30.657177+0000","last_became_peered":"2024-09-05T07:29:30.657177+0000","last_unstale":"2024-09-05T07:57:36.838769+0000","last_undegraded":"2024-09-05T07:57:36.838769+0000","last_fullsized":"2024-09-05T07:57:36.838769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'76","last_scrub_stamp":"2024-09-05T07:57:36.838651+0000","last_deep_scrub":"24'76","last_deep_scrub_stamp":"2024-09-05T07:57:36.838651+0000","last_clean_scrub_stamp":"2024-09-05T07:57:36.838651+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:28:16.204384+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":7413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"24'76","reported_seq":114,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:30.022364+0000","last_change":"2024-09-05T07:57:30.022364+0000","last_active":"2024-09-05T07:57:30.022364+0000","last_peered":"2024-09-05T07:57:30.022364+0000","last_clean":"2024-09-05T07:57:30.022364+0000","last_became_active":"2024-09-05T07:29:30.641834+0000","last_became_peered":"2024-09-05T07:29:30.641834+0000","last_unstale":"2024-09-05T07:57:30.022364+0000","last_undegraded":"2024-09-05T07:57:30.022364+0000","last_fullsized":"2024-09-05T07:57:30.022364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'76","last_scrub_stamp":"2024-09-05T07:57:30.022252+0000","last_deep_scrub":"24'76","last_deep_scrub_stamp":"2024-09-05T07:57:30.022252+0000","last_clean_scrub_stamp":"2024-09-05T07:57:30.022252+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:02:51.707881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":3360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"24'83","reported_seq":121,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:33.423931+0000","last_change":"2024-09-05T07:57:33.423931+0000","last_active":"2024-09-05T07:57:33.423931+0000","last_peered":"2024-09-05T07:57:33.423931+0000","last_clean":"2024-09-05T07:57:33.423931+0000","last_became_active":"2024-09-05T07:29:30.633507+0000","last_became_peered":"2024-09-05T07:29:30.633507+0000","last_unstale":"2024-09-05T07:57:33.423931+0000","last_undegraded":"2024-09-05T07:57:33.423931+0000","last_fullsized":"2024-09-05T07:57:33.423931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'83","last_scrub_stamp":"2024-09-05T07:57:33.423826+0000","last_deep_scrub":"24'83","last_deep_scrub_stamp":"2024-09-05T07:57:33.423826+0000","last_clean_scrub_stamp":"2024-09-05T07:57:33.423826+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:36:12.958763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":5040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"24'50","reported_seq":88,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:31.434025+0000","last_change":"2024-09-05T07:57:31.434025+0000","last_active":"2024-09-05T07:57:31.434025+0000","last_peered":"2024-09-05T07:57:31.434025+0000","last_clean":"2024-09-05T07:57:31.434025+0000","last_became_active":"2024-09-05T07:29:30.632269+0000","last_became_peered":"2024-09-05T07:29:30.632269+0000","last_unstale":"2024-09-05T07:57:31.434025+0000","last_undegraded":"2024-09-05T07:57:31.434025+0000","last_fullsized":"2024-09-05T07:57:31.434025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'50","last_scrub_stamp":"2024-09-05T07:57:31.433866+0000","last_deep_scrub":"24'50","last_deep_scrub_stamp":"2024-09-05T07:57:31.433866+0000","last_clean_scrub_stamp":"2024-09-05T07:57:31.433866+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:37:01.245300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":6253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"24'73","reported_seq":111,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:29.799981+0000","last_change":"2024-09-05T07:57:29.800004+0000","last_active":"2024-09-05T07:57:29.799981+0000","last_peered":"2024-09-05T07:57:29.799981+0000","last_clean":"2024-09-05T07:57:29.799981+0000","last_became_active":"2024-09-05T07:29:30.656382+0000","last_became_peered":"2024-09-05T07:29:30.656382+0000","last_unstale":"2024-09-05T07:57:29.799981+0000","last_undegraded":"2024-09-05T07:57:29.799981+0000","last_fullsized":"2024-09-05T07:57:29.799981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'73","last_scrub_stamp":"2024-09-05T07:57:29.799892+0000","last_deep_scrub":"24'73","last_deep_scrub_stamp":"2024-09-05T07:57:29.799892+0000","last_clean_scrub_stamp":"2024-09-05T07:57:29.799892+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:09:01.558269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":7725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"24'117","reported_seq":155,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:42.958472+0000","last_change":"2024-09-05T07:57:42.958499+0000","last_active":"2024-09-05T07:57:42.958472+0000","last_peered":"2024-09-05T07:57:42.958472+0000","last_clean":"2024-09-05T07:57:42.958472+0000","last_became_active":"2024-09-05T07:29:30.657159+0000","last_became_peered":"2024-09-05T07:29:30.657159+0000","last_unstale":"2024-09-05T07:57:42.958472+0000","last_undegraded":"2024-09-05T07:57:42.958472+0000","last_fullsized":"2024-09-05T07:57:42.958472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'117","last_scrub_stamp":"2024-09-05T07:57:42.958376+0000","last_deep_scrub":"24'117","last_deep_scrub_stamp":"2024-09-05T07:57:42.958376+0000","last_clean_scrub_stamp":"2024-09-05T07:57:42.958376+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:38:26.448096+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":4986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"24'92","reported_seq":130,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:29.547761+0000","last_change":"2024-09-05T07:57:29.547788+0000","last_active":"2024-09-05T07:57:29.547761+0000","last_peered":"2024-09-05T07:57:29.547761+0000","last_clean":"2024-09-05T07:57:29.547761+0000","last_became_active":"2024-09-05T07:29:30.624605+0000","last_became_peered":"2024-09-05T07:29:30.624605+0000","last_unstale":"2024-09-05T07:57:29.547761+0000","last_undegraded":"2024-09-05T07:57:29.547761+0000","last_fullsized":"2024-09-05T07:57:29.547761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'92","last_scrub_stamp":"2024-09-05T07:57:29.547667+0000","last_deep_scrub":"24'92","last_deep_scrub_stamp":"2024-09-05T07:57:29.547667+0000","last_clean_scrub_stamp":"2024-09-05T07:57:29.547667+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:26:33.535477+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":7891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"24'80","reported_seq":118,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:28.056617+0000","last_change":"2024-09-05T07:57:28.056640+0000","last_active":"2024-09-05T07:57:28.056617+0000","last_peered":"2024-09-05T07:57:28.056617+0000","last_clean":"2024-09-05T07:57:28.056617+0000","last_became_active":"2024-09-05T07:29:30.642084+0000","last_became_peered":"2024-09-05T07:29:30.642084+0000","last_unstale":"2024-09-05T07:57:28.056617+0000","last_undegraded":"2024-09-05T07:57:28.056617+0000","last_fullsized":"2024-09-05T07:57:28.056617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'80","last_scrub_stamp":"2024-09-05T07:57:28.056542+0000","last_deep_scrub":"24'80","last_deep_scrub_stamp":"2024-09-05T07:57:28.056542+0000","last_clean_scrub_stamp":"2024-09-05T07:57:28.056542+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:25:19.241029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":4235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"24'60","reported_seq":96,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:27.276172+0000","last_change":"2024-09-05T07:57:27.276195+0000","last_active":"2024-09-05T07:57:27.276172+0000","last_peered":"2024-09-05T07:57:27.276172+0000","last_clean":"2024-09-05T07:57:27.276172+0000","last_became_active":"2024-09-05T07:29:30.657117+0000","last_became_peered":"2024-09-05T07:29:30.657117+0000","last_unstale":"2024-09-05T07:57:27.276172+0000","last_undegraded":"2024-09-05T07:57:27.276172+0000","last_fullsized":"2024-09-05T07:57:27.276172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'60","last_scrub_stamp":"2024-09-05T07:57:27.276093+0000","last_deep_scrub":"24'60","last_deep_scrub_stamp":"2024-09-05T07:57:27.276093+0000","last_clean_scrub_stamp":"2024-09-05T07:57:27.276093+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:44:52.571698+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":3534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"24'649","reported_seq":687,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:27.805468+0000","last_change":"2024-09-05T07:57:27.805515+0000","last_active":"2024-09-05T07:57:27.805468+0000","last_peered":"2024-09-05T07:57:27.805468+0000","last_clean":"2024-09-05T07:57:27.805468+0000","last_became_active":"2024-09-05T07:29:29.567846+0000","last_became_peered":"2024-09-05T07:29:29.567846+0000","last_unstale":"2024-09-05T07:57:27.805468+0000","last_undegraded":"2024-09-05T07:57:27.805468+0000","last_fullsized":"2024-09-05T07:57:27.805468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'649","last_scrub_stamp":"2024-09-05T07:57:27.805361+0000","last_deep_scrub":"24'649","last_deep_scrub_stamp":"2024-09-05T07:57:27.805361+0000","last_clean_scrub_stamp":"2024-09-05T07:57:27.805361+0000","objects_scrubbed":3,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:55:18.667411+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195510,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":639,"num_write_kb":4403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"24'89","reported_seq":125,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:29.575490+0000","last_change":"2024-09-05T07:57:29.575540+0000","last_active":"2024-09-05T07:57:29.575490+0000","last_peered":"2024-09-05T07:57:29.575490+0000","last_clean":"2024-09-05T07:57:29.575490+0000","last_became_active":"2024-09-05T07:29:30.557203+0000","last_became_peered":"2024-09-05T07:29:30.557203+0000","last_unstale":"2024-09-05T07:57:29.575490+0000","last_undegraded":"2024-09-05T07:57:29.575490+0000","last_fullsized":"2024-09-05T07:57:29.575490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'89","last_scrub_stamp":"2024-09-05T07:57:29.575356+0000","last_deep_scrub":"24'89","last_deep_scrub_stamp":"2024-09-05T07:57:29.575356+0000","last_clean_scrub_stamp":"2024-09-05T07:57:29.575356+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:14:42.985016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":6286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"24'602","reported_seq":640,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:30.872412+0000","last_change":"2024-09-05T07:57:30.872445+0000","last_active":"2024-09-05T07:57:30.872412+0000","last_peered":"2024-09-05T07:57:30.872412+0000","last_clean":"2024-09-05T07:57:30.872412+0000","last_became_active":"2024-09-05T07:29:29.524321+0000","last_became_peered":"2024-09-05T07:29:29.524321+0000","last_unstale":"2024-09-05T07:57:30.872412+0000","last_undegraded":"2024-09-05T07:57:30.872412+0000","last_fullsized":"2024-09-05T07:57:30.872412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'602","last_scrub_stamp":"2024-09-05T07:57:30.872328+0000","last_deep_scrub":"24'602","last_deep_scrub_stamp":"2024-09-05T07:57:30.872328+0000","last_clean_scrub_stamp":"2024-09-05T07:57:30.872328+0000","objects_scrubbed":4,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:58:14.214800+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"24'8","reported_seq":46,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:27.352100+0000","last_change":"2024-09-05T07:57:27.352131+0000","last_active":"2024-09-05T07:57:27.352100+0000","last_peered":"2024-09-05T07:57:27.352100+0000","last_clean":"2024-09-05T07:57:27.352100+0000","last_became_active":"2024-09-05T07:29:29.570456+0000","last_became_peered":"2024-09-05T07:29:29.570456+0000","last_unstale":"2024-09-05T07:57:27.352100+0000","last_undegraded":"2024-09-05T07:57:27.352100+0000","last_fullsized":"2024-09-05T07:57:27.352100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'8","last_scrub_stamp":"2024-09-05T07:57:27.352023+0000","last_deep_scrub":"24'8","last_deep_scrub_stamp":"2024-09-05T07:57:27.352023+0000","last_clean_scrub_stamp":"2024-09-05T07:57:27.352023+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:46:14.421308+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"24'84","reported_seq":120,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:32.801644+0000","last_change":"2024-09-05T07:57:32.801669+0000","last_active":"2024-09-05T07:57:32.801644+0000","last_peered":"2024-09-05T07:57:32.801644+0000","last_clean":"2024-09-05T07:57:32.801644+0000","last_became_active":"2024-09-05T07:29:30.657008+0000","last_became_peered":"2024-09-05T07:29:30.657008+0000","last_unstale":"2024-09-05T07:57:32.801644+0000","last_undegraded":"2024-09-05T07:57:32.801644+0000","last_fullsized":"2024-09-05T07:57:32.801644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'84","last_scrub_stamp":"2024-09-05T07:57:32.801543+0000","last_deep_scrub":"24'84","last_deep_scrub_stamp":"2024-09-05T07:57:32.801543+0000","last_clean_scrub_stamp":"2024-09-05T07:57:32.801543+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:52:08.741255+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":7830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"24'8","reported_seq":46,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:32.850082+0000","last_change":"2024-09-05T07:57:32.850182+0000","last_active":"2024-09-05T07:57:32.850082+0000","last_peered":"2024-09-05T07:57:32.850082+0000","last_clean":"2024-09-05T07:57:32.850082+0000","last_became_active":"2024-09-05T07:29:29.562520+0000","last_became_peered":"2024-09-05T07:29:29.562520+0000","last_unstale":"2024-09-05T07:57:32.850082+0000","last_undegraded":"2024-09-05T07:57:32.850082+0000","last_fullsized":"2024-09-05T07:57:32.850082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'8","last_scrub_stamp":"2024-09-05T07:57:32.849947+0000","last_deep_scrub":"24'8","last_deep_scrub_stamp":"2024-09-05T07:57:32.849947+0000","last_clean_scrub_stamp":"2024-09-05T07:57:32.849947+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:37:45.714232+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"24'88","reported_seq":124,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:30.601950+0000","last_change":"2024-09-05T07:57:30.601996+0000","last_active":"2024-09-05T07:57:30.601950+0000","last_peered":"2024-09-05T07:57:30.601950+0000","last_clean":"2024-09-05T07:57:30.601950+0000","last_became_active":"2024-09-05T07:29:30.562945+0000","last_became_peered":"2024-09-05T07:29:30.562945+0000","last_unstale":"2024-09-05T07:57:30.601950+0000","last_undegraded":"2024-09-05T07:57:30.601950+0000","last_fullsized":"2024-09-05T07:57:30.601950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'88","last_scrub_stamp":"2024-09-05T07:57:30.601825+0000","last_deep_scrub":"24'88","last_deep_scrub_stamp":"2024-09-05T07:57:30.601825+0000","last_clean_scrub_stamp":"2024-09-05T07:57:30.601825+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:18:02.325680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"24'15","reported_seq":53,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:23.243991+0000","last_change":"2024-09-05T07:57:23.244015+0000","last_active":"2024-09-05T07:57:23.243991+0000","last_peered":"2024-09-05T07:57:23.243991+0000","last_clean":"2024-09-05T07:57:23.243991+0000","last_became_active":"2024-09-05T07:29:29.558744+0000","last_became_peered":"2024-09-05T07:29:29.558744+0000","last_unstale":"2024-09-05T07:57:23.243991+0000","last_undegraded":"2024-09-05T07:57:23.243991+0000","last_fullsized":"2024-09-05T07:57:23.243991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'15","last_scrub_stamp":"2024-09-05T07:57:23.243924+0000","last_deep_scrub":"24'15","last_deep_scrub_stamp":"2024-09-05T07:57:23.243924+0000","last_clean_scrub_stamp":"2024-09-05T07:57:23.243924+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:42:29.701541+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"24'98","reported_seq":134,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:27.013551+0000","last_change":"2024-09-05T07:57:27.013577+0000","last_active":"2024-09-05T07:57:27.013551+0000","last_peered":"2024-09-05T07:57:27.013551+0000","last_clean":"2024-09-05T07:57:27.013551+0000","last_became_active":"2024-09-05T07:29:30.641360+0000","last_became_peered":"2024-09-05T07:29:30.641360+0000","last_unstale":"2024-09-05T07:57:27.013551+0000","last_undegraded":"2024-09-05T07:57:27.013551+0000","last_fullsized":"2024-09-05T07:57:27.013551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'98","last_scrub_stamp":"2024-09-05T07:57:27.013469+0000","last_deep_scrub":"24'98","last_deep_scrub_stamp":"2024-09-05T07:57:27.013469+0000","last_clean_scrub_stamp":"2024-09-05T07:57:27.013469+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:44:52.309074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":5807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"24'10","reported_seq":48,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:24.510047+0000","last_change":"2024-09-05T07:57:24.510091+0000","last_active":"2024-09-05T07:57:24.510047+0000","last_peered":"2024-09-05T07:57:24.510047+0000","last_clean":"2024-09-05T07:57:24.510047+0000","last_became_active":"2024-09-05T07:29:29.559717+0000","last_became_peered":"2024-09-05T07:29:29.559717+0000","last_unstale":"2024-09-05T07:57:24.510047+0000","last_undegraded":"2024-09-05T07:57:24.510047+0000","last_fullsized":"2024-09-05T07:57:24.510047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'10","last_scrub_stamp":"2024-09-05T07:57:24.509935+0000","last_deep_scrub":"24'10","last_deep_scrub_stamp":"2024-09-05T07:57:24.509935+0000","last_clean_scrub_stamp":"2024-09-05T07:57:24.509935+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:13:21.596151+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"24'57","reported_seq":93,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:34.824294+0000","last_change":"2024-09-05T07:57:34.824325+0000","last_active":"2024-09-05T07:57:34.824294+0000","last_peered":"2024-09-05T07:57:34.824294+0000","last_clean":"2024-09-05T07:57:34.824294+0000","last_became_active":"2024-09-05T07:29:30.657038+0000","last_became_peered":"2024-09-05T07:29:30.657038+0000","last_unstale":"2024-09-05T07:57:34.824294+0000","last_undegraded":"2024-09-05T07:57:34.824294+0000","last_fullsized":"2024-09-05T07:57:34.824294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'57","last_scrub_stamp":"2024-09-05T07:57:34.824190+0000","last_deep_scrub":"24'57","last_deep_scrub_stamp":"2024-09-05T07:57:34.824190+0000","last_clean_scrub_stamp":"2024-09-05T07:57:34.824190+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:50:49.770438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":3450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"24'616","reported_seq":654,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:26.538566+0000","last_change":"2024-09-05T07:57:26.538618+0000","last_active":"2024-09-05T07:57:26.538566+0000","last_peered":"2024-09-05T07:57:26.538566+0000","last_clean":"2024-09-05T07:57:26.538566+0000","last_became_active":"2024-09-05T07:29:29.566501+0000","last_became_peered":"2024-09-05T07:29:29.566501+0000","last_unstale":"2024-09-05T07:57:26.538566+0000","last_undegraded":"2024-09-05T07:57:26.538566+0000","last_fullsized":"2024-09-05T07:57:26.538566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'616","last_scrub_stamp":"2024-09-05T07:57:26.538461+0000","last_deep_scrub":"24'616","last_deep_scrub_stamp":"2024-09-05T07:57:26.538461+0000","last_clean_scrub_stamp":"2024-09-05T07:57:26.538461+0000","objects_scrubbed":4,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:33:38.471672+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":613,"num_write_kb":614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"24'72","reported_seq":109,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:41.910421+0000","last_change":"2024-09-05T07:57:41.910448+0000","last_active":"2024-09-05T07:57:41.910421+0000","last_peered":"2024-09-05T07:57:41.910421+0000","last_clean":"2024-09-05T07:57:41.910421+0000","last_became_active":"2024-09-05T07:29:30.641991+0000","last_became_peered":"2024-09-05T07:29:30.641991+0000","last_unstale":"2024-09-05T07:57:41.910421+0000","last_undegraded":"2024-09-05T07:57:41.910421+0000","last_fullsized":"2024-09-05T07:57:41.910421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'72","last_scrub_stamp":"2024-09-05T07:57:41.910324+0000","last_deep_scrub":"24'72","last_deep_scrub_stamp":"2024-09-05T07:57:41.910324+0000","last_clean_scrub_stamp":"2024-09-05T07:57:41.910324+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:57:59.839558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":2982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"24'837","reported_seq":876,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:22.971983+0000","last_change":"2024-09-05T07:57:22.971983+0000","last_active":"2024-09-05T07:57:22.971983+0000","last_peered":"2024-09-05T07:57:22.971983+0000","last_clean":"2024-09-05T07:57:22.971983+0000","last_became_active":"2024-09-05T07:29:29.562136+0000","last_became_peered":"2024-09-05T07:29:29.562136+0000","last_unstale":"2024-09-05T07:57:22.971983+0000","last_undegraded":"2024-09-05T07:57:22.971983+0000","last_fullsized":"2024-09-05T07:57:22.971983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'837","last_scrub_stamp":"2024-09-05T07:57:22.971866+0000","last_deep_scrub":"24'837","last_deep_scrub_stamp":"2024-09-05T07:57:22.971866+0000","last_clean_scrub_stamp":"2024-09-05T07:57:22.971866+0000","objects_scrubbed":6,"log_size":837,"log_dups_size":0,"ondisk_log_size":837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:46:11.796235+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":830,"num_write_kb":4536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"24'66","reported_seq":102,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:33.458942+0000","last_change":"2024-09-05T07:57:33.458983+0000","last_active":"2024-09-05T07:57:33.458942+0000","last_peered":"2024-09-05T07:57:33.458942+0000","last_clean":"2024-09-05T07:57:33.458942+0000","last_became_active":"2024-09-05T07:29:30.632784+0000","last_became_peered":"2024-09-05T07:29:30.632784+0000","last_unstale":"2024-09-05T07:57:33.458942+0000","last_undegraded":"2024-09-05T07:57:33.458942+0000","last_fullsized":"2024-09-05T07:57:33.458942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'66","last_scrub_stamp":"2024-09-05T07:57:33.458860+0000","last_deep_scrub":"24'66","last_deep_scrub_stamp":"2024-09-05T07:57:33.458860+0000","last_clean_scrub_stamp":"2024-09-05T07:57:33.458860+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:58:16.801333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":3605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'20","reported_seq":59,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:27.573326+0000","last_change":"2024-09-05T07:57:27.573326+0000","last_active":"2024-09-05T07:57:27.573326+0000","last_peered":"2024-09-05T07:57:27.573326+0000","last_clean":"2024-09-05T07:57:27.573326+0000","last_became_active":"2024-09-05T07:29:29.566934+0000","last_became_peered":"2024-09-05T07:29:29.566934+0000","last_unstale":"2024-09-05T07:57:27.573326+0000","last_undegraded":"2024-09-05T07:57:27.573326+0000","last_fullsized":"2024-09-05T07:57:27.573326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'20","last_scrub_stamp":"2024-09-05T07:57:27.573210+0000","last_deep_scrub":"24'20","last_deep_scrub_stamp":"2024-09-05T07:57:27.573210+0000","last_clean_scrub_stamp":"2024-09-05T07:57:27.573210+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:03:20.966648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"24'76","reported_seq":113,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:30.415157+0000","last_change":"2024-09-05T07:57:30.415157+0000","last_active":"2024-09-05T07:57:30.415157+0000","last_peered":"2024-09-05T07:57:30.415157+0000","last_clean":"2024-09-05T07:57:30.415157+0000","last_became_active":"2024-09-05T07:29:30.631974+0000","last_became_peered":"2024-09-05T07:29:30.631974+0000","last_unstale":"2024-09-05T07:57:30.415157+0000","last_undegraded":"2024-09-05T07:57:30.415157+0000","last_fullsized":"2024-09-05T07:57:30.415157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'76","last_scrub_stamp":"2024-09-05T07:57:30.415029+0000","last_deep_scrub":"24'76","last_deep_scrub_stamp":"2024-09-05T07:57:30.415029+0000","last_clean_scrub_stamp":"2024-09-05T07:57:30.415029+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:32:42.635981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"24'13","reported_seq":52,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:35.842659+0000","last_change":"2024-09-05T07:57:35.842687+0000","last_active":"2024-09-05T07:57:35.842659+0000","last_peered":"2024-09-05T07:57:35.842659+0000","last_clean":"2024-09-05T07:57:35.842659+0000","last_became_active":"2024-09-05T07:29:29.566754+0000","last_became_peered":"2024-09-05T07:29:29.566754+0000","last_unstale":"2024-09-05T07:57:35.842659+0000","last_undegraded":"2024-09-05T07:57:35.842659+0000","last_fullsized":"2024-09-05T07:57:35.842659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'13","last_scrub_stamp":"2024-09-05T07:57:35.842576+0000","last_deep_scrub":"24'13","last_deep_scrub_stamp":"2024-09-05T07:57:35.842576+0000","last_clean_scrub_stamp":"2024-09-05T07:57:35.842576+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:51:46.302451+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"24'97","reported_seq":134,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:36.840436+0000","last_change":"2024-09-05T07:57:36.840482+0000","last_active":"2024-09-05T07:57:36.840436+0000","last_peered":"2024-09-05T07:57:36.840436+0000","last_clean":"2024-09-05T07:57:36.840436+0000","last_became_active":"2024-09-05T07:29:30.558179+0000","last_became_peered":"2024-09-05T07:29:30.558179+0000","last_unstale":"2024-09-05T07:57:36.840436+0000","last_undegraded":"2024-09-05T07:57:36.840436+0000","last_fullsized":"2024-09-05T07:57:36.840436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'97","last_scrub_stamp":"2024-09-05T07:57:36.840327+0000","last_deep_scrub":"24'97","last_deep_scrub_stamp":"2024-09-05T07:57:36.840327+0000","last_clean_scrub_stamp":"2024-09-05T07:57:36.840327+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:16:16.764033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":15470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"24'12","reported_seq":51,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:22.554961+0000","last_change":"2024-09-05T07:57:22.554961+0000","last_active":"2024-09-05T07:57:22.554961+0000","last_peered":"2024-09-05T07:57:22.554961+0000","last_clean":"2024-09-05T07:57:22.554961+0000","last_became_active":"2024-09-05T07:29:29.525139+0000","last_became_peered":"2024-09-05T07:29:29.525139+0000","last_unstale":"2024-09-05T07:57:22.554961+0000","last_undegraded":"2024-09-05T07:57:22.554961+0000","last_fullsized":"2024-09-05T07:57:22.554961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'12","last_scrub_stamp":"2024-09-05T07:57:22.554806+0000","last_deep_scrub":"24'12","last_deep_scrub_stamp":"2024-09-05T07:57:22.554806+0000","last_clean_scrub_stamp":"2024-09-05T07:57:22.554806+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:21:10.839197+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1172,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"24'53","reported_seq":90,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:28.250327+0000","last_change":"2024-09-05T07:57:28.250327+0000","last_active":"2024-09-05T07:57:28.250327+0000","last_peered":"2024-09-05T07:57:28.250327+0000","last_clean":"2024-09-05T07:57:28.250327+0000","last_became_active":"2024-09-05T07:29:30.659311+0000","last_became_peered":"2024-09-05T07:29:30.659311+0000","last_unstale":"2024-09-05T07:57:28.250327+0000","last_undegraded":"2024-09-05T07:57:28.250327+0000","last_fullsized":"2024-09-05T07:57:28.250327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'53","last_scrub_stamp":"2024-09-05T07:57:28.250172+0000","last_deep_scrub":"24'53","last_deep_scrub_stamp":"2024-09-05T07:57:28.250172+0000","last_clean_scrub_stamp":"2024-09-05T07:57:28.250172+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:49:19.066773+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":2804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"24'30","reported_seq":69,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:28.559813+0000","last_change":"2024-09-05T07:57:28.559813+0000","last_active":"2024-09-05T07:57:28.559813+0000","last_peered":"2024-09-05T07:57:28.559813+0000","last_clean":"2024-09-05T07:57:28.559813+0000","last_became_active":"2024-09-05T07:29:29.566503+0000","last_became_peered":"2024-09-05T07:29:29.566503+0000","last_unstale":"2024-09-05T07:57:28.559813+0000","last_undegraded":"2024-09-05T07:57:28.559813+0000","last_fullsized":"2024-09-05T07:57:28.559813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'30","last_scrub_stamp":"2024-09-05T07:57:28.559652+0000","last_deep_scrub":"24'30","last_deep_scrub_stamp":"2024-09-05T07:57:28.559652+0000","last_clean_scrub_stamp":"2024-09-05T07:57:28.559652+0000","objects_scrubbed":8,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:14:30.243682+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"24'65","reported_seq":102,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:40.880473+0000","last_change":"2024-09-05T07:57:40.880497+0000","last_active":"2024-09-05T07:57:40.880473+0000","last_peered":"2024-09-05T07:57:40.880473+0000","last_clean":"2024-09-05T07:57:40.880473+0000","last_became_active":"2024-09-05T07:29:30.641309+0000","last_became_peered":"2024-09-05T07:29:30.641309+0000","last_unstale":"2024-09-05T07:57:40.880473+0000","last_undegraded":"2024-09-05T07:57:40.880473+0000","last_fullsized":"2024-09-05T07:57:40.880473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'65","last_scrub_stamp":"2024-09-05T07:57:40.880389+0000","last_deep_scrub":"24'65","last_deep_scrub_stamp":"2024-09-05T07:57:40.880389+0000","last_clean_scrub_stamp":"2024-09-05T07:57:40.880389+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:51:48.318350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":5311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"24'8","reported_seq":47,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:21.584696+0000","last_change":"2024-09-05T07:57:21.584725+0000","last_active":"2024-09-05T07:57:21.584696+0000","last_peered":"2024-09-05T07:57:21.584696+0000","last_clean":"2024-09-05T07:57:21.584696+0000","last_became_active":"2024-09-05T07:29:29.524522+0000","last_became_peered":"2024-09-05T07:29:29.524522+0000","last_unstale":"2024-09-05T07:57:21.584696+0000","last_undegraded":"2024-09-05T07:57:21.584696+0000","last_fullsized":"2024-09-05T07:57:21.584696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'8","last_scrub_stamp":"2024-09-05T07:57:21.584620+0000","last_deep_scrub":"24'8","last_deep_scrub_stamp":"2024-09-05T07:57:21.584620+0000","last_clean_scrub_stamp":"2024-09-05T07:57:21.584620+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:25:12.769108+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"24'36","reported_seq":73,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:29.025194+0000","last_change":"2024-09-05T07:57:29.025217+0000","last_active":"2024-09-05T07:57:29.025194+0000","last_peered":"2024-09-05T07:57:29.025194+0000","last_clean":"2024-09-05T07:57:29.025194+0000","last_became_active":"2024-09-05T07:29:30.641774+0000","last_became_peered":"2024-09-05T07:29:30.641774+0000","last_unstale":"2024-09-05T07:57:29.025194+0000","last_undegraded":"2024-09-05T07:57:29.025194+0000","last_fullsized":"2024-09-05T07:57:29.025194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'36","last_scrub_stamp":"2024-09-05T07:57:29.025120+0000","last_deep_scrub":"24'36","last_deep_scrub_stamp":"2024-09-05T07:57:29.025120+0000","last_clean_scrub_stamp":"2024-09-05T07:57:29.025120+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:21:17.309511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"24'9","reported_seq":48,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:24.496483+0000","last_change":"2024-09-05T07:57:24.496520+0000","last_active":"2024-09-05T07:57:24.496483+0000","last_peered":"2024-09-05T07:57:24.496483+0000","last_clean":"2024-09-05T07:57:24.496483+0000","last_became_active":"2024-09-05T07:29:29.525044+0000","last_became_peered":"2024-09-05T07:29:29.525044+0000","last_unstale":"2024-09-05T07:57:24.496483+0000","last_undegraded":"2024-09-05T07:57:24.496483+0000","last_fullsized":"2024-09-05T07:57:24.496483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'9","last_scrub_stamp":"2024-09-05T07:57:24.496406+0000","last_deep_scrub":"24'9","last_deep_scrub_stamp":"2024-09-05T07:57:24.496406+0000","last_clean_scrub_stamp":"2024-09-05T07:57:24.496406+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:46:11.565692+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"24'52","reported_seq":89,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:29.464753+0000","last_change":"2024-09-05T07:57:29.464777+0000","last_active":"2024-09-05T07:57:29.464753+0000","last_peered":"2024-09-05T07:57:29.464753+0000","last_clean":"2024-09-05T07:57:29.464753+0000","last_became_active":"2024-09-05T07:29:30.563408+0000","last_became_peered":"2024-09-05T07:29:30.563408+0000","last_unstale":"2024-09-05T07:57:29.464753+0000","last_undegraded":"2024-09-05T07:57:29.464753+0000","last_fullsized":"2024-09-05T07:57:29.464753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'52","last_scrub_stamp":"2024-09-05T07:57:29.464665+0000","last_deep_scrub":"24'52","last_deep_scrub_stamp":"2024-09-05T07:57:29.464665+0000","last_clean_scrub_stamp":"2024-09-05T07:57:29.464665+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:37:11.861995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":3705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'7","reported_seq":46,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:25.809370+0000","last_change":"2024-09-05T07:57:25.809413+0000","last_active":"2024-09-05T07:57:25.809370+0000","last_peered":"2024-09-05T07:57:25.809370+0000","last_clean":"2024-09-05T07:57:25.809370+0000","last_became_active":"2024-09-05T07:29:29.558856+0000","last_became_peered":"2024-09-05T07:29:29.558856+0000","last_unstale":"2024-09-05T07:57:25.809370+0000","last_undegraded":"2024-09-05T07:57:25.809370+0000","last_fullsized":"2024-09-05T07:57:25.809370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'7","last_scrub_stamp":"2024-09-05T07:57:25.809250+0000","last_deep_scrub":"24'7","last_deep_scrub_stamp":"2024-09-05T07:57:25.809250+0000","last_clean_scrub_stamp":"2024-09-05T07:57:25.809250+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:25:16.993737+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"24'61","reported_seq":98,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:32.452006+0000","last_change":"2024-09-05T07:57:32.452049+0000","last_active":"2024-09-05T07:57:32.452006+0000","last_peered":"2024-09-05T07:57:32.452006+0000","last_clean":"2024-09-05T07:57:32.452006+0000","last_became_active":"2024-09-05T07:29:30.624057+0000","last_became_peered":"2024-09-05T07:29:30.624057+0000","last_unstale":"2024-09-05T07:57:32.452006+0000","last_undegraded":"2024-09-05T07:57:32.452006+0000","last_fullsized":"2024-09-05T07:57:32.452006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'61","last_scrub_stamp":"2024-09-05T07:57:32.451885+0000","last_deep_scrub":"24'61","last_deep_scrub_stamp":"2024-09-05T07:57:32.451885+0000","last_clean_scrub_stamp":"2024-09-05T07:57:32.451885+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:01:09.469203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":4070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"24'16","reported_seq":55,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:28.385265+0000","last_change":"2024-09-05T07:57:28.385296+0000","last_active":"2024-09-05T07:57:28.385265+0000","last_peered":"2024-09-05T07:57:28.385265+0000","last_clean":"2024-09-05T07:57:28.385265+0000","last_became_active":"2024-09-05T07:29:29.570478+0000","last_became_peered":"2024-09-05T07:29:29.570478+0000","last_unstale":"2024-09-05T07:57:28.385265+0000","last_undegraded":"2024-09-05T07:57:28.385265+0000","last_fullsized":"2024-09-05T07:57:28.385265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'16","last_scrub_stamp":"2024-09-05T07:57:28.385191+0000","last_deep_scrub":"24'16","last_deep_scrub_stamp":"2024-09-05T07:57:28.385191+0000","last_clean_scrub_stamp":"2024-09-05T07:57:28.385191+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:20:32.831441+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1754,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"24'65","reported_seq":102,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:38.838664+0000","last_change":"2024-09-05T07:57:38.838689+0000","last_active":"2024-09-05T07:57:38.838664+0000","last_peered":"2024-09-05T07:57:38.838664+0000","last_clean":"2024-09-05T07:57:38.838664+0000","last_became_active":"2024-09-05T07:29:30.562824+0000","last_became_peered":"2024-09-05T07:29:30.562824+0000","last_unstale":"2024-09-05T07:57:38.838664+0000","last_undegraded":"2024-09-05T07:57:38.838664+0000","last_fullsized":"2024-09-05T07:57:38.838664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'65","last_scrub_stamp":"2024-09-05T07:57:38.838576+0000","last_deep_scrub":"24'65","last_deep_scrub_stamp":"2024-09-05T07:57:38.838576+0000","last_clean_scrub_stamp":"2024-09-05T07:57:38.838576+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:05:13.694244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":2542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"24'119","reported_seq":200,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:22.254530+0000","last_change":"2024-09-05T07:57:22.254581+0000","last_active":"2024-09-05T07:57:22.254530+0000","last_peered":"2024-09-05T07:57:22.254530+0000","last_clean":"2024-09-05T07:57:22.254530+0000","last_became_active":"2024-09-05T07:29:13.365841+0000","last_became_peered":"2024-09-05T07:29:13.365841+0000","last_unstale":"2024-09-05T07:57:22.254530+0000","last_undegraded":"2024-09-05T07:57:22.254530+0000","last_fullsized":"2024-09-05T07:57:22.254530+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'119","last_scrub_stamp":"2024-09-05T07:57:22.254416+0000","last_deep_scrub":"24'119","last_deep_scrub_stamp":"2024-09-05T07:57:22.254416+0000","last_clean_scrub_stamp":"2024-09-05T07:57:22.254416+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:31:10.108926+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"24'11","reported_seq":51,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:33.874793+0000","last_change":"2024-09-05T07:57:33.874831+0000","last_active":"2024-09-05T07:57:33.874793+0000","last_peered":"2024-09-05T07:57:33.874793+0000","last_clean":"2024-09-05T07:57:33.874793+0000","last_became_active":"2024-09-05T07:29:29.562956+0000","last_became_peered":"2024-09-05T07:29:29.562956+0000","last_unstale":"2024-09-05T07:57:33.874793+0000","last_undegraded":"2024-09-05T07:57:33.874793+0000","last_fullsized":"2024-09-05T07:57:33.874793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'11","last_scrub_stamp":"2024-09-05T07:57:33.874714+0000","last_deep_scrub":"24'11","last_deep_scrub_stamp":"2024-09-05T07:57:33.874714+0000","last_clean_scrub_stamp":"2024-09-05T07:57:33.874714+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:14:40.855054+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"24'54","reported_seq":92,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:34.612038+0000","last_change":"2024-09-05T07:57:34.612064+0000","last_active":"2024-09-05T07:57:34.612038+0000","last_peered":"2024-09-05T07:57:34.612038+0000","last_clean":"2024-09-05T07:57:34.612038+0000","last_became_active":"2024-09-05T07:29:30.641243+0000","last_became_peered":"2024-09-05T07:29:30.641243+0000","last_unstale":"2024-09-05T07:57:34.612038+0000","last_undegraded":"2024-09-05T07:57:34.612038+0000","last_fullsized":"2024-09-05T07:57:34.612038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'54","last_scrub_stamp":"2024-09-05T07:57:34.611944+0000","last_deep_scrub":"24'54","last_deep_scrub_stamp":"2024-09-05T07:57:34.611944+0000","last_clean_scrub_stamp":"2024-09-05T07:57:34.611944+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:33:16.262114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":3733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"24'326","reported_seq":367,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:28.914039+0000","last_change":"2024-09-05T07:57:28.914039+0000","last_active":"2024-09-05T07:57:28.914039+0000","last_peered":"2024-09-05T07:57:28.914039+0000","last_clean":"2024-09-05T07:57:28.914039+0000","last_became_active":"2024-09-05T07:29:29.479005+0000","last_became_peered":"2024-09-05T07:29:29.479005+0000","last_unstale":"2024-09-05T07:57:28.914039+0000","last_undegraded":"2024-09-05T07:57:28.914039+0000","last_fullsized":"2024-09-05T07:57:28.914039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'326","last_scrub_stamp":"2024-09-05T07:57:28.913931+0000","last_deep_scrub":"24'326","last_deep_scrub_stamp":"2024-09-05T07:57:28.913931+0000","last_clean_scrub_stamp":"2024-09-05T07:57:28.913931+0000","objects_scrubbed":2,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:28:08.279664+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3481379,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":316,"num_write_kb":3556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"24'55","reported_seq":93,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:34.395254+0000","last_change":"2024-09-05T07:57:34.395279+0000","last_active":"2024-09-05T07:57:34.395254+0000","last_peered":"2024-09-05T07:57:34.395254+0000","last_clean":"2024-09-05T07:57:34.395254+0000","last_became_active":"2024-09-05T07:29:30.641269+0000","last_became_peered":"2024-09-05T07:29:30.641269+0000","last_unstale":"2024-09-05T07:57:34.395254+0000","last_undegraded":"2024-09-05T07:57:34.395254+0000","last_fullsized":"2024-09-05T07:57:34.395254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'55","last_scrub_stamp":"2024-09-05T07:57:34.395171+0000","last_deep_scrub":"24'55","last_deep_scrub_stamp":"2024-09-05T07:57:34.395171+0000","last_clean_scrub_stamp":"2024-09-05T07:57:34.395171+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:18:22.840909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":2599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"24'882","reported_seq":1791,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:28.526046+0000","last_change":"2024-09-05T07:57:28.526101+0000","last_active":"2024-09-05T07:57:28.526046+0000","last_peered":"2024-09-05T07:57:28.526046+0000","last_clean":"2024-09-05T07:57:28.526046+0000","last_became_active":"2024-09-05T07:29:29.568576+0000","last_became_peered":"2024-09-05T07:29:29.568576+0000","last_unstale":"2024-09-05T07:57:28.526046+0000","last_undegraded":"2024-09-05T07:57:28.526046+0000","last_fullsized":"2024-09-05T07:57:28.526046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'882","last_scrub_stamp":"2024-09-05T07:57:28.525946+0000","last_deep_scrub":"24'882","last_deep_scrub_stamp":"2024-09-05T07:57:28.525946+0000","last_clean_scrub_stamp":"2024-09-05T07:57:28.525946+0000","objects_scrubbed":4,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:10:24.071012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182215,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":869,"num_read_kb":916,"num_write":877,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"24'71","reported_seq":110,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:40.979148+0000","last_change":"2024-09-05T07:57:40.979176+0000","last_active":"2024-09-05T07:57:40.979148+0000","last_peered":"2024-09-05T07:57:40.979148+0000","last_clean":"2024-09-05T07:57:40.979148+0000","last_became_active":"2024-09-05T07:29:30.659720+0000","last_became_peered":"2024-09-05T07:29:30.659720+0000","last_unstale":"2024-09-05T07:57:40.979148+0000","last_undegraded":"2024-09-05T07:57:40.979148+0000","last_fullsized":"2024-09-05T07:57:40.979148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'71","last_scrub_stamp":"2024-09-05T07:57:40.979052+0000","last_deep_scrub":"24'71","last_deep_scrub_stamp":"2024-09-05T07:57:40.979052+0000","last_clean_scrub_stamp":"2024-09-05T07:57:40.979052+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:37:53.843337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":2450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"24'10","reported_seq":50,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:27.950576+0000","last_change":"2024-09-05T07:57:27.950624+0000","last_active":"2024-09-05T07:57:27.950576+0000","last_peered":"2024-09-05T07:57:27.950576+0000","last_clean":"2024-09-05T07:57:27.950576+0000","last_became_active":"2024-09-05T07:29:29.568307+0000","last_became_peered":"2024-09-05T07:29:29.568307+0000","last_unstale":"2024-09-05T07:57:27.950576+0000","last_undegraded":"2024-09-05T07:57:27.950576+0000","last_fullsized":"2024-09-05T07:57:27.950576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'10","last_scrub_stamp":"2024-09-05T07:57:27.950485+0000","last_deep_scrub":"24'10","last_deep_scrub_stamp":"2024-09-05T07:57:27.950485+0000","last_clean_scrub_stamp":"2024-09-05T07:57:27.950485+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:39:39.074971+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"24'89","reported_seq":127,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:34.448403+0000","last_change":"2024-09-05T07:57:34.448429+0000","last_active":"2024-09-05T07:57:34.448403+0000","last_peered":"2024-09-05T07:57:34.448403+0000","last_clean":"2024-09-05T07:57:34.448403+0000","last_became_active":"2024-09-05T07:29:30.642414+0000","last_became_peered":"2024-09-05T07:29:30.642414+0000","last_unstale":"2024-09-05T07:57:34.448403+0000","last_undegraded":"2024-09-05T07:57:34.448403+0000","last_fullsized":"2024-09-05T07:57:34.448403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'89","last_scrub_stamp":"2024-09-05T07:57:34.448308+0000","last_deep_scrub":"24'89","last_deep_scrub_stamp":"2024-09-05T07:57:34.448308+0000","last_clean_scrub_stamp":"2024-09-05T07:57:34.448308+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:24:06.040697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":7430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"24'5","reported_seq":45,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:28.813463+0000","last_change":"2024-09-05T07:57:28.813486+0000","last_active":"2024-09-05T07:57:28.813463+0000","last_peered":"2024-09-05T07:57:28.813463+0000","last_clean":"2024-09-05T07:57:28.813463+0000","last_became_active":"2024-09-05T07:29:29.568499+0000","last_became_peered":"2024-09-05T07:29:29.568499+0000","last_unstale":"2024-09-05T07:57:28.813463+0000","last_undegraded":"2024-09-05T07:57:28.813463+0000","last_fullsized":"2024-09-05T07:57:28.813463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'5","last_scrub_stamp":"2024-09-05T07:57:28.813379+0000","last_deep_scrub":"24'5","last_deep_scrub_stamp":"2024-09-05T07:57:28.813379+0000","last_clean_scrub_stamp":"2024-09-05T07:57:28.813379+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:13:25.899595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"24'66","reported_seq":104,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:24.976104+0000","last_change":"2024-09-05T07:57:24.976133+0000","last_active":"2024-09-05T07:57:24.976104+0000","last_peered":"2024-09-05T07:57:24.976104+0000","last_clean":"2024-09-05T07:57:24.976104+0000","last_became_active":"2024-09-05T07:29:30.640805+0000","last_became_peered":"2024-09-05T07:29:30.640805+0000","last_unstale":"2024-09-05T07:57:24.976104+0000","last_undegraded":"2024-09-05T07:57:24.976104+0000","last_fullsized":"2024-09-05T07:57:24.976104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'66","last_scrub_stamp":"2024-09-05T07:57:24.976013+0000","last_deep_scrub":"24'66","last_deep_scrub_stamp":"2024-09-05T07:57:24.976013+0000","last_clean_scrub_stamp":"2024-09-05T07:57:24.976013+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:33:18.410649+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":1781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"24'11","reported_seq":51,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:31.841829+0000","last_change":"2024-09-05T07:57:31.841897+0000","last_active":"2024-09-05T07:57:31.841829+0000","last_peered":"2024-09-05T07:57:31.841829+0000","last_clean":"2024-09-05T07:57:31.841829+0000","last_became_active":"2024-09-05T07:29:29.524918+0000","last_became_peered":"2024-09-05T07:29:29.524918+0000","last_unstale":"2024-09-05T07:57:31.841829+0000","last_undegraded":"2024-09-05T07:57:31.841829+0000","last_fullsized":"2024-09-05T07:57:31.841829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'11","last_scrub_stamp":"2024-09-05T07:57:31.841706+0000","last_deep_scrub":"24'11","last_deep_scrub_stamp":"2024-09-05T07:57:31.841706+0000","last_clean_scrub_stamp":"2024-09-05T07:57:31.841706+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:00:04.240836+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"24'64","reported_seq":102,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:35.414702+0000","last_change":"2024-09-05T07:57:35.414757+0000","last_active":"2024-09-05T07:57:35.414702+0000","last_peered":"2024-09-05T07:57:35.414702+0000","last_clean":"2024-09-05T07:57:35.414702+0000","last_became_active":"2024-09-05T07:29:30.658155+0000","last_became_peered":"2024-09-05T07:29:30.658155+0000","last_unstale":"2024-09-05T07:57:35.414702+0000","last_undegraded":"2024-09-05T07:57:35.414702+0000","last_fullsized":"2024-09-05T07:57:35.414702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'64","last_scrub_stamp":"2024-09-05T07:57:35.414603+0000","last_deep_scrub":"24'64","last_deep_scrub_stamp":"2024-09-05T07:57:35.414603+0000","last_clean_scrub_stamp":"2024-09-05T07:57:35.414603+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:09:54.791121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":2545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"24'1352","reported_seq":1392,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:26.488637+0000","last_change":"2024-09-05T07:57:26.488637+0000","last_active":"2024-09-05T07:57:26.488637+0000","last_peered":"2024-09-05T07:57:26.488637+0000","last_clean":"2024-09-05T07:57:26.488637+0000","last_became_active":"2024-09-05T07:29:29.526421+0000","last_became_peered":"2024-09-05T07:29:29.526421+0000","last_unstale":"2024-09-05T07:57:26.488637+0000","last_undegraded":"2024-09-05T07:57:26.488637+0000","last_fullsized":"2024-09-05T07:57:26.488637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'1352","last_scrub_stamp":"2024-09-05T07:57:26.488499+0000","last_deep_scrub":"24'1352","last_deep_scrub_stamp":"2024-09-05T07:57:26.488499+0000","last_clean_scrub_stamp":"2024-09-05T07:57:26.488499+0000","objects_scrubbed":4,"log_size":1352,"log_dups_size":0,"ondisk_log_size":1352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:32:59.132324+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3429,"num_write_kb":1221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"24'72","reported_seq":110,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:33.649756+0000","last_change":"2024-09-05T07:57:33.649756+0000","last_active":"2024-09-05T07:57:33.649756+0000","last_peered":"2024-09-05T07:57:33.649756+0000","last_clean":"2024-09-05T07:57:33.649756+0000","last_became_active":"2024-09-05T07:29:30.633535+0000","last_became_peered":"2024-09-05T07:29:30.633535+0000","last_unstale":"2024-09-05T07:57:33.649756+0000","last_undegraded":"2024-09-05T07:57:33.649756+0000","last_fullsized":"2024-09-05T07:57:33.649756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'72","last_scrub_stamp":"2024-09-05T07:57:33.649637+0000","last_deep_scrub":"24'72","last_deep_scrub_stamp":"2024-09-05T07:57:33.649637+0000","last_clean_scrub_stamp":"2024-09-05T07:57:33.649637+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:09:38.832653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"24'16","reported_seq":56,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:29.893611+0000","last_change":"2024-09-05T07:57:29.893611+0000","last_active":"2024-09-05T07:57:29.893611+0000","last_peered":"2024-09-05T07:57:29.893611+0000","last_clean":"2024-09-05T07:57:29.893611+0000","last_became_active":"2024-09-05T07:29:29.524268+0000","last_became_peered":"2024-09-05T07:29:29.524268+0000","last_unstale":"2024-09-05T07:57:29.893611+0000","last_undegraded":"2024-09-05T07:57:29.893611+0000","last_fullsized":"2024-09-05T07:57:29.893611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'16","last_scrub_stamp":"2024-09-05T07:57:29.893498+0000","last_deep_scrub":"24'16","last_deep_scrub_stamp":"2024-09-05T07:57:29.893498+0000","last_clean_scrub_stamp":"2024-09-05T07:57:29.893498+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:31:33.782733+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'84","reported_seq":122,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:31.589425+0000","last_change":"2024-09-05T07:57:31.589425+0000","last_active":"2024-09-05T07:57:31.589425+0000","last_peered":"2024-09-05T07:57:31.589425+0000","last_clean":"2024-09-05T07:57:31.589425+0000","last_became_active":"2024-09-05T07:29:30.624117+0000","last_became_peered":"2024-09-05T07:29:30.624117+0000","last_unstale":"2024-09-05T07:57:31.589425+0000","last_undegraded":"2024-09-05T07:57:31.589425+0000","last_fullsized":"2024-09-05T07:57:31.589425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'84","last_scrub_stamp":"2024-09-05T07:57:31.589309+0000","last_deep_scrub":"24'84","last_deep_scrub_stamp":"2024-09-05T07:57:31.589309+0000","last_clean_scrub_stamp":"2024-09-05T07:57:31.589309+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:02:13.811981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":5195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'10","reported_seq":50,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:25.459897+0000","last_change":"2024-09-05T07:57:25.459897+0000","last_active":"2024-09-05T07:57:25.459897+0000","last_peered":"2024-09-05T07:57:25.459897+0000","last_clean":"2024-09-05T07:57:25.459897+0000","last_became_active":"2024-09-05T07:29:29.561026+0000","last_became_peered":"2024-09-05T07:29:29.561026+0000","last_unstale":"2024-09-05T07:57:25.459897+0000","last_undegraded":"2024-09-05T07:57:25.459897+0000","last_fullsized":"2024-09-05T07:57:25.459897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'10","last_scrub_stamp":"2024-09-05T07:57:25.459803+0000","last_deep_scrub":"24'10","last_deep_scrub_stamp":"2024-09-05T07:57:25.459803+0000","last_clean_scrub_stamp":"2024-09-05T07:57:25.459803+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:43:01.433432+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"24'80","reported_seq":118,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:25.875993+0000","last_change":"2024-09-05T07:57:25.875993+0000","last_active":"2024-09-05T07:57:25.875993+0000","last_peered":"2024-09-05T07:57:25.875993+0000","last_clean":"2024-09-05T07:57:25.875993+0000","last_became_active":"2024-09-05T07:29:30.556627+0000","last_became_peered":"2024-09-05T07:29:30.556627+0000","last_unstale":"2024-09-05T07:57:25.875993+0000","last_undegraded":"2024-09-05T07:57:25.875993+0000","last_fullsized":"2024-09-05T07:57:25.875993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'80","last_scrub_stamp":"2024-09-05T07:57:25.875888+0000","last_deep_scrub":"24'80","last_deep_scrub_stamp":"2024-09-05T07:57:25.875888+0000","last_clean_scrub_stamp":"2024-09-05T07:57:25.875888+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:10:06.480356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":7503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"24'15","reported_seq":55,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:27.536913+0000","last_change":"2024-09-05T07:57:27.536913+0000","last_active":"2024-09-05T07:57:27.536913+0000","last_peered":"2024-09-05T07:57:27.536913+0000","last_clean":"2024-09-05T07:57:27.536913+0000","last_became_active":"2024-09-05T07:29:29.526572+0000","last_became_peered":"2024-09-05T07:29:29.526572+0000","last_unstale":"2024-09-05T07:57:27.536913+0000","last_undegraded":"2024-09-05T07:57:27.536913+0000","last_fullsized":"2024-09-05T07:57:27.536913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'15","last_scrub_stamp":"2024-09-05T07:57:27.536801+0000","last_deep_scrub":"24'15","last_deep_scrub_stamp":"2024-09-05T07:57:27.536801+0000","last_clean_scrub_stamp":"2024-09-05T07:57:27.536801+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:56:55.931527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"24'71","reported_seq":109,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:32.628607+0000","last_change":"2024-09-05T07:57:32.628607+0000","last_active":"2024-09-05T07:57:32.628607+0000","last_peered":"2024-09-05T07:57:32.628607+0000","last_clean":"2024-09-05T07:57:32.628607+0000","last_became_active":"2024-09-05T07:29:30.624109+0000","last_became_peered":"2024-09-05T07:29:30.624109+0000","last_unstale":"2024-09-05T07:57:32.628607+0000","last_undegraded":"2024-09-05T07:57:32.628607+0000","last_fullsized":"2024-09-05T07:57:32.628607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'71","last_scrub_stamp":"2024-09-05T07:57:32.628472+0000","last_deep_scrub":"24'71","last_deep_scrub_stamp":"2024-09-05T07:57:32.628472+0000","last_clean_scrub_stamp":"2024-09-05T07:57:32.628472+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T15:29:23.564777+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":2208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"24'7","reported_seq":47,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:26.384758+0000","last_change":"2024-09-05T07:57:26.384758+0000","last_active":"2024-09-05T07:57:26.384758+0000","last_peered":"2024-09-05T07:57:26.384758+0000","last_clean":"2024-09-05T07:57:26.384758+0000","last_became_active":"2024-09-05T07:29:29.569536+0000","last_became_peered":"2024-09-05T07:29:29.569536+0000","last_unstale":"2024-09-05T07:57:26.384758+0000","last_undegraded":"2024-09-05T07:57:26.384758+0000","last_fullsized":"2024-09-05T07:57:26.384758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'7","last_scrub_stamp":"2024-09-05T07:57:26.384641+0000","last_deep_scrub":"24'7","last_deep_scrub_stamp":"2024-09-05T07:57:26.384641+0000","last_clean_scrub_stamp":"2024-09-05T07:57:26.384641+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:19:38.647034+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"24'86","reported_seq":123,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:30.510675+0000","last_change":"2024-09-05T07:57:30.510702+0000","last_active":"2024-09-05T07:57:30.510675+0000","last_peered":"2024-09-05T07:57:30.510675+0000","last_clean":"2024-09-05T07:57:30.510675+0000","last_became_active":"2024-09-05T07:29:30.632502+0000","last_became_peered":"2024-09-05T07:29:30.632502+0000","last_unstale":"2024-09-05T07:57:30.510675+0000","last_undegraded":"2024-09-05T07:57:30.510675+0000","last_fullsized":"2024-09-05T07:57:30.510675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'86","last_scrub_stamp":"2024-09-05T07:57:30.510577+0000","last_deep_scrub":"24'86","last_deep_scrub_stamp":"2024-09-05T07:57:30.510577+0000","last_clean_scrub_stamp":"2024-09-05T07:57:30.510577+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:30:28.162182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":4049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"24'548","reported_seq":587,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:34.850475+0000","last_change":"2024-09-05T07:57:34.850546+0000","last_active":"2024-09-05T07:57:34.850475+0000","last_peered":"2024-09-05T07:57:34.850475+0000","last_clean":"2024-09-05T07:57:34.850475+0000","last_became_active":"2024-09-05T07:29:29.563316+0000","last_became_peered":"2024-09-05T07:29:29.563316+0000","last_unstale":"2024-09-05T07:57:34.850475+0000","last_undegraded":"2024-09-05T07:57:34.850475+0000","last_fullsized":"2024-09-05T07:57:34.850475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'548","last_scrub_stamp":"2024-09-05T07:57:34.850360+0000","last_deep_scrub":"24'548","last_deep_scrub_stamp":"2024-09-05T07:57:34.850360+0000","last_clean_scrub_stamp":"2024-09-05T07:57:34.850360+0000","objects_scrubbed":3,"log_size":548,"log_dups_size":0,"ondisk_log_size":548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:21:26.021314+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":542,"num_write_kb":4368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"24'76","reported_seq":114,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:37.814904+0000","last_change":"2024-09-05T07:57:37.814904+0000","last_active":"2024-09-05T07:57:37.814904+0000","last_peered":"2024-09-05T07:57:37.814904+0000","last_clean":"2024-09-05T07:57:37.814904+0000","last_became_active":"2024-09-05T07:29:30.562776+0000","last_became_peered":"2024-09-05T07:29:30.562776+0000","last_unstale":"2024-09-05T07:57:37.814904+0000","last_undegraded":"2024-09-05T07:57:37.814904+0000","last_fullsized":"2024-09-05T07:57:37.814904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'76","last_scrub_stamp":"2024-09-05T07:57:37.814788+0000","last_deep_scrub":"24'76","last_deep_scrub_stamp":"2024-09-05T07:57:37.814788+0000","last_clean_scrub_stamp":"2024-09-05T07:57:37.814788+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:54:04.184644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":1880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"24'79","reported_seq":115,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:24.857320+0000","last_change":"2024-09-05T07:57:24.857344+0000","last_active":"2024-09-05T07:57:24.857320+0000","last_peered":"2024-09-05T07:57:24.857320+0000","last_clean":"2024-09-05T07:57:24.857320+0000","last_became_active":"2024-09-05T07:29:30.557747+0000","last_became_peered":"2024-09-05T07:29:30.557747+0000","last_unstale":"2024-09-05T07:57:24.857320+0000","last_undegraded":"2024-09-05T07:57:24.857320+0000","last_fullsized":"2024-09-05T07:57:24.857320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'79","last_scrub_stamp":"2024-09-05T07:57:24.857247+0000","last_deep_scrub":"24'79","last_deep_scrub_stamp":"2024-09-05T07:57:24.857247+0000","last_clean_scrub_stamp":"2024-09-05T07:57:24.857247+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:16:13.313348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":6364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"24'12","reported_seq":50,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:26.464427+0000","last_change":"2024-09-05T07:57:26.464476+0000","last_active":"2024-09-05T07:57:26.464427+0000","last_peered":"2024-09-05T07:57:26.464427+0000","last_clean":"2024-09-05T07:57:26.464427+0000","last_became_active":"2024-09-05T07:29:29.561065+0000","last_became_peered":"2024-09-05T07:29:29.561065+0000","last_unstale":"2024-09-05T07:57:26.464427+0000","last_undegraded":"2024-09-05T07:57:26.464427+0000","last_fullsized":"2024-09-05T07:57:26.464427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'12","last_scrub_stamp":"2024-09-05T07:57:26.464322+0000","last_deep_scrub":"24'12","last_deep_scrub_stamp":"2024-09-05T07:57:26.464322+0000","last_clean_scrub_stamp":"2024-09-05T07:57:26.464322+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:16:14.920422+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"24'45","reported_seq":81,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:26.266422+0000","last_change":"2024-09-05T07:57:26.266466+0000","last_active":"2024-09-05T07:57:26.266422+0000","last_peered":"2024-09-05T07:57:26.266422+0000","last_clean":"2024-09-05T07:57:26.266422+0000","last_became_active":"2024-09-05T07:29:30.565787+0000","last_became_peered":"2024-09-05T07:29:30.565787+0000","last_unstale":"2024-09-05T07:57:26.266422+0000","last_undegraded":"2024-09-05T07:57:26.266422+0000","last_fullsized":"2024-09-05T07:57:26.266422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'45","last_scrub_stamp":"2024-09-05T07:57:26.266317+0000","last_deep_scrub":"24'45","last_deep_scrub_stamp":"2024-09-05T07:57:26.266317+0000","last_clean_scrub_stamp":"2024-09-05T07:57:26.266317+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:25:19.664259+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":3021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"24'1213","reported_seq":1251,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:23.550010+0000","last_change":"2024-09-05T07:57:23.550048+0000","last_active":"2024-09-05T07:57:23.550010+0000","last_peered":"2024-09-05T07:57:23.550010+0000","last_clean":"2024-09-05T07:57:23.550010+0000","last_became_active":"2024-09-05T07:29:29.559675+0000","last_became_peered":"2024-09-05T07:29:29.559675+0000","last_unstale":"2024-09-05T07:57:23.550010+0000","last_undegraded":"2024-09-05T07:57:23.550010+0000","last_fullsized":"2024-09-05T07:57:23.550010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'1213","last_scrub_stamp":"2024-09-05T07:57:23.549927+0000","last_deep_scrub":"24'1213","last_deep_scrub_stamp":"2024-09-05T07:57:23.549927+0000","last_clean_scrub_stamp":"2024-09-05T07:57:23.549927+0000","objects_scrubbed":9,"log_size":1213,"log_dups_size":0,"ondisk_log_size":1213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:02:45.235555+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1200,"num_write_kb":8869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"24'101","reported_seq":139,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:33.779947+0000","last_change":"2024-09-05T07:57:33.779973+0000","last_active":"2024-09-05T07:57:33.779947+0000","last_peered":"2024-09-05T07:57:33.779947+0000","last_clean":"2024-09-05T07:57:33.779947+0000","last_became_active":"2024-09-05T07:29:30.656876+0000","last_became_peered":"2024-09-05T07:29:30.656876+0000","last_unstale":"2024-09-05T07:57:33.779947+0000","last_undegraded":"2024-09-05T07:57:33.779947+0000","last_fullsized":"2024-09-05T07:57:33.779947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'101","last_scrub_stamp":"2024-09-05T07:57:33.779856+0000","last_deep_scrub":"24'101","last_deep_scrub_stamp":"2024-09-05T07:57:33.779856+0000","last_clean_scrub_stamp":"2024-09-05T07:57:33.779856+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:46:26.317515+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":8259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"24'717","reported_seq":758,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:26.823865+0000","last_change":"2024-09-05T07:57:26.823865+0000","last_active":"2024-09-05T07:57:26.823865+0000","last_peered":"2024-09-05T07:57:26.823865+0000","last_clean":"2024-09-05T07:57:26.823865+0000","last_became_active":"2024-09-05T07:29:29.567129+0000","last_became_peered":"2024-09-05T07:29:29.567129+0000","last_unstale":"2024-09-05T07:57:26.823865+0000","last_undegraded":"2024-09-05T07:57:26.823865+0000","last_fullsized":"2024-09-05T07:57:26.823865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'717","last_scrub_stamp":"2024-09-05T07:57:26.823777+0000","last_deep_scrub":"24'717","last_deep_scrub_stamp":"2024-09-05T07:57:26.823777+0000","last_clean_scrub_stamp":"2024-09-05T07:57:26.823777+0000","objects_scrubbed":1,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:21:15.108168+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":711,"num_write_kb":4517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"24'60","reported_seq":99,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:35.857690+0000","last_change":"2024-09-05T07:57:35.857713+0000","last_active":"2024-09-05T07:57:35.857690+0000","last_peered":"2024-09-05T07:57:35.857690+0000","last_clean":"2024-09-05T07:57:35.857690+0000","last_became_active":"2024-09-05T07:29:30.657625+0000","last_became_peered":"2024-09-05T07:29:30.657625+0000","last_unstale":"2024-09-05T07:57:35.857690+0000","last_undegraded":"2024-09-05T07:57:35.857690+0000","last_fullsized":"2024-09-05T07:57:35.857690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'60","last_scrub_stamp":"2024-09-05T07:57:35.857607+0000","last_deep_scrub":"24'60","last_deep_scrub_stamp":"2024-09-05T07:57:35.857607+0000","last_clean_scrub_stamp":"2024-09-05T07:57:35.857607+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:39:46.982093+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":2166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"24'594","reported_seq":634,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-05T07:57:25.514937+0000","last_change":"2024-09-05T07:57:25.514971+0000","last_active":"2024-09-05T07:57:25.514937+0000","last_peered":"2024-09-05T07:57:25.514937+0000","last_clean":"2024-09-05T07:57:25.514937+0000","last_became_active":"2024-09-05T07:29:29.525832+0000","last_became_peered":"2024-09-05T07:29:29.525832+0000","last_unstale":"2024-09-05T07:57:25.514937+0000","last_undegraded":"2024-09-05T07:57:25.514937+0000","last_fullsized":"2024-09-05T07:57:25.514937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'594","last_scrub_stamp":"2024-09-05T07:57:25.514845+0000","last_deep_scrub":"24'594","last_deep_scrub_stamp":"2024-09-05T07:57:25.514845+0000","last_clean_scrub_stamp":"2024-09-05T07:57:25.514845+0000","objects_scrubbed":7,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T16:20:29.961094+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3789,"num_write_kb":295314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4716,"ondisk_log_size":4716,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":37226760,"num_objects":107,"num_object_clones":0,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":869,"num_read_kb":916,"num_write":10472,"num_write_kb":41821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":74694656,"data_stored":74453520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8589,"ondisk_log_size":8589,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":16,"seq":68719477089,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61848,"kb_used_data":12616,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94309992,"statfs":{"total":96636764160,"available":96573431808,"internally_reserved":0,"allocated":12918784,"data_stored":12732533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509792,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35736,"kb_used_data":4552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94336104,"statfs":{"total":96636764160,"available":96600170496,"internally_reserved":0,"allocated":4661248,"data_stored":4466126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509792,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47156,"kb_used_data":15972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94324684,"statfs":{"total":96636764160,"available":96588476416,"internally_reserved":0,"allocated":16355328,"data_stored":16156262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509792,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47952,"kb_used_data":8448,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323888,"statfs":{"total":96636764160,"available":96587661312,"internally_reserved":0,"allocated":8650752,"data_stored":8478013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509791,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48536,"kb_used_data":9032,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323304,"statfs":{"total":96636764160,"available":96587063296,"internally_reserved":0,"allocated":9248768,"data_stored":9069055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509791,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47908,"kb_used_data":12564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323932,"statfs":{"total":96636764160,"available":96587706368,"internally_reserved":0,"allocated":12865536,"data_stored":12675287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542496,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43860,"kb_used_data":4356,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327980,"statfs":{"total":96636764160,"available":96591851520,"internally_reserved":0,"allocated":4460544,"data_stored":4286517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542495,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43828,"kb_used_data":8484,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94328012,"statfs":{"total":96636764160,"available":96591884288,"internally_reserved":0,"allocated":8687616,"data_stored":8479783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12619776,"data_stored":12586622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8409088,"data_stored":8390022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16109568,"data_stored":16067597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8441856,"data_stored":8391118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12079104,"data_stored":12053500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4214784,"data_stored":4197852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4415488,"data_stored":4377461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T07:58:08.401 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-05T07:58:08.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.534+0000 7fd9581fd640 1 Processor -- start 2024-09-05T07:58:08.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.534+0000 7fd9581fd640 1 -- start start 2024-09-05T07:58:08.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.535+0000 7fd9581fd640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9500cabd0 0x7fd9500c9b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:08.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.535+0000 7fd9581fd640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9500c8e80 con 0x7fd95015a970 2024-09-05T07:58:08.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.535+0000 7fd9581fd640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd95006bd40 con 0x7fd95006d8f0 2024-09-05T07:58:08.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.535+0000 7fd9581fd640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fd95015b930 con 0x7fd9500cabd0 2024-09-05T07:58:08.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.536+0000 7fd955798640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd95006d8f0 0x7fd9500cafb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.17:34292/0 (socket says 172.21.15.17:34292) 2024-09-05T07:58:08.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.536+0000 7fd955798640 1 -- 172.21.15.17:0/1155871770 learned_addr learned my addr 172.21.15.17:0/1155871770 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:58:08.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.536+0000 7fd955f99640 1 --2- 172.21.15.17:0/1155871770 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9500cabd0 0x7fd9500c9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:08.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.538+0000 7fd954f97640 1 -- 172.21.15.17:0/1155871770 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2049472556 0 0) 0x7fd95006bd40 con 0x7fd95006d8f0 2024-09-05T07:58:08.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.538+0000 7fd954f97640 1 -- 172.21.15.17:0/1155871770 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd938003520 con 0x7fd95006d8f0 2024-09-05T07:58:08.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.538+0000 7fd955f99640 1 -- 172.21.15.17:0/1155871770 >> v1:172.21.15.26:6789/0 conn(0x7fd95006d8f0 legacy=0x7fd9500cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:08.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.538+0000 7fd955f99640 1 -- 172.21.15.17:0/1155871770 >> v1:172.21.15.17:6789/0 conn(0x7fd95015a970 legacy=0x7fd950165210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:08.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.538+0000 7fd955f99640 1 -- 172.21.15.17:0/1155871770 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd95006bfe0 con 0x7fd9500cabd0 2024-09-05T07:58:08.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.540+0000 7fd955f99640 1 --2- 172.21.15.17:0/1155871770 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9500cabd0 0x7fd9500c9b50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd9480097d0 tx=0x7fd94802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90c23c01bcdc7cf6 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:58:08.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.544+0000 7fd954f97640 1 -- 172.21.15.17:0/1155871770 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd948037070 con 0x7fd9500cabd0 2024-09-05T07:58:08.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.544+0000 7fd954f97640 1 -- 172.21.15.17:0/1155871770 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd948032440 con 0x7fd9500cabd0 2024-09-05T07:58:08.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.544+0000 7fd954f97640 1 -- 172.21.15.17:0/1155871770 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd948032810 con 0x7fd9500cabd0 2024-09-05T07:58:08.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.545+0000 7fd9581fd640 1 -- 172.21.15.17:0/1155871770 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9500cabd0 msgr2=0x7fd9500c9b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:08.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.545+0000 7fd9581fd640 1 --2- 172.21.15.17:0/1155871770 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9500cabd0 0x7fd9500c9b50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd9480097d0 tx=0x7fd94802a180 comp rx=0 tx=0).stop 2024-09-05T07:58:08.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.545+0000 7fd9581fd640 1 -- 172.21.15.17:0/1155871770 shutdown_connections 2024-09-05T07:58:08.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.545+0000 7fd9581fd640 1 --2- 172.21.15.17:0/1155871770 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9500cabd0 0x7fd9500c9b50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:08.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.545+0000 7fd9581fd640 1 -- 172.21.15.17:0/1155871770 >> 172.21.15.17:0/1155871770 conn(0x7fd950071500 msgr2=0x7fd950071910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:58:08.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.545+0000 7fd9581fd640 1 -- 172.21.15.17:0/1155871770 shutdown_connections 2024-09-05T07:58:08.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.545+0000 7fd9581fd640 1 -- 172.21.15.17:0/1155871770 wait complete. 2024-09-05T07:58:08.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.546+0000 7fd9581fd640 1 Processor -- start 2024-09-05T07:58:08.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.546+0000 7fd9581fd640 1 -- start start 2024-09-05T07:58:08.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.547+0000 7fd9581fd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd95006d8f0 0x7fd9500c7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:08.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.547+0000 7fd9581fd640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9500cabd0 0x7fd9500c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:08.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.547+0000 7fd9581fd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd95015a970 0x7fd9501f3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:08.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.547+0000 7fd9581fd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd95015ae20 con 0x7fd95006d8f0 2024-09-05T07:58:08.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.547+0000 7fd9581fd640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd9500c96c0 con 0x7fd95015a970 2024-09-05T07:58:08.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.547+0000 7fd9581fd640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fd9500cdd60 con 0x7fd9500cabd0 2024-09-05T07:58:08.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.547+0000 7fd955f99640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd95006d8f0 0x7fd9500c7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:08.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.547+0000 7fd955798640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9500cabd0 0x7fd9500c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:08.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.547+0000 7fd95679a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd95015a970 0x7fd9501f3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:08.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.548+0000 7fd955798640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9500cabd0 0x7fd9500c78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.17:46346/0 (socket says 172.21.15.17:46346) 2024-09-05T07:58:08.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.548+0000 7fd955798640 1 -- 172.21.15.17:0/830100018 learned_addr learned my addr 172.21.15.17:0/830100018 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:58:08.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.551+0000 7fd95679a640 1 -- 172.21.15.17:0/830100018 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9500cabd0 msgr2=0x7fd9500c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:08.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.551+0000 7fd95679a640 1 --2- 172.21.15.17:0/830100018 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9500cabd0 0x7fd9500c78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:08.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.551+0000 7fd95679a640 1 -- 172.21.15.17:0/830100018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd95006d8f0 msgr2=0x7fd9500c7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:08.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.551+0000 7fd95679a640 1 --2- 172.21.15.17:0/830100018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd95006d8f0 0x7fd9500c7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:08.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.551+0000 7fd95679a640 1 -- 172.21.15.17:0/830100018 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9501f4a60 con 0x7fd95015a970 2024-09-05T07:58:08.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.553+0000 7fd95679a640 1 --2- 172.21.15.17:0/830100018 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd95015a970 0x7fd9501f3e50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd94000c690 tx=0x7fd94000cb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:58:08.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.557+0000 7fd94e7fc640 1 -- 172.21.15.17:0/830100018 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd940003b70 con 0x7fd95015a970 2024-09-05T07:58:08.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.557+0000 7fd94e7fc640 1 -- 172.21.15.17:0/830100018 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd940003d10 con 0x7fd95015a970 2024-09-05T07:58:08.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.557+0000 7fd94e7fc640 1 -- 172.21.15.17:0/830100018 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd940005310 con 0x7fd95015a970 2024-09-05T07:58:08.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.557+0000 7fd9581fd640 1 -- 172.21.15.17:0/830100018 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9501f4d20 con 0x7fd95015a970 2024-09-05T07:58:08.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.557+0000 7fd9581fd640 1 -- 172.21.15.17:0/830100018 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9501e4f60 con 0x7fd95015a970 2024-09-05T07:58:08.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.558+0000 7fd9581fd640 1 -- 172.21.15.17:0/830100018 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9501e5900 con 0x7fd95015a970 2024-09-05T07:58:08.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.837+0000 7fd94e7fc640 1 -- 172.21.15.17:0/830100018 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd9400054b0 con 0x7fd95015a970 2024-09-05T07:58:08.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.838+0000 7fd94e7fc640 1 --2- 172.21.15.17:0/830100018 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd93c06be80 0x7fd93c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:08.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.838+0000 7fd955f99640 1 --2- 172.21.15.17:0/830100018 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd93c06be80 0x7fd93c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:08.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.839+0000 7fd955f99640 1 --2- 172.21.15.17:0/830100018 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd93c06be80 0x7fd93c06e340 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd948034000 tx=0x7fd94802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:58:08.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.841+0000 7fd94e7fc640 1 -- 172.21.15.17:0/830100018 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7fd9400057a0 con 0x7fd95015a970 2024-09-05T07:58:08.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:08.855+0000 7fd94e7fc640 1 -- 172.21.15.17:0/830100018 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd9501e5900 con 0x7fd95015a970 2024-09-05T07:58:09.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.033+0000 7fd9581fd640 1 -- 172.21.15.17:0/830100018 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fd9500c8b40 con 0x7fd95015a970 2024-09-05T07:58:09.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.232+0000 7fd94e7fc640 1 -- 172.21.15.17:0/830100018 <== mon.1 v2:172.21.15.26:3300/0 7 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd940059960 con 0x7fd95015a970 2024-09-05T07:58:09.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.232+0000 7fd94e7fc640 1 -- 172.21.15.17:0/830100018 <== mon.1 v2:172.21.15.26:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7fd94005dc60 con 0x7fd95015a970 2024-09-05T07:58:09.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.235+0000 7fd9581fd640 1 -- 172.21.15.17:0/830100018 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd93c06be80 msgr2=0x7fd93c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:09.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.235+0000 7fd9581fd640 1 --2- 172.21.15.17:0/830100018 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd93c06be80 0x7fd93c06e340 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd948034000 tx=0x7fd94802e000 comp rx=0 tx=0).stop 2024-09-05T07:58:09.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.235+0000 7fd9581fd640 1 -- 172.21.15.17:0/830100018 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd95015a970 msgr2=0x7fd9501f3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:09.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.235+0000 7fd9581fd640 1 --2- 172.21.15.17:0/830100018 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd95015a970 0x7fd9501f3e50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd94000c690 tx=0x7fd94000cb50 comp rx=0 tx=0).stop 2024-09-05T07:58:09.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.235+0000 7fd9581fd640 1 -- 172.21.15.17:0/830100018 shutdown_connections 2024-09-05T07:58:09.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.235+0000 7fd9581fd640 1 --2- 172.21.15.17:0/830100018 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd93c06be80 0x7fd93c06e340 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:09.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.235+0000 7fd9581fd640 1 --2- 172.21.15.17:0/830100018 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd9500cabd0 0x7fd9500c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:09.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.235+0000 7fd9581fd640 1 --2- 172.21.15.17:0/830100018 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd95015a970 0x7fd9501f3e50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:09.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.235+0000 7fd9581fd640 1 --2- 172.21.15.17:0/830100018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd95006d8f0 0x7fd9500c7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:09.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.235+0000 7fd9581fd640 1 -- 172.21.15.17:0/830100018 >> 172.21.15.17:0/830100018 conn(0x7fd950071500 msgr2=0x7fd950158b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:58:09.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.235+0000 7fd9581fd640 1 -- 172.21.15.17:0/830100018 shutdown_connections 2024-09-05T07:58:09.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.235+0000 7fd9581fd640 1 -- 172.21.15.17:0/830100018 wait complete. 2024-09-05T07:58:09.247 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-05T07:58:09.247 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-05T07:58:09.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.348+0000 7f2b7741e640 1 Processor -- start 2024-09-05T07:58:09.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.348+0000 7f2b7741e640 1 -- start start 2024-09-05T07:58:09.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.349+0000 7f2b7741e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2b70154cb0 0x7f2b7015a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:09.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.349+0000 7f2b7741e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b700c96a0 con 0x7f2b70067bc0 2024-09-05T07:58:09.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.349+0000 7f2b7741e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b700c8e00 con 0x7f2b70067fa0 2024-09-05T07:58:09.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.349+0000 7f2b7741e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f2b700c90e0 con 0x7f2b70154cb0 2024-09-05T07:58:09.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.394+0000 7f2b751ba640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f2b70067bc0 0x7f2b70073a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:43588/0 (socket says 172.21.15.17:43588) 2024-09-05T07:58:09.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.394+0000 7f2b751ba640 1 -- 172.21.15.17:0/712937096 learned_addr learned my addr 172.21.15.17:0/712937096 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:58:09.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.395+0000 7f2b759bb640 1 --2- 172.21.15.17:0/712937096 >> v2:172.21.15.26:3300/0 conn(0x7f2b70154cb0 0x7f2b7015a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:09.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.397+0000 7f2b67fff640 1 -- 172.21.15.17:0/712937096 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2926998397 0 0) 0x7f2b700c96a0 con 0x7f2b70067bc0 2024-09-05T07:58:09.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.397+0000 7f2b67fff640 1 -- 172.21.15.17:0/712937096 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b5c003520 con 0x7f2b70067bc0 2024-09-05T07:58:09.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.400+0000 7f2b759bb640 1 -- 172.21.15.17:0/712937096 >> v1:172.21.15.26:6789/0 conn(0x7f2b70067fa0 legacy=0x7f2b701545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:09.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.400+0000 7f2b759bb640 1 -- 172.21.15.17:0/712937096 >> v1:172.21.15.17:6789/0 conn(0x7f2b70067bc0 legacy=0x7f2b70073a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:09.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.400+0000 7f2b759bb640 1 -- 172.21.15.17:0/712937096 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b700c93c0 con 0x7f2b70154cb0 2024-09-05T07:58:09.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.403+0000 7f2b759bb640 1 --2- 172.21.15.17:0/712937096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b70154cb0 0x7f2b7015a860 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2b68009d90 tx=0x7f2b6802a780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8f1b5c785e65ca7 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:58:09.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.408+0000 7f2b67fff640 1 -- 172.21.15.17:0/712937096 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b68037070 con 0x7f2b70154cb0 2024-09-05T07:58:09.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.408+0000 7f2b67fff640 1 -- 172.21.15.17:0/712937096 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2b68007740 con 0x7f2b70154cb0 2024-09-05T07:58:09.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.408+0000 7f2b67fff640 1 -- 172.21.15.17:0/712937096 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b68007b30 con 0x7f2b70154cb0 2024-09-05T07:58:09.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.408+0000 7f2b7741e640 1 -- 172.21.15.17:0/712937096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b70154cb0 msgr2=0x7f2b7015a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:09.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.408+0000 7f2b7741e640 1 --2- 172.21.15.17:0/712937096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b70154cb0 0x7f2b7015a860 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2b68009d90 tx=0x7f2b6802a780 comp rx=0 tx=0).stop 2024-09-05T07:58:09.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.408+0000 7f2b7741e640 1 -- 172.21.15.17:0/712937096 shutdown_connections 2024-09-05T07:58:09.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.408+0000 7f2b7741e640 1 --2- 172.21.15.17:0/712937096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b70154cb0 0x7f2b7015a860 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:09.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.408+0000 7f2b7741e640 1 -- 172.21.15.17:0/712937096 >> 172.21.15.17:0/712937096 conn(0x7f2b700cd260 msgr2=0x7f2b700cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:58:09.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.409+0000 7f2b7741e640 1 -- 172.21.15.17:0/712937096 shutdown_connections 2024-09-05T07:58:09.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.409+0000 7f2b7741e640 1 -- 172.21.15.17:0/712937096 wait complete. 2024-09-05T07:58:09.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.410+0000 7f2b7741e640 1 Processor -- start 2024-09-05T07:58:09.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.410+0000 7f2b7741e640 1 -- start start 2024-09-05T07:58:09.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.410+0000 7f2b7741e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b70067bc0 0x7f2b700b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:09.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.410+0000 7f2b7741e640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b70067fa0 0x7f2b701f1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:09.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.410+0000 7f2b7741e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b70154cb0 0x7f2b701f1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:09.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.410+0000 7f2b7741e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2b70074110 con 0x7f2b70067bc0 2024-09-05T07:58:09.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.410+0000 7f2b7741e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f2b700734e0 con 0x7f2b70154cb0 2024-09-05T07:58:09.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.410+0000 7f2b7741e640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f2b7006bc10 con 0x7f2b70067fa0 2024-09-05T07:58:09.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.411+0000 7f2b751ba640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b70067bc0 0x7f2b700b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:09.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.411+0000 7f2b759bb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b70154cb0 0x7f2b701f1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:09.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.411+0000 7f2b749b9640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b70067fa0 0x7f2b701f1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:09.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.411+0000 7f2b759bb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b70154cb0 0x7f2b701f1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:51306/0 (socket says 172.21.15.17:51306) 2024-09-05T07:58:09.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.411+0000 7f2b759bb640 1 -- 172.21.15.17:0/199857546 learned_addr learned my addr 172.21.15.17:0/199857546 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:58:09.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.415+0000 7f2b751ba640 1 -- 172.21.15.17:0/199857546 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b70067fa0 msgr2=0x7f2b701f1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:09.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.415+0000 7f2b751ba640 1 --2- 172.21.15.17:0/199857546 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b70067fa0 0x7f2b701f1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:09.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.415+0000 7f2b751ba640 1 -- 172.21.15.17:0/199857546 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b70154cb0 msgr2=0x7f2b701f1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:09.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.415+0000 7f2b751ba640 1 --2- 172.21.15.17:0/199857546 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b70154cb0 0x7f2b701f1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:09.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.415+0000 7f2b751ba640 1 -- 172.21.15.17:0/199857546 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b70150030 con 0x7f2b70067bc0 2024-09-05T07:58:09.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.417+0000 7f2b751ba640 1 --2- 172.21.15.17:0/199857546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b70067bc0 0x7f2b700b22a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c00c430 tx=0x7f2b6c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:58:09.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.421+0000 7f2b65ffb640 1 -- 172.21.15.17:0/199857546 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c017070 con 0x7f2b70067bc0 2024-09-05T07:58:09.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.421+0000 7f2b65ffb640 1 -- 172.21.15.17:0/199857546 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2b6c005ce0 con 0x7f2b70067bc0 2024-09-05T07:58:09.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.421+0000 7f2b7741e640 1 -- 172.21.15.17:0/199857546 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b701f0700 con 0x7f2b70067bc0 2024-09-05T07:58:09.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.421+0000 7f2b65ffb640 1 -- 172.21.15.17:0/199857546 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c007310 con 0x7f2b70067bc0 2024-09-05T07:58:09.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.421+0000 7f2b7741e640 1 -- 172.21.15.17:0/199857546 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b701f0cc0 con 0x7f2b70067bc0 2024-09-05T07:58:09.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.422+0000 7f2b7741e640 1 -- 172.21.15.17:0/199857546 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b70150650 con 0x7f2b70067bc0 2024-09-05T07:58:09.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.441+0000 7f2b65ffb640 1 -- 172.21.15.17:0/199857546 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2b6c01a070 con 0x7f2b70067bc0 2024-09-05T07:58:09.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.442+0000 7f2b65ffb640 1 --2- 172.21.15.17:0/199857546 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f2b5406be80 0x7f2b5406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:09.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.442+0000 7f2b749b9640 1 --2- 172.21.15.17:0/199857546 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f2b5406be80 0x7f2b5406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:09.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.443+0000 7f2b749b9640 1 --2- 172.21.15.17:0/199857546 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f2b5406be80 0x7f2b5406e340 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2b7014f2e0 tx=0x7f2b60009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:58:09.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.445+0000 7f2b65ffb640 1 -- 172.21.15.17:0/199857546 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7f2b6c056a30 con 0x7f2b70067bc0 2024-09-05T07:58:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.713+0000 7f2b65ffb640 1 -- 172.21.15.17:0/199857546 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2b70150650 con 0x7f2b70067bc0 2024-09-05T07:58:09.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.938+0000 7f2b7741e640 1 -- 172.21.15.17:0/199857546 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b700727f0 con 0x7f2b70067bc0 2024-09-05T07:58:09.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.952+0000 7f2b65ffb640 1 -- 172.21.15.17:0/199857546 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6938 (secure 0 0 0) 0x7f2b6c021020 con 0x7f2b70067bc0 2024-09-05T07:58:09.953 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:58:09.953 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":18,"btime":"2024-09-05T07:29:49:192665+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4221,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/1677649004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1677649004},{"type":"v1","addr":"172.21.15.17:6833","nonce":1677649004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-05T07:29:30.282161+0000","modified":"2024-09-05T07:29:49.192601+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4261,"mds_1":4258,"mds_2":4241,"mds_3":4233,"mds_4":4230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4230":{"gid":4230,"name":"d","rank":4,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.26:6837/840343339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":840343339},{"type":"v1","addr":"172.21.15.26:6837","nonce":840343339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4233":{"gid":4233,"name":"b","rank":3,"incarnation":15,"state":"up:active","state_seq":7,"addr":"172.21.15.26:6839/914231229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":914231229},{"type":"v1","addr":"172.21.15.26:6839","nonce":914231229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4241":{"gid":4241,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":6,"addr":"172.21.15.17:6837/4100397916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":4100397916},{"type":"v1","addr":"172.21.15.17:6837","nonce":4100397916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4258":{"gid":4258,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.17:6835/2818017162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2818017162},{"type":"v1","addr":"172.21.15.17:6835","nonce":2818017162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4261":{"gid":4261,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/656329439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":656329439},{"type":"v1","addr":"172.21.15.26:6835","nonce":656329439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4261,"qdb_cluster":[4230,4233,4241,4258,4261]},"id":1}]} 2024-09-05T07:58:09.954 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 18 2024-09-05T07:58:09.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.954+0000 7f2b7741e640 1 -- 172.21.15.17:0/199857546 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f2b5406be80 msgr2=0x7f2b5406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:09.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.954+0000 7f2b7741e640 1 --2- 172.21.15.17:0/199857546 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f2b5406be80 0x7f2b5406e340 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2b7014f2e0 tx=0x7f2b60009040 comp rx=0 tx=0).stop 2024-09-05T07:58:09.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.954+0000 7f2b7741e640 1 -- 172.21.15.17:0/199857546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b70067bc0 msgr2=0x7f2b700b22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:09.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.954+0000 7f2b7741e640 1 --2- 172.21.15.17:0/199857546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b70067bc0 0x7f2b700b22a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c00c430 tx=0x7f2b6c00c8f0 comp rx=0 tx=0).stop 2024-09-05T07:58:09.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.954+0000 7f2b7741e640 1 -- 172.21.15.17:0/199857546 shutdown_connections 2024-09-05T07:58:09.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.954+0000 7f2b7741e640 1 --2- 172.21.15.17:0/199857546 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f2b5406be80 0x7f2b5406e340 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:09.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.954+0000 7f2b7741e640 1 --2- 172.21.15.17:0/199857546 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b70067fa0 0x7f2b701f1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:09.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.954+0000 7f2b7741e640 1 --2- 172.21.15.17:0/199857546 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b70154cb0 0x7f2b701f1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:09.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.954+0000 7f2b7741e640 1 --2- 172.21.15.17:0/199857546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b70067bc0 0x7f2b700b22a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:09.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.954+0000 7f2b7741e640 1 -- 172.21.15.17:0/199857546 >> 172.21.15.17:0/199857546 conn(0x7f2b700cd260 msgr2=0x7f2b700ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:58:09.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.955+0000 7f2b7741e640 1 -- 172.21.15.17:0/199857546 shutdown_connections 2024-09-05T07:58:09.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:09.955+0000 7f2b7741e640 1 -- 172.21.15.17:0/199857546 wait complete. 2024-09-05T07:58:09.967 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-05T07:58:10.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.065+0000 7fdd34e2e640 1 Processor -- start 2024-09-05T07:58:10.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.065+0000 7fdd34e2e640 1 -- start start 2024-09-05T07:58:10.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.066+0000 7fdd34e2e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdd30152c10 0x7fdd300c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:10.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.066+0000 7fdd34e2e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fdd300c8390 0x7fdd3006de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:10.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.066+0000 7fdd34e2e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd300c9ed0 con 0x7fdd30152830 2024-09-05T07:58:10.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.066+0000 7fdd34e2e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fdd300c51c0 con 0x7fdd300c8390 2024-09-05T07:58:10.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.066+0000 7fdd34e2e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fdd3006f7c0 con 0x7fdd30152c10 2024-09-05T07:58:10.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.067+0000 7fdd2ed9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fdd300c8390 0x7fdd3006de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:10.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.067+0000 7fdd2dd9b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdd30152c10 0x7fdd300c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:10.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.067+0000 7fdd2ed9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fdd300c8390 0x7fdd3006de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48266/0 (socket says 172.21.15.17:48266) 2024-09-05T07:58:10.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.067+0000 7fdd2ed9d640 1 -- 172.21.15.17:0/2784398130 learned_addr learned my addr 172.21.15.17:0/2784398130 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:58:10.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.069+0000 7fdd2ed9d640 1 -- 172.21.15.17:0/2784398130 >> v2:172.21.15.26:3300/0 conn(0x7fdd30152c10 msgr2=0x7fdd300c8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:58:10.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.069+0000 7fdd2ed9d640 1 --2- 172.21.15.17:0/2784398130 >> v2:172.21.15.26:3300/0 conn(0x7fdd30152c10 0x7fdd300c8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:10.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.069+0000 7fdd2ed9d640 1 -- 172.21.15.17:0/2784398130 >> v1:172.21.15.26:6789/0 conn(0x7fdd30152830 legacy=0x7fdd300c31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:58:10.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.069+0000 7fdd2ed9d640 1 -- 172.21.15.17:0/2784398130 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd300c4f50 con 0x7fdd300c8390 2024-09-05T07:58:10.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.071+0000 7fdd2ed9d640 1 --2- 172.21.15.17:0/2784398130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd300c8390 0x7fdd3006de20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdd30071580 tx=0x7fdd2002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce13b93fa9826eba server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:58:10.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.075+0000 7fdd2d59a640 1 -- 172.21.15.17:0/2784398130 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd20037070 con 0x7fdd300c8390 2024-09-05T07:58:10.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.075+0000 7fdd2d59a640 1 -- 172.21.15.17:0/2784398130 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fdd20032440 con 0x7fdd300c8390 2024-09-05T07:58:10.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.075+0000 7fdd2d59a640 1 -- 172.21.15.17:0/2784398130 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd20032830 con 0x7fdd300c8390 2024-09-05T07:58:10.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.076+0000 7fdd34e2e640 1 -- 172.21.15.17:0/2784398130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd300c8390 msgr2=0x7fdd3006de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:10.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.076+0000 7fdd34e2e640 1 --2- 172.21.15.17:0/2784398130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd300c8390 0x7fdd3006de20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdd30071580 tx=0x7fdd2002a230 comp rx=0 tx=0).stop 2024-09-05T07:58:10.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.076+0000 7fdd34e2e640 1 -- 172.21.15.17:0/2784398130 shutdown_connections 2024-09-05T07:58:10.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.076+0000 7fdd34e2e640 1 --2- 172.21.15.17:0/2784398130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd300c8390 0x7fdd3006de20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:10.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.076+0000 7fdd34e2e640 1 --2- 172.21.15.17:0/2784398130 >> v2:172.21.15.26:3300/0 conn(0x7fdd30152c10 0x7fdd300c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:10.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.076+0000 7fdd34e2e640 1 -- 172.21.15.17:0/2784398130 >> 172.21.15.17:0/2784398130 conn(0x7fdd300715f0 msgr2=0x7fdd300719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:58:10.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.076+0000 7fdd34e2e640 1 -- 172.21.15.17:0/2784398130 shutdown_connections 2024-09-05T07:58:10.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.076+0000 7fdd34e2e640 1 -- 172.21.15.17:0/2784398130 wait complete. 2024-09-05T07:58:10.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.077+0000 7fdd34e2e640 1 Processor -- start 2024-09-05T07:58:10.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.077+0000 7fdd34e2e640 1 -- start start 2024-09-05T07:58:10.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.078+0000 7fdd34e2e640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd300c8390 0x7fdd301f0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:10.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.078+0000 7fdd34e2e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd30152830 0x7fdd300b1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:10.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.078+0000 7fdd34e2e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd30152c10 0x7fdd3014e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:10.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.078+0000 7fdd34e2e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdd30070350 con 0x7fdd30152c10 2024-09-05T07:58:10.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.078+0000 7fdd34e2e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3006fe30 con 0x7fdd30152830 2024-09-05T07:58:10.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.078+0000 7fdd34e2e640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fdd300704d0 con 0x7fdd300c8390 2024-09-05T07:58:10.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.079+0000 7fdd2dd9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd30152830 0x7fdd300b1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:10.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.079+0000 7fdd2ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd30152c10 0x7fdd3014e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:10.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.079+0000 7fdd2e59c640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd300c8390 0x7fdd301f0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:10.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.079+0000 7fdd2dd9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd30152830 0x7fdd300b1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:51318/0 (socket says 172.21.15.17:51318) 2024-09-05T07:58:10.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.079+0000 7fdd2dd9b640 1 -- 172.21.15.17:0/1095593649 learned_addr learned my addr 172.21.15.17:0/1095593649 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:58:10.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.083+0000 7fdd2dd9b640 1 -- 172.21.15.17:0/1095593649 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd300c8390 msgr2=0x7fdd301f0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:10.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.083+0000 7fdd2dd9b640 1 --2- 172.21.15.17:0/1095593649 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd300c8390 0x7fdd301f0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:10.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.083+0000 7fdd2dd9b640 1 -- 172.21.15.17:0/1095593649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd30152c10 msgr2=0x7fdd3014e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:10.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.083+0000 7fdd2dd9b640 1 --2- 172.21.15.17:0/1095593649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd30152c10 0x7fdd3014e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:10.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.083+0000 7fdd2dd9b640 1 -- 172.21.15.17:0/1095593649 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd301f0960 con 0x7fdd30152830 2024-09-05T07:58:10.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.085+0000 7fdd2dd9b640 1 --2- 172.21.15.17:0/1095593649 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd30152830 0x7fdd300b1910 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdd1800e9b0 tx=0x7fdd1800ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:58:10.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.089+0000 7fdd26ffd640 1 -- 172.21.15.17:0/1095593649 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd18017070 con 0x7fdd30152830 2024-09-05T07:58:10.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.089+0000 7fdd26ffd640 1 -- 172.21.15.17:0/1095593649 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fdd1800c9a0 con 0x7fdd30152830 2024-09-05T07:58:10.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.089+0000 7fdd34e2e640 1 -- 172.21.15.17:0/1095593649 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd300c6ea0 con 0x7fdd30152830 2024-09-05T07:58:10.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.089+0000 7fdd26ffd640 1 -- 172.21.15.17:0/1095593649 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1800cdb0 con 0x7fdd30152830 2024-09-05T07:58:10.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.089+0000 7fdd34e2e640 1 -- 172.21.15.17:0/1095593649 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd300c7460 con 0x7fdd30152830 2024-09-05T07:58:10.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.090+0000 7fdd34e2e640 1 -- 172.21.15.17:0/1095593649 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd300c8bb0 con 0x7fdd30152830 2024-09-05T07:58:10.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.110+0000 7fdd26ffd640 1 -- 172.21.15.17:0/1095593649 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdd1801a070 con 0x7fdd30152830 2024-09-05T07:58:10.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.110+0000 7fdd26ffd640 1 --2- 172.21.15.17:0/1095593649 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fdd1006be80 0x7fdd1006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:10.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.110+0000 7fdd2e59c640 1 --2- 172.21.15.17:0/1095593649 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fdd1006be80 0x7fdd1006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:10.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.111+0000 7fdd2e59c640 1 --2- 172.21.15.17:0/1095593649 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fdd1006be80 0x7fdd1006e340 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdd28005660 tx=0x7fdd28003d90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:58:10.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.115+0000 7fdd26ffd640 1 -- 172.21.15.17:0/1095593649 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7fdd180579c0 con 0x7fdd30152830 2024-09-05T07:58:10.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.386+0000 7fdd26ffd640 1 -- 172.21.15.17:0/1095593649 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdd18059920 con 0x7fdd30152830 2024-09-05T07:58:10.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.602+0000 7fdd34e2e640 1 -- 172.21.15.17:0/1095593649 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdd30075770 con 0x7fdd30152830 2024-09-05T07:58:10.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.617+0000 7fdd26ffd640 1 -- 172.21.15.17:0/1095593649 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6938 (secure 0 0 0) 0x7fdd1805dc20 con 0x7fdd30152830 2024-09-05T07:58:10.617 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:58:10.617 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":18,"btime":"2024-09-05T07:29:49:192665+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4221,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/1677649004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1677649004},{"type":"v1","addr":"172.21.15.17:6833","nonce":1677649004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-05T07:29:30.282161+0000","modified":"2024-09-05T07:29:49.192601+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4261,"mds_1":4258,"mds_2":4241,"mds_3":4233,"mds_4":4230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4230":{"gid":4230,"name":"d","rank":4,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.26:6837/840343339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":840343339},{"type":"v1","addr":"172.21.15.26:6837","nonce":840343339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4233":{"gid":4233,"name":"b","rank":3,"incarnation":15,"state":"up:active","state_seq":7,"addr":"172.21.15.26:6839/914231229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":914231229},{"type":"v1","addr":"172.21.15.26:6839","nonce":914231229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4241":{"gid":4241,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":6,"addr":"172.21.15.17:6837/4100397916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":4100397916},{"type":"v1","addr":"172.21.15.17:6837","nonce":4100397916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4258":{"gid":4258,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.17:6835/2818017162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2818017162},{"type":"v1","addr":"172.21.15.17:6835","nonce":2818017162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4261":{"gid":4261,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/656329439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":656329439},{"type":"v1","addr":"172.21.15.26:6835","nonce":656329439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4261,"qdb_cluster":[4230,4233,4241,4258,4261]},"id":1}]} 2024-09-05T07:58:10.618 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 18 2024-09-05T07:58:10.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.619+0000 7fdd34e2e640 1 -- 172.21.15.17:0/1095593649 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fdd1006be80 msgr2=0x7fdd1006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:10.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.619+0000 7fdd34e2e640 1 --2- 172.21.15.17:0/1095593649 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fdd1006be80 0x7fdd1006e340 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdd28005660 tx=0x7fdd28003d90 comp rx=0 tx=0).stop 2024-09-05T07:58:10.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.619+0000 7fdd34e2e640 1 -- 172.21.15.17:0/1095593649 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd30152830 msgr2=0x7fdd300b1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:10.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.619+0000 7fdd34e2e640 1 --2- 172.21.15.17:0/1095593649 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd30152830 0x7fdd300b1910 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdd1800e9b0 tx=0x7fdd1800ee70 comp rx=0 tx=0).stop 2024-09-05T07:58:10.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.619+0000 7fdd34e2e640 1 -- 172.21.15.17:0/1095593649 shutdown_connections 2024-09-05T07:58:10.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.619+0000 7fdd34e2e640 1 --2- 172.21.15.17:0/1095593649 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fdd1006be80 0x7fdd1006e340 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:10.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.619+0000 7fdd34e2e640 1 --2- 172.21.15.17:0/1095593649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd30152c10 0x7fdd3014e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:10.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.619+0000 7fdd34e2e640 1 --2- 172.21.15.17:0/1095593649 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd30152830 0x7fdd300b1910 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:10.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.619+0000 7fdd34e2e640 1 --2- 172.21.15.17:0/1095593649 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdd300c8390 0x7fdd301f0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:10.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.619+0000 7fdd34e2e640 1 -- 172.21.15.17:0/1095593649 >> 172.21.15.17:0/1095593649 conn(0x7fdd300715f0 msgr2=0x7fdd3015c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:58:10.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.619+0000 7fdd34e2e640 1 -- 172.21.15.17:0/1095593649 shutdown_connections 2024-09-05T07:58:10.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.619+0000 7fdd34e2e640 1 -- 172.21.15.17:0/1095593649 wait complete. 2024-09-05T07:58:10.630 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-05T07:58:10.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.729+0000 7fd09bd11640 1 Processor -- start 2024-09-05T07:58:10.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.730+0000 7fd09bd11640 1 -- start start 2024-09-05T07:58:10.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.730+0000 7fd09bd11640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd0940cafa0 0x7fd09415b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:10.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.730+0000 7fd09bd11640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd09406c8c0 con 0x7fd094154770 2024-09-05T07:58:10.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.730+0000 7fd09bd11640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0940cb950 con 0x7fd0940c5a80 2024-09-05T07:58:10.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.730+0000 7fd09bd11640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fd0940c5310 con 0x7fd0940cafa0 2024-09-05T07:58:10.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.731+0000 7fd099aad640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fd094154770 0x7fd0940d05c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:43604/0 (socket says 172.21.15.17:43604) 2024-09-05T07:58:10.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.731+0000 7fd099aad640 1 -- 172.21.15.17:0/2303656289 learned_addr learned my addr 172.21.15.17:0/2303656289 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:58:10.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.731+0000 7fd0992ac640 1 --2- 172.21.15.17:0/2303656289 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd0940cafa0 0x7fd09415b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:10.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.734+0000 7fd098aab640 1 -- 172.21.15.17:0/2303656289 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 616925983 0 0) 0x7fd09406c8c0 con 0x7fd094154770 2024-09-05T07:58:10.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.734+0000 7fd098aab640 1 -- 172.21.15.17:0/2303656289 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd07c003520 con 0x7fd094154770 2024-09-05T07:58:10.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.734+0000 7fd098aab640 1 -- 172.21.15.17:0/2303656289 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1496684299 0 0) 0x7fd0940cb950 con 0x7fd0940c5a80 2024-09-05T07:58:10.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.734+0000 7fd098aab640 1 -- 172.21.15.17:0/2303656289 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd09406c8c0 con 0x7fd0940c5a80 2024-09-05T07:58:10.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.734+0000 7fd0992ac640 1 -- 172.21.15.17:0/2303656289 >> v1:172.21.15.26:6789/0 conn(0x7fd0940c5a80 legacy=0x7fd0940c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:10.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.734+0000 7fd0992ac640 1 -- 172.21.15.17:0/2303656289 >> v1:172.21.15.17:6789/0 conn(0x7fd094154770 legacy=0x7fd0940d05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:10.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.734+0000 7fd0992ac640 1 -- 172.21.15.17:0/2303656289 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd09406cb60 con 0x7fd0940cafa0 2024-09-05T07:58:10.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.736+0000 7fd0992ac640 1 --2- 172.21.15.17:0/2303656289 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd0940cafa0 0x7fd09415b240 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd0880097d0 tx=0x7fd08802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29ab41192dd14a44 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:58:10.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.740+0000 7fd098aab640 1 -- 172.21.15.17:0/2303656289 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd088037070 con 0x7fd0940cafa0 2024-09-05T07:58:10.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.740+0000 7fd098aab640 1 -- 172.21.15.17:0/2303656289 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd088032440 con 0x7fd0940cafa0 2024-09-05T07:58:10.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.740+0000 7fd098aab640 1 -- 172.21.15.17:0/2303656289 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd088032830 con 0x7fd0940cafa0 2024-09-05T07:58:10.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.740+0000 7fd09bd11640 1 -- 172.21.15.17:0/2303656289 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd0940cafa0 msgr2=0x7fd09415b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:10.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.740+0000 7fd09bd11640 1 --2- 172.21.15.17:0/2303656289 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd0940cafa0 0x7fd09415b240 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd0880097d0 tx=0x7fd08802a210 comp rx=0 tx=0).stop 2024-09-05T07:58:10.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.740+0000 7fd09bd11640 1 -- 172.21.15.17:0/2303656289 shutdown_connections 2024-09-05T07:58:10.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.740+0000 7fd09bd11640 1 --2- 172.21.15.17:0/2303656289 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd0940cafa0 0x7fd09415b240 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:10.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.740+0000 7fd09bd11640 1 -- 172.21.15.17:0/2303656289 >> 172.21.15.17:0/2303656289 conn(0x7fd094073710 msgr2=0x7fd094073b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:58:10.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.740+0000 7fd09bd11640 1 -- 172.21.15.17:0/2303656289 shutdown_connections 2024-09-05T07:58:10.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.740+0000 7fd09bd11640 1 -- 172.21.15.17:0/2303656289 wait complete. 2024-09-05T07:58:10.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.741+0000 7fd09bd11640 1 Processor -- start 2024-09-05T07:58:10.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.742+0000 7fd09bd11640 1 -- start start 2024-09-05T07:58:10.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.742+0000 7fd09bd11640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0940c5a80 0x7fd09414fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:10.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.742+0000 7fd09bd11640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0940cafa0 0x7fd0941f1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:10.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.742+0000 7fd09bd11640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd094154770 0x7fd09414df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:10.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.742+0000 7fd09bd11640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd094154b50 con 0x7fd0940c5a80 2024-09-05T07:58:10.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.742+0000 7fd09bd11640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd0940cbc30 con 0x7fd0940cafa0 2024-09-05T07:58:10.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.742+0000 7fd09bd11640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fd0940d0cd0 con 0x7fd094154770 2024-09-05T07:58:10.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.743+0000 7fd099aad640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0940c5a80 0x7fd09414fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:10.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.743+0000 7fd09a2ae640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd094154770 0x7fd09414df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:10.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.743+0000 7fd0992ac640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0940cafa0 0x7fd0941f1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:10.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.743+0000 7fd099aad640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0940c5a80 0x7fd09414fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48286/0 (socket says 172.21.15.17:48286) 2024-09-05T07:58:10.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.743+0000 7fd099aad640 1 -- 172.21.15.17:0/2549540539 learned_addr learned my addr 172.21.15.17:0/2549540539 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:58:10.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.747+0000 7fd099aad640 1 -- 172.21.15.17:0/2549540539 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd094154770 msgr2=0x7fd09414df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:10.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.747+0000 7fd099aad640 1 --2- 172.21.15.17:0/2549540539 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd094154770 0x7fd09414df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:10.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.747+0000 7fd099aad640 1 -- 172.21.15.17:0/2549540539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0940cafa0 msgr2=0x7fd0941f1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:10.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.747+0000 7fd099aad640 1 --2- 172.21.15.17:0/2549540539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0940cafa0 0x7fd0941f1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:10.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.747+0000 7fd099aad640 1 -- 172.21.15.17:0/2549540539 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd09414f440 con 0x7fd0940c5a80 2024-09-05T07:58:10.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.749+0000 7fd099aad640 1 --2- 172.21.15.17:0/2549540539 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0940c5a80 0x7fd09414fee0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd08400cb10 tx=0x7fd08400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:58:10.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.753+0000 7fd0927fc640 1 -- 172.21.15.17:0/2549540539 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd084017070 con 0x7fd0940c5a80 2024-09-05T07:58:10.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.753+0000 7fd0927fc640 1 -- 172.21.15.17:0/2549540539 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd08400ac10 con 0x7fd0940c5a80 2024-09-05T07:58:10.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.753+0000 7fd0927fc640 1 -- 172.21.15.17:0/2549540539 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd084012400 con 0x7fd0940c5a80 2024-09-05T07:58:10.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.753+0000 7fd09bd11640 1 -- 172.21.15.17:0/2549540539 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0940c90e0 con 0x7fd0940c5a80 2024-09-05T07:58:10.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.753+0000 7fd09bd11640 1 -- 172.21.15.17:0/2549540539 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0940c7ad0 con 0x7fd0940c5a80 2024-09-05T07:58:10.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:10.754+0000 7fd09bd11640 1 -- 172.21.15.17:0/2549540539 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd09406bca0 con 0x7fd0940c5a80 2024-09-05T07:58:11.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.028+0000 7fd0927fc640 1 -- 172.21.15.17:0/2549540539 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd08401a070 con 0x7fd0940c5a80 2024-09-05T07:58:11.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.028+0000 7fd0927fc640 1 --2- 172.21.15.17:0/2549540539 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd08006beb0 0x7fd08006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:11.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.029+0000 7fd0992ac640 1 --2- 172.21.15.17:0/2549540539 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd08006beb0 0x7fd08006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:11.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.029+0000 7fd0992ac640 1 --2- 172.21.15.17:0/2549540539 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd08006beb0 0x7fd08006e370 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd088034000 tx=0x7fd08802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:58:11.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.043+0000 7fd0927fc640 1 -- 172.21.15.17:0/2549540539 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7fd084057430 con 0x7fd0940c5a80 2024-09-05T07:58:11.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.044+0000 7fd0927fc640 1 -- 172.21.15.17:0/2549540539 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd084021020 con 0x7fd0940c5a80 2024-09-05T07:58:11.114 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:58:11.117 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:58:11.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.220+0000 7fd09bd11640 1 -- 172.21.15.17:0/2549540539 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd0940ca6c0 con 0x7fd0940c5a80 2024-09-05T07:58:11.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.263+0000 7fd0927fc640 1 -- 172.21.15.17:0/2549540539 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+16670 (secure 0 0 0) 0x7fd084059390 con 0x7fd0940c5a80 2024-09-05T07:58:11.264 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-05T07:58:11.264 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":24,"fsid":"848dac54-74f8-48f3-8686-c6495dcb972b","created":"2024-09-05T07:28:54.070215+0000","modified":"2024-09-05T07:30:02.065968+0000","last_up_change":"2024-09-05T07:29:11.992790+0000","last_in_change":"2024-09-05T07:29:00.001829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T07:29:10.227047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T07:29:27.905154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T07:29:29.039672+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f01a8b4-dc10-4cdf-a65e-b7f96de4e2b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2731314060},{"type":"v1","addr":"172.21.15.17:6825","nonce":2731314060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2731314060},{"type":"v1","addr":"172.21.15.17:6827","nonce":2731314060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2731314060},{"type":"v1","addr":"172.21.15.17:6831","nonce":2731314060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2731314060},{"type":"v1","addr":"172.21.15.17:6829","nonce":2731314060}]},"public_addr":"172.21.15.17:6825/2731314060","cluster_addr":"172.21.15.17:6827/2731314060","heartbeat_back_addr":"172.21.15.17:6831/2731314060","heartbeat_front_addr":"172.21.15.17:6829/2731314060","state":["exists","up"]},{"osd":1,"uuid":"d16867fb-2290-486c-9ac8-327ca54326d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3327408852},{"type":"v1","addr":"172.21.15.17:6817","nonce":3327408852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3327408852},{"type":"v1","addr":"172.21.15.17:6819","nonce":3327408852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3327408852},{"type":"v1","addr":"172.21.15.17:6823","nonce":3327408852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3327408852},{"type":"v1","addr":"172.21.15.17:6821","nonce":3327408852}]},"public_addr":"172.21.15.17:6817/3327408852","cluster_addr":"172.21.15.17:6819/3327408852","heartbeat_back_addr":"172.21.15.17:6823/3327408852","heartbeat_front_addr":"172.21.15.17:6821/3327408852","state":["exists","up"]},{"osd":2,"uuid":"632ad558-bd14-4240-a8f1-5beda951b3b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":363420609},{"type":"v1","addr":"172.21.15.17:6809","nonce":363420609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":363420609},{"type":"v1","addr":"172.21.15.17:6811","nonce":363420609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":363420609},{"type":"v1","addr":"172.21.15.17:6815","nonce":363420609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":363420609},{"type":"v1","addr":"172.21.15.17:6813","nonce":363420609}]},"public_addr":"172.21.15.17:6809/363420609","cluster_addr":"172.21.15.17:6811/363420609","heartbeat_back_addr":"172.21.15.17:6815/363420609","heartbeat_front_addr":"172.21.15.17:6813/363420609","state":["exists","up"]},{"osd":3,"uuid":"9727a970-8f98-45b9-8eca-62da1f28ff17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":3512342499},{"type":"v1","addr":"172.21.15.17:6801","nonce":3512342499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":3512342499},{"type":"v1","addr":"172.21.15.17:6803","nonce":3512342499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":3512342499},{"type":"v1","addr":"172.21.15.17:6807","nonce":3512342499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":3512342499},{"type":"v1","addr":"172.21.15.17:6805","nonce":3512342499}]},"public_addr":"172.21.15.17:6801/3512342499","cluster_addr":"172.21.15.17:6803/3512342499","heartbeat_back_addr":"172.21.15.17:6807/3512342499","heartbeat_front_addr":"172.21.15.17:6805/3512342499","state":["exists","up"]},{"osd":4,"uuid":"0e0141e0-51f1-4229-861f-1992afe70c96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6803","nonce":3740556509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6805","nonce":3740556509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6809","nonce":3740556509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3740556509},{"type":"v1","addr":"172.21.15.26:6807","nonce":3740556509}]},"public_addr":"172.21.15.26:6803/3740556509","cluster_addr":"172.21.15.26:6805/3740556509","heartbeat_back_addr":"172.21.15.26:6809/3740556509","heartbeat_front_addr":"172.21.15.26:6807/3740556509","state":["exists","up"]},{"osd":5,"uuid":"5603d79b-fcf8-45aa-a1db-96918af450be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":3020770750},{"type":"v1","addr":"172.21.15.26:6819","nonce":3020770750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":3020770750},{"type":"v1","addr":"172.21.15.26:6821","nonce":3020770750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3020770750},{"type":"v1","addr":"172.21.15.26:6825","nonce":3020770750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":3020770750},{"type":"v1","addr":"172.21.15.26:6823","nonce":3020770750}]},"public_addr":"172.21.15.26:6819/3020770750","cluster_addr":"172.21.15.26:6821/3020770750","heartbeat_back_addr":"172.21.15.26:6825/3020770750","heartbeat_front_addr":"172.21.15.26:6823/3020770750","state":["exists","up"]},{"osd":6,"uuid":"14f3b696-1b3c-4749-8f61-ac10edbb5b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6811","nonce":158775588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6813","nonce":158775588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6817","nonce":158775588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":158775588},{"type":"v1","addr":"172.21.15.26:6815","nonce":158775588}]},"public_addr":"172.21.15.26:6811/158775588","cluster_addr":"172.21.15.26:6813/158775588","heartbeat_back_addr":"172.21.15.26:6817/158775588","heartbeat_front_addr":"172.21.15.26:6815/158775588","state":["exists","up"]},{"osd":7,"uuid":"be7b4121-c71b-4908-ba4a-9c4389423201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":4176189153},{"type":"v1","addr":"172.21.15.26:6827","nonce":4176189153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":4176189153},{"type":"v1","addr":"172.21.15.26:6829","nonce":4176189153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":4176189153},{"type":"v1","addr":"172.21.15.26:6833","nonce":4176189153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":4176189153},{"type":"v1","addr":"172.21.15.26:6831","nonce":4176189153}]},"public_addr":"172.21.15.26:6827/4176189153","cluster_addr":"172.21.15.26:6829/4176189153","heartbeat_back_addr":"172.21.15.26:6833/4176189153","heartbeat_front_addr":"172.21.15.26:6831/4176189153","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.923722+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.404043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.275202+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.434925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.159606+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.379036+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.196000+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T07:29:07.387333+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T07:58:11.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.265+0000 7fd09bd11640 1 -- 172.21.15.17:0/2549540539 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd08006beb0 msgr2=0x7fd08006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:11.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.265+0000 7fd09bd11640 1 --2- 172.21.15.17:0/2549540539 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd08006beb0 0x7fd08006e370 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd088034000 tx=0x7fd08802e000 comp rx=0 tx=0).stop 2024-09-05T07:58:11.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.265+0000 7fd09bd11640 1 -- 172.21.15.17:0/2549540539 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0940c5a80 msgr2=0x7fd09414fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:11.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.265+0000 7fd09bd11640 1 --2- 172.21.15.17:0/2549540539 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0940c5a80 0x7fd09414fee0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd08400cb10 tx=0x7fd08400a060 comp rx=0 tx=0).stop 2024-09-05T07:58:11.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.265+0000 7fd09bd11640 1 -- 172.21.15.17:0/2549540539 shutdown_connections 2024-09-05T07:58:11.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.265+0000 7fd09bd11640 1 --2- 172.21.15.17:0/2549540539 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fd08006beb0 0x7fd08006e370 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:11.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.265+0000 7fd09bd11640 1 --2- 172.21.15.17:0/2549540539 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd094154770 0x7fd09414df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:11.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.265+0000 7fd09bd11640 1 --2- 172.21.15.17:0/2549540539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0940cafa0 0x7fd0941f1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:11.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.265+0000 7fd09bd11640 1 --2- 172.21.15.17:0/2549540539 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0940c5a80 0x7fd09414fee0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:11.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.265+0000 7fd09bd11640 1 -- 172.21.15.17:0/2549540539 >> 172.21.15.17:0/2549540539 conn(0x7fd094073710 msgr2=0x7fd0940ccb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:58:11.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.266+0000 7fd09bd11640 1 -- 172.21.15.17:0/2549540539 shutdown_connections 2024-09-05T07:58:11.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.266+0000 7fd09bd11640 1 -- 172.21.15.17:0/2549540539 wait complete. 2024-09-05T07:58:11.278 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-05T07:58:11.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.377+0000 7fb8ddfb7640 1 Processor -- start 2024-09-05T07:58:11.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.377+0000 7fb8ddfb7640 1 -- start start 2024-09-05T07:58:11.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.378+0000 7fb8ddfb7640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb8d80cabd0 0x7fb8d80c9b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:11.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.378+0000 7fb8ddfb7640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb8d806d8f0 0x7fb8d815a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:11.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.378+0000 7fb8ddfb7640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8d80c8e80 con 0x7fb8d80cafb0 2024-09-05T07:58:11.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.378+0000 7fb8ddfb7640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fb8d815b930 con 0x7fb8d80cabd0 2024-09-05T07:58:11.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.378+0000 7fb8ddfb7640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fb8d80c96c0 con 0x7fb8d806d8f0 2024-09-05T07:58:11.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.379+0000 7fb8d77fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb8d80cabd0 0x7fb8d80c9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:11.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.379+0000 7fb8d6ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb8d806d8f0 0x7fb8d815a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:11.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.379+0000 7fb8d77fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb8d80cabd0 0x7fb8d80c9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48298/0 (socket says 172.21.15.17:48298) 2024-09-05T07:58:11.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.379+0000 7fb8d77fe640 1 -- 172.21.15.17:0/210811811 learned_addr learned my addr 172.21.15.17:0/210811811 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:58:11.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.381+0000 7fb8d6ffd640 1 -- 172.21.15.17:0/210811811 >> v2:172.21.15.17:3300/0 conn(0x7fb8d80cabd0 msgr2=0x7fb8d80c9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:58:11.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.381+0000 7fb8d6ffd640 1 --2- 172.21.15.17:0/210811811 >> v2:172.21.15.17:3300/0 conn(0x7fb8d80cabd0 0x7fb8d80c9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:11.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.381+0000 7fb8d6ffd640 1 -- 172.21.15.17:0/210811811 >> v1:172.21.15.17:6789/0 conn(0x7fb8d80cafb0 legacy=0x7fb8d815dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:11.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.381+0000 7fb8d6ffd640 1 -- 172.21.15.17:0/210811811 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d806bd40 con 0x7fb8d806d8f0 2024-09-05T07:58:11.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.383+0000 7fb8d6ffd640 1 --2- 172.21.15.17:0/210811811 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8d806d8f0 0x7fb8d815a970 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb8d806eee0 tx=0x7fb8cc02a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4ded1c20dc252eb server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:58:11.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.387+0000 7fb8d67fc640 1 -- 172.21.15.17:0/210811811 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc037070 con 0x7fb8d806d8f0 2024-09-05T07:58:11.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.387+0000 7fb8d67fc640 1 -- 172.21.15.17:0/210811811 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb8cc032440 con 0x7fb8d806d8f0 2024-09-05T07:58:11.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.387+0000 7fb8d67fc640 1 -- 172.21.15.17:0/210811811 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc02ae60 con 0x7fb8d806d8f0 2024-09-05T07:58:11.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.388+0000 7fb8ddfb7640 1 -- 172.21.15.17:0/210811811 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8d806d8f0 msgr2=0x7fb8d815a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:11.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.388+0000 7fb8ddfb7640 1 --2- 172.21.15.17:0/210811811 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8d806d8f0 0x7fb8d815a970 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb8d806eee0 tx=0x7fb8cc02a110 comp rx=0 tx=0).stop 2024-09-05T07:58:11.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.388+0000 7fb8ddfb7640 1 -- 172.21.15.17:0/210811811 shutdown_connections 2024-09-05T07:58:11.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.388+0000 7fb8ddfb7640 1 --2- 172.21.15.17:0/210811811 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8d806d8f0 0x7fb8d815a970 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:11.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.388+0000 7fb8ddfb7640 1 --2- 172.21.15.17:0/210811811 >> v2:172.21.15.17:3300/0 conn(0x7fb8d80cabd0 0x7fb8d80c9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:11.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.388+0000 7fb8ddfb7640 1 -- 172.21.15.17:0/210811811 >> 172.21.15.17:0/210811811 conn(0x7fb8d8071500 msgr2=0x7fb8d8071910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:58:11.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.388+0000 7fb8ddfb7640 1 -- 172.21.15.17:0/210811811 shutdown_connections 2024-09-05T07:58:11.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.388+0000 7fb8ddfb7640 1 -- 172.21.15.17:0/210811811 wait complete. 2024-09-05T07:58:11.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.389+0000 7fb8ddfb7640 1 Processor -- start 2024-09-05T07:58:11.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.389+0000 7fb8ddfb7640 1 -- start start 2024-09-05T07:58:11.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.390+0000 7fb8ddfb7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8d806d8f0 0x7fb8d815d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:11.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.390+0000 7fb8ddfb7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8d80cabd0 0x7fb8d8159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:11.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.390+0000 7fb8ddfb7640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb8d80cafb0 0x7fb8d814db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:11.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.390+0000 7fb8ddfb7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d80cdd60 con 0x7fb8d80cabd0 2024-09-05T07:58:11.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.390+0000 7fb8ddfb7640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d80c9350 con 0x7fb8d806d8f0 2024-09-05T07:58:11.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.390+0000 7fb8ddfb7640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7fb8d80c8b40 con 0x7fb8d80cafb0 2024-09-05T07:58:11.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.391+0000 7fb8d6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8d80cabd0 0x7fb8d8159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:11.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.391+0000 7fb8d77fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8d806d8f0 0x7fb8d815d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:11.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.391+0000 7fb8d7fff640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb8d80cafb0 0x7fb8d814db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:11.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.391+0000 7fb8d77fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8d806d8f0 0x7fb8d815d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:51352/0 (socket says 172.21.15.17:51352) 2024-09-05T07:58:11.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.391+0000 7fb8d77fe640 1 -- 172.21.15.17:0/1706602991 learned_addr learned my addr 172.21.15.17:0/1706602991 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:58:11.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.395+0000 7fb8d6ffd640 1 -- 172.21.15.17:0/1706602991 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb8d80cafb0 msgr2=0x7fb8d814db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:11.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.395+0000 7fb8d6ffd640 1 --2- 172.21.15.17:0/1706602991 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb8d80cafb0 0x7fb8d814db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:11.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.395+0000 7fb8d6ffd640 1 -- 172.21.15.17:0/1706602991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8d806d8f0 msgr2=0x7fb8d815d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:11.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.395+0000 7fb8d6ffd640 1 --2- 172.21.15.17:0/1706602991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8d806d8f0 0x7fb8d815d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:11.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.395+0000 7fb8d6ffd640 1 -- 172.21.15.17:0/1706602991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d815cc60 con 0x7fb8d80cabd0 2024-09-05T07:58:11.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.397+0000 7fb8d6ffd640 1 --2- 172.21.15.17:0/1706602991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8d80cabd0 0x7fb8d8159730 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb8d80c9840 tx=0x7fb8cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:58:11.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.401+0000 7fb8bffff640 1 -- 172.21.15.17:0/1706602991 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc041030 con 0x7fb8d80cabd0 2024-09-05T07:58:11.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.401+0000 7fb8bffff640 1 -- 172.21.15.17:0/1706602991 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb8cc030540 con 0x7fb8d80cabd0 2024-09-05T07:58:11.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.401+0000 7fb8bffff640 1 -- 172.21.15.17:0/1706602991 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc037040 con 0x7fb8d80cabd0 2024-09-05T07:58:11.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.401+0000 7fb8ddfb7640 1 -- 172.21.15.17:0/1706602991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8d81f19c0 con 0x7fb8d80cabd0 2024-09-05T07:58:11.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.401+0000 7fb8ddfb7640 1 -- 172.21.15.17:0/1706602991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8d81530e0 con 0x7fb8d80cabd0 2024-09-05T07:58:11.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.402+0000 7fb8ddfb7640 1 -- 172.21.15.17:0/1706602991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8d806c2c0 con 0x7fb8d80cabd0 2024-09-05T07:58:11.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.678+0000 7fb8bffff640 1 -- 172.21.15.17:0/1706602991 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb8cc044070 con 0x7fb8d80cabd0 2024-09-05T07:58:11.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.678+0000 7fb8bffff640 1 --2- 172.21.15.17:0/1706602991 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fb8c406be30 0x7fb8c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:11.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.678+0000 7fb8d77fe640 1 --2- 172.21.15.17:0/1706602991 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fb8c406be30 0x7fb8c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:11.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.679+0000 7fb8d77fe640 1 --2- 172.21.15.17:0/1706602991 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fb8c406be30 0x7fb8c406e2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb8c80094a0 tx=0x7fb8c8009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:58:11.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.695+0000 7fb8bffff640 1 -- 172.21.15.17:0/1706602991 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5738+0+0 (secure 0 0 0) 0x7fb8cc078390 con 0x7fb8d80cabd0 2024-09-05T07:58:11.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.695+0000 7fb8bffff640 1 -- 172.21.15.17:0/1706602991 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb8cc07a2f0 con 0x7fb8d80cabd0 2024-09-05T07:58:11.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:11.919+0000 7fb8ddfb7640 1 -- 172.21.15.17:0/1706602991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb8d80cdad0 con 0x7fb8d80cabd0 2024-09-05T07:58:12.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.064+0000 7fb8bffff640 1 -- 172.21.15.17:0/1706602991 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) ==== 161+0+0 (secure 0 0 0) 0x7fb8cc07e5f0 con 0x7fb8d80cabd0 2024-09-05T07:58:12.065 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-05T07:58:12.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.066+0000 7fb8ddfb7640 1 -- 172.21.15.17:0/1706602991 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fb8c406be30 msgr2=0x7fb8c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:12.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.066+0000 7fb8ddfb7640 1 --2- 172.21.15.17:0/1706602991 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fb8c406be30 0x7fb8c406e2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb8c80094a0 tx=0x7fb8c8009240 comp rx=0 tx=0).stop 2024-09-05T07:58:12.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.066+0000 7fb8ddfb7640 1 -- 172.21.15.17:0/1706602991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8d80cabd0 msgr2=0x7fb8d8159730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:12.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.066+0000 7fb8ddfb7640 1 --2- 172.21.15.17:0/1706602991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8d80cabd0 0x7fb8d8159730 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb8d80c9840 tx=0x7fb8cc0046c0 comp rx=0 tx=0).stop 2024-09-05T07:58:12.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.066+0000 7fb8ddfb7640 1 -- 172.21.15.17:0/1706602991 shutdown_connections 2024-09-05T07:58:12.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.066+0000 7fb8ddfb7640 1 --2- 172.21.15.17:0/1706602991 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7fb8c406be30 0x7fb8c406e2f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:12.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.066+0000 7fb8ddfb7640 1 --2- 172.21.15.17:0/1706602991 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb8d80cafb0 0x7fb8d814db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:12.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.066+0000 7fb8ddfb7640 1 --2- 172.21.15.17:0/1706602991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8d80cabd0 0x7fb8d8159730 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:12.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.066+0000 7fb8ddfb7640 1 --2- 172.21.15.17:0/1706602991 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8d806d8f0 0x7fb8d815d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:12.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.066+0000 7fb8ddfb7640 1 -- 172.21.15.17:0/1706602991 >> 172.21.15.17:0/1706602991 conn(0x7fb8d8071500 msgr2=0x7fb8d806f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:58:12.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.066+0000 7fb8ddfb7640 1 -- 172.21.15.17:0/1706602991 shutdown_connections 2024-09-05T07:58:12.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.066+0000 7fb8ddfb7640 1 -- 172.21.15.17:0/1706602991 wait complete. 2024-09-05T07:58:12.080 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-05T07:58:12.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.187+0000 7f1d7b59e640 1 Processor -- start 2024-09-05T07:58:12.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.187+0000 7f1d7b59e640 1 -- start start 2024-09-05T07:58:12.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.188+0000 7f1d7b59e640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d7c154950 0x7f1d7c15b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:12.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.188+0000 7f1d7b59e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d7c0cb260 con 0x7f1d7c0cce50 2024-09-05T07:58:12.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.188+0000 7f1d7b59e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d7c0cb540 con 0x7f1d7c0cc2c0 2024-09-05T07:58:12.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.188+0000 7f1d7b59e640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f1d7c0b48c0 con 0x7f1d7c154950 2024-09-05T07:58:12.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.189+0000 7f1d79d9b640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1d7c0cc2c0 0x7f1d7c0b41b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.17:40936/0 (socket says 172.21.15.17:40936) 2024-09-05T07:58:12.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.189+0000 7f1d79d9b640 1 -- 172.21.15.17:0/1821663084 learned_addr learned my addr 172.21.15.17:0/1821663084 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:58:12.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.189+0000 7f1d7a59c640 1 --2- 172.21.15.17:0/1821663084 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d7c154950 0x7f1d7c15b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:12.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.192+0000 7f1d7a59c640 1 -- 172.21.15.17:0/1821663084 >> v1:172.21.15.26:6789/0 conn(0x7f1d7c0cc2c0 legacy=0x7f1d7c0b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:12.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.192+0000 7f1d7a59c640 1 -- 172.21.15.17:0/1821663084 >> v1:172.21.15.17:6789/0 conn(0x7f1d7c0cce50 legacy=0x7f1d7c164f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:58:12.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.192+0000 7f1d7a59c640 1 -- 172.21.15.17:0/1821663084 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d7c15db70 con 0x7f1d7c154950 2024-09-05T07:58:12.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.195+0000 7f1d7a59c640 1 --2- 172.21.15.17:0/1821663084 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d7c154950 0x7f1d7c15b070 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c0097d0 tx=0x7f1d6c02a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eab29c34bd93c78d server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:58:12.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.200+0000 7f1d7959a640 1 -- 172.21.15.17:0/1821663084 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c037070 con 0x7f1d7c154950 2024-09-05T07:58:12.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.200+0000 7f1d7959a640 1 -- 172.21.15.17:0/1821663084 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1d6c032440 con 0x7f1d7c154950 2024-09-05T07:58:12.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.200+0000 7f1d7959a640 1 -- 172.21.15.17:0/1821663084 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c032830 con 0x7f1d7c154950 2024-09-05T07:58:12.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.201+0000 7f1d7b59e640 1 -- 172.21.15.17:0/1821663084 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d7c154950 msgr2=0x7f1d7c15b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:12.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.201+0000 7f1d7b59e640 1 --2- 172.21.15.17:0/1821663084 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d7c154950 0x7f1d7c15b070 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c0097d0 tx=0x7f1d6c02a250 comp rx=0 tx=0).stop 2024-09-05T07:58:12.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.201+0000 7f1d7b59e640 1 -- 172.21.15.17:0/1821663084 shutdown_connections 2024-09-05T07:58:12.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.201+0000 7f1d7b59e640 1 --2- 172.21.15.17:0/1821663084 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d7c154950 0x7f1d7c15b070 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:12.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.201+0000 7f1d7b59e640 1 -- 172.21.15.17:0/1821663084 >> 172.21.15.17:0/1821663084 conn(0x7f1d7c0735f0 msgr2=0x7f1d7c0739d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:58:12.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.201+0000 7f1d7b59e640 1 -- 172.21.15.17:0/1821663084 shutdown_connections 2024-09-05T07:58:12.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.201+0000 7f1d7b59e640 1 -- 172.21.15.17:0/1821663084 wait complete. 2024-09-05T07:58:12.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.202+0000 7f1d7b59e640 1 Processor -- start 2024-09-05T07:58:12.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.202+0000 7f1d7b59e640 1 -- start start 2024-09-05T07:58:12.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.203+0000 7f1d7b59e640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d7c0cc2c0 0x7f1d7c152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:12.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.203+0000 7f1d7b59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d7c0cce50 0x7f1d7c145540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:12.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.203+0000 7f1d7b59e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d7c154950 0x7f1d7c149830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:12.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.203+0000 7f1d7b59e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7c15e130 con 0x7f1d7c0cce50 2024-09-05T07:58:12.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.203+0000 7f1d7b59e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7c0cb010 con 0x7f1d7c154950 2024-09-05T07:58:12.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.203+0000 7f1d7b59e640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f1d7c15e930 con 0x7f1d7c0cc2c0 2024-09-05T07:58:12.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.204+0000 7f1d7ad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d7c154950 0x7f1d7c149830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:12.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.204+0000 7f1d7ad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d7c154950 0x7f1d7c149830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:51368/0 (socket says 172.21.15.17:51368) 2024-09-05T07:58:12.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.204+0000 7f1d7ad9d640 1 -- 172.21.15.17:0/2014647554 learned_addr learned my addr 172.21.15.17:0/2014647554 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:58:12.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.204+0000 7f1d7a59c640 1 --2- 172.21.15.17:0/2014647554 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d7c0cc2c0 0x7f1d7c152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:12.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.209+0000 7f1d7ad9d640 1 -- 172.21.15.17:0/2014647554 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d7c0cc2c0 msgr2=0x7f1d7c152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:12.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.209+0000 7f1d7ad9d640 1 --2- 172.21.15.17:0/2014647554 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d7c0cc2c0 0x7f1d7c152170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:12.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.209+0000 7f1d7ad9d640 1 -- 172.21.15.17:0/2014647554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d7c0cce50 msgr2=0x7f1d7c145540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:12.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.209+0000 7f1d7ad9d640 1 --2- 172.21.15.17:0/2014647554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d7c0cce50 0x7f1d7c145540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:12.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.209+0000 7f1d7ad9d640 1 -- 172.21.15.17:0/2014647554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d7c15d420 con 0x7f1d7c154950 2024-09-05T07:58:12.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.213+0000 7f1d7ad9d640 1 --2- 172.21.15.17:0/2014647554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d7c154950 0x7f1d7c149830 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1d7400c7b0 tx=0x7f1d7400cc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:58:12.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.215+0000 7f1d6affd640 1 -- 172.21.15.17:0/2014647554 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d74017070 con 0x7f1d7c154950 2024-09-05T07:58:12.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.216+0000 7f1d7b59e640 1 -- 172.21.15.17:0/2014647554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d7c153990 con 0x7f1d7c154950 2024-09-05T07:58:12.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.216+0000 7f1d7b59e640 1 -- 172.21.15.17:0/2014647554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d7c145020 con 0x7f1d7c154950 2024-09-05T07:58:12.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.216+0000 7f1d7b59e640 1 -- 172.21.15.17:0/2014647554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d7c0cc6e0 con 0x7f1d7c154950 2024-09-05T07:58:12.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.219+0000 7f1d6affd640 1 -- 172.21.15.17:0/2014647554 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1d74003d80 con 0x7f1d7c154950 2024-09-05T07:58:12.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.219+0000 7f1d6affd640 1 -- 172.21.15.17:0/2014647554 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d74021060 con 0x7f1d7c154950 2024-09-05T07:58:12.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.506+0000 7f1d6affd640 1 -- 172.21.15.17:0/2014647554 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1d7401a070 con 0x7f1d7c154950 2024-09-05T07:58:12.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.507+0000 7f1d6affd640 1 --2- 172.21.15.17:0/2014647554 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f1d5c06be30 0x7f1d5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:12.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.507+0000 7f1d7a59c640 1 --2- 172.21.15.17:0/2014647554 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f1d5c06be30 0x7f1d5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:12.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.507+0000 7f1d7a59c640 1 --2- 172.21.15.17:0/2014647554 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f1d5c06be30 0x7f1d5c06e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c034000 tx=0x7f1d6c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:58:12.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.514+0000 7f1d6affd640 1 -- 172.21.15.17:0/2014647554 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6168+0+0 (secure 0 0 0) 0x7f1d74056f70 con 0x7f1d7c154950 2024-09-05T07:58:12.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.532+0000 7f1d6affd640 1 -- 172.21.15.17:0/2014647554 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1d74058ed0 con 0x7f1d7c154950 2024-09-05T07:58:12.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:12.747+0000 7f1d7b59e640 1 -- 172.21.15.17:0/2014647554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f1d7c0cbb50 con 0x7f1d7c154950 2024-09-05T07:58:13.663 INFO:tasks.ceph.mds.b.smithi026.stderr:==00:00:28:55.855 41442== 2024-09-05T07:58:13.663 INFO:tasks.ceph.mds.b.smithi026.stderr:==00:00:28:55.855 41442== Exit program on first error (--exit-on-first-error=yes) 2024-09-05T07:58:13.664 INFO:tasks.ceph.mds.a.smithi017.stderr:==00:00:28:55.855 41602== 2024-09-05T07:58:13.664 INFO:tasks.ceph.mds.a.smithi017.stderr:==00:00:28:55.855 41602== Exit program on first error (--exit-on-first-error=yes) 2024-09-05T07:58:13.675 INFO:tasks.ceph.mds.e.smithi017.stderr:==00:00:28:55.861 41603== 2024-09-05T07:58:13.675 INFO:tasks.ceph.mds.e.smithi017.stderr:==00:00:28:55.861 41603== Exit program on first error (--exit-on-first-error=yes) 2024-09-05T07:58:13.731 INFO:tasks.ceph.mds.d.smithi026.stderr:==00:00:28:55.927 41441== 2024-09-05T07:58:13.732 INFO:tasks.ceph.mds.d.smithi026.stderr:==00:00:28:55.928 41441== Exit program on first error (--exit-on-first-error=yes) 2024-09-05T07:58:13.738 INFO:tasks.ceph.mds.b.smithi026.stderr:daemon-helper: command failed with exit status 42 2024-09-05T07:58:13.750 INFO:tasks.ceph.mds.a.smithi017.stderr:daemon-helper: command failed with exit status 42 2024-09-05T07:58:13.750 INFO:tasks.ceph.mds.e.smithi017.stderr:daemon-helper: command failed with exit status 42 2024-09-05T07:58:13.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:13.891+0000 7f1d6affd640 1 -- 172.21.15.17:0/2014647554 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) ==== 104+0+0 (secure 0 0 0) 0x7f1d7405d1d0 con 0x7f1d7c154950 2024-09-05T07:58:14.024 INFO:tasks.ceph.mds.f.smithi026.stderr:==00:00:28:56.098 41440== 2024-09-05T07:58:14.025 INFO:tasks.ceph.mds.f.smithi026.stderr:==00:00:28:56.098 41440== Exit program on first error (--exit-on-first-error=yes) 2024-09-05T07:58:14.025 INFO:tasks.ceph.mds.d.smithi026.stderr:daemon-helper: command failed with exit status 42 2024-09-05T07:58:14.027 INFO:tasks.ceph.mds.f.smithi026.stderr:daemon-helper: command failed with exit status 42 2024-09-05T07:58:14.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:13.893+0000 7f1d7b59e640 1 -- 172.21.15.17:0/2014647554 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f1d5c06be30 msgr2=0x7f1d5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:14.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:13.893+0000 7f1d7b59e640 1 --2- 172.21.15.17:0/2014647554 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f1d5c06be30 0x7f1d5c06e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c034000 tx=0x7f1d6c02e000 comp rx=0 tx=0).stop 2024-09-05T07:58:14.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:13.893+0000 7f1d7b59e640 1 -- 172.21.15.17:0/2014647554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d7c154950 msgr2=0x7f1d7c149830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:14.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:13.893+0000 7f1d7b59e640 1 --2- 172.21.15.17:0/2014647554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d7c154950 0x7f1d7c149830 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1d7400c7b0 tx=0x7f1d7400cc70 comp rx=0 tx=0).stop 2024-09-05T07:58:14.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:13.893+0000 7f1d7b59e640 1 -- 172.21.15.17:0/2014647554 shutdown_connections 2024-09-05T07:58:14.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:13.893+0000 7f1d7b59e640 1 --2- 172.21.15.17:0/2014647554 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f1d5c06be30 0x7f1d5c06e2f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:14.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:13.893+0000 7f1d7b59e640 1 --2- 172.21.15.17:0/2014647554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d7c154950 0x7f1d7c149830 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:14.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:13.893+0000 7f1d7b59e640 1 --2- 172.21.15.17:0/2014647554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d7c0cce50 0x7f1d7c145540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:14.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:13.893+0000 7f1d7b59e640 1 --2- 172.21.15.17:0/2014647554 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1d7c0cc2c0 0x7f1d7c152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:14.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:13.894+0000 7f1d7b59e640 1 -- 172.21.15.17:0/2014647554 >> 172.21.15.17:0/2014647554 conn(0x7f1d7c0735f0 msgr2=0x7f1d7c0b4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:58:14.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:13.894+0000 7f1d7b59e640 1 -- 172.21.15.17:0/2014647554 shutdown_connections 2024-09-05T07:58:14.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:13.894+0000 7f1d7b59e640 1 -- 172.21.15.17:0/2014647554 wait complete. 2024-09-05T07:58:14.029 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-05T07:58:14.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.134+0000 7effab484640 1 Processor -- start 2024-09-05T07:58:14.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.135+0000 7effab484640 1 -- start start 2024-09-05T07:58:14.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.135+0000 7effab484640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7effa40ccef0 0x7effa40b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:14.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.135+0000 7effab484640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effa40b3b20 con 0x7effa40b43b0 2024-09-05T07:58:14.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.135+0000 7effab484640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effa415b590 con 0x7effa40cd2d0 2024-09-05T07:58:14.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.135+0000 7effab484640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7effa40b2d60 con 0x7effa40ccef0 2024-09-05T07:58:14.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.136+0000 7effa8a1f640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7effa40b43b0 0x7effa4157800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:43628/0 (socket says 172.21.15.17:43628) 2024-09-05T07:58:14.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.136+0000 7effa8a1f640 1 -- 172.21.15.17:0/4089408640 learned_addr learned my addr 172.21.15.17:0/4089408640 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:58:14.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.136+0000 7effa9220640 1 --2- 172.21.15.17:0/4089408640 >> v2:172.21.15.26:3300/0 conn(0x7effa40ccef0 0x7effa40b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:14.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.139+0000 7eff9bfff640 1 -- 172.21.15.17:0/4089408640 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3307310154 0 0) 0x7effa40b3b20 con 0x7effa40b43b0 2024-09-05T07:58:14.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.139+0000 7eff9bfff640 1 -- 172.21.15.17:0/4089408640 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff90003520 con 0x7effa40b43b0 2024-09-05T07:58:14.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.139+0000 7effa9220640 1 -- 172.21.15.17:0/4089408640 >> v1:172.21.15.26:6789/0 conn(0x7effa40cd2d0 legacy=0x7effa415a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T07:58:14.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.139+0000 7effa9220640 1 -- 172.21.15.17:0/4089408640 >> v1:172.21.15.17:6789/0 conn(0x7effa40b43b0 legacy=0x7effa4157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:14.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.139+0000 7effa9220640 1 -- 172.21.15.17:0/4089408640 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa40b3040 con 0x7effa40ccef0 2024-09-05T07:58:14.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.143+0000 7effa9220640 1 --2- 172.21.15.17:0/4089408640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effa40ccef0 0x7effa40b3e70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7effa00097d0 tx=0x7effa002a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b832573981326d40 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:58:14.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.146+0000 7eff9bfff640 1 -- 172.21.15.17:0/4089408640 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa0037070 con 0x7effa40ccef0 2024-09-05T07:58:14.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.146+0000 7eff9bfff640 1 -- 172.21.15.17:0/4089408640 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7effa0032440 con 0x7effa40ccef0 2024-09-05T07:58:14.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.146+0000 7eff9bfff640 1 -- 172.21.15.17:0/4089408640 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa0032830 con 0x7effa40ccef0 2024-09-05T07:58:14.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.147+0000 7effab484640 1 -- 172.21.15.17:0/4089408640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effa40ccef0 msgr2=0x7effa40b3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:14.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.147+0000 7effab484640 1 --2- 172.21.15.17:0/4089408640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effa40ccef0 0x7effa40b3e70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7effa00097d0 tx=0x7effa002a210 comp rx=0 tx=0).stop 2024-09-05T07:58:14.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.147+0000 7effab484640 1 -- 172.21.15.17:0/4089408640 shutdown_connections 2024-09-05T07:58:14.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.147+0000 7effab484640 1 --2- 172.21.15.17:0/4089408640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effa40ccef0 0x7effa40b3e70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:14.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.147+0000 7effab484640 1 -- 172.21.15.17:0/4089408640 >> 172.21.15.17:0/4089408640 conn(0x7effa4072230 msgr2=0x7effa4072640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:58:14.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.147+0000 7effab484640 1 -- 172.21.15.17:0/4089408640 shutdown_connections 2024-09-05T07:58:14.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.147+0000 7effab484640 1 -- 172.21.15.17:0/4089408640 wait complete. 2024-09-05T07:58:14.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.148+0000 7effab484640 1 Processor -- start 2024-09-05T07:58:14.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.148+0000 7effab484640 1 -- start start 2024-09-05T07:58:14.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.149+0000 7effab484640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effa40b43b0 0x7effa41e7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:14.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.149+0000 7effab484640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effa40ccef0 0x7effa415a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:14.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.149+0000 7effab484640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effa40cd2d0 0x7effa41f46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:14.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.149+0000 7effab484640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7effa415dee0 con 0x7effa40cd2d0 2024-09-05T07:58:14.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.149+0000 7effab484640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7effa40b3600 con 0x7effa40ccef0 2024-09-05T07:58:14.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.149+0000 7effab484640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7effa415e060 con 0x7effa40b43b0 2024-09-05T07:58:14.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.150+0000 7effa8a1f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effa40ccef0 0x7effa415a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:14.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.150+0000 7effa9220640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effa40b43b0 0x7effa41e7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:14.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.150+0000 7effa8a1f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effa40ccef0 0x7effa415a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.17:51388/0 (socket says 172.21.15.17:51388) 2024-09-05T07:58:14.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.150+0000 7effa8a1f640 1 -- 172.21.15.17:0/1557173443 learned_addr learned my addr 172.21.15.17:0/1557173443 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:58:14.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.154+0000 7effa8a1f640 1 -- 172.21.15.17:0/1557173443 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effa40b43b0 msgr2=0x7effa41e7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:14.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.154+0000 7effa8a1f640 1 --2- 172.21.15.17:0/1557173443 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effa40b43b0 0x7effa41e7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:14.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.154+0000 7effa8a1f640 1 -- 172.21.15.17:0/1557173443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effa40cd2d0 msgr2=0x7effa41f46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:14.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.154+0000 7effa8a1f640 1 --2- 172.21.15.17:0/1557173443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effa40cd2d0 0x7effa41f46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:14.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.154+0000 7effa8a1f640 1 -- 172.21.15.17:0/1557173443 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa40c76a0 con 0x7effa40ccef0 2024-09-05T07:58:14.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.156+0000 7effa8a1f640 1 --2- 172.21.15.17:0/1557173443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effa40ccef0 0x7effa415a220 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7eff9400c430 tx=0x7eff9400c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:58:14.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.159+0000 7eff99ffb640 1 -- 172.21.15.17:0/1557173443 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff94017070 con 0x7effa40ccef0 2024-09-05T07:58:14.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.159+0000 7effab484640 1 -- 172.21.15.17:0/1557173443 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effa40c7940 con 0x7effa40ccef0 2024-09-05T07:58:14.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.159+0000 7effab484640 1 -- 172.21.15.17:0/1557173443 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effa40c7f00 con 0x7effa40ccef0 2024-09-05T07:58:14.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.160+0000 7effab484640 1 -- 172.21.15.17:0/1557173443 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effa40cf1d0 con 0x7effa40ccef0 2024-09-05T07:58:14.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.160+0000 7eff99ffb640 1 -- 172.21.15.17:0/1557173443 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7eff94005ce0 con 0x7effa40ccef0 2024-09-05T07:58:14.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.160+0000 7eff99ffb640 1 -- 172.21.15.17:0/1557173443 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff94021060 con 0x7effa40ccef0 2024-09-05T07:58:14.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.440+0000 7eff99ffb640 1 -- 172.21.15.17:0/1557173443 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7eff9401a070 con 0x7effa40ccef0 2024-09-05T07:58:14.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.440+0000 7eff99ffb640 1 --2- 172.21.15.17:0/1557173443 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7eff8806be60 0x7eff8806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:14.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.440+0000 7effa9220640 1 --2- 172.21.15.17:0/1557173443 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7eff8806be60 0x7eff8806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:14.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.441+0000 7effa9220640 1 --2- 172.21.15.17:0/1557173443 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7eff8806be60 0x7eff8806e320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7effa0034000 tx=0x7effa002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:58:14.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.444+0000 7eff99ffb640 1 -- 172.21.15.17:0/1557173443 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6168+0+0 (secure 0 0 0) 0x7eff94056e90 con 0x7effa40ccef0 2024-09-05T07:58:14.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.457+0000 7eff99ffb640 1 -- 172.21.15.17:0/1557173443 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7effa40cf1d0 con 0x7effa40ccef0 2024-09-05T07:58:14.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:14.634+0000 7effab484640 1 -- 172.21.15.17:0/1557173443 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7effa415b310 con 0x7effa40ccef0 2024-09-05T07:58:15.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.059+0000 7eff99ffb640 1 -- 172.21.15.17:0/1557173443 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) ==== 181+0+0 (secure 0 0 0) 0x7effa415b310 con 0x7effa40ccef0 2024-09-05T07:58:15.059 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2024-09-05T07:58:15.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.061+0000 7effab484640 1 -- 172.21.15.17:0/1557173443 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7eff8806be60 msgr2=0x7eff8806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:15.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.061+0000 7effab484640 1 --2- 172.21.15.17:0/1557173443 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7eff8806be60 0x7eff8806e320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7effa0034000 tx=0x7effa002e000 comp rx=0 tx=0).stop 2024-09-05T07:58:15.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.061+0000 7effab484640 1 -- 172.21.15.17:0/1557173443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effa40ccef0 msgr2=0x7effa415a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:15.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.061+0000 7effab484640 1 --2- 172.21.15.17:0/1557173443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effa40ccef0 0x7effa415a220 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7eff9400c430 tx=0x7eff9400c8f0 comp rx=0 tx=0).stop 2024-09-05T07:58:15.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.061+0000 7effab484640 1 -- 172.21.15.17:0/1557173443 shutdown_connections 2024-09-05T07:58:15.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.061+0000 7effab484640 1 --2- 172.21.15.17:0/1557173443 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7eff8806be60 0x7eff8806e320 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:15.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.061+0000 7effab484640 1 --2- 172.21.15.17:0/1557173443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effa40cd2d0 0x7effa41f46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:15.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.061+0000 7effab484640 1 --2- 172.21.15.17:0/1557173443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effa40ccef0 0x7effa415a220 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:15.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.061+0000 7effab484640 1 --2- 172.21.15.17:0/1557173443 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7effa40b43b0 0x7effa41e7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:15.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.061+0000 7effab484640 1 -- 172.21.15.17:0/1557173443 >> 172.21.15.17:0/1557173443 conn(0x7effa4072230 msgr2=0x7effa41575d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:58:15.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.061+0000 7effab484640 1 -- 172.21.15.17:0/1557173443 shutdown_connections 2024-09-05T07:58:15.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.061+0000 7effab484640 1 -- 172.21.15.17:0/1557173443 wait complete. 2024-09-05T07:58:15.073 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-05T07:58:15.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.185+0000 7f4ec84ba640 1 Processor -- start 2024-09-05T07:58:15.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.185+0000 7f4ec84ba640 1 -- start start 2024-09-05T07:58:15.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.186+0000 7f4ec84ba640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ec0154bc0 0x7f4ec015de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:15.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.186+0000 7f4ec84ba640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ec015a8f0 con 0x7f4ec00cda50 2024-09-05T07:58:15.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.186+0000 7f4ec84ba640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ec00cae30 con 0x7f4ec015b650 2024-09-05T07:58:15.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.186+0000 7f4ec84ba640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f4ec00cc710 con 0x7f4ec0154bc0 2024-09-05T07:58:15.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.186+0000 7f4ec6a57640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f4ec00cda50 0x7f4ec01651b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:43632/0 (socket says 172.21.15.17:43632) 2024-09-05T07:58:15.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.186+0000 7f4ec6a57640 1 -- 172.21.15.17:0/1888284693 learned_addr learned my addr 172.21.15.17:0/1888284693 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-05T07:58:15.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.187+0000 7f4ec6256640 1 --2- 172.21.15.17:0/1888284693 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ec0154bc0 0x7f4ec015de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:15.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.189+0000 7f4ec5254640 1 -- 172.21.15.17:0/1888284693 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2724248753 0 0) 0x7f4eb8001490 con 0x7f4ec00cda50 2024-09-05T07:58:15.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.189+0000 7f4ec5254640 1 -- 172.21.15.17:0/1888284693 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4eac003520 con 0x7f4ec00cda50 2024-09-05T07:58:15.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.189+0000 7f4ec5254640 1 -- 172.21.15.17:0/1888284693 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2643663353 0 0) 0x7f4ec00cae30 con 0x7f4ec015b650 2024-09-05T07:58:15.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.189+0000 7f4ec5254640 1 -- 172.21.15.17:0/1888284693 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4eb8001490 con 0x7f4ec015b650 2024-09-05T07:58:15.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.189+0000 7f4ec6256640 1 -- 172.21.15.17:0/1888284693 >> v1:172.21.15.26:6789/0 conn(0x7f4ec015b650 legacy=0x7f4ec006c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:15.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.189+0000 7f4ec6256640 1 -- 172.21.15.17:0/1888284693 >> v1:172.21.15.17:6789/0 conn(0x7f4ec00cda50 legacy=0x7f4ec01651b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:15.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.189+0000 7f4ec6256640 1 -- 172.21.15.17:0/1888284693 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ec00cc9f0 con 0x7f4ec0154bc0 2024-09-05T07:58:15.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.191+0000 7f4ec6256640 1 --2- 172.21.15.17:0/1888284693 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ec0154bc0 0x7f4ec015de60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc0097d0 tx=0x7f4ebc02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b34c8ba47f985028 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:58:15.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.195+0000 7f4ec5254640 1 -- 172.21.15.17:0/1888284693 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc037070 con 0x7f4ec0154bc0 2024-09-05T07:58:15.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.195+0000 7f4ec5254640 1 -- 172.21.15.17:0/1888284693 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4ebc032440 con 0x7f4ec0154bc0 2024-09-05T07:58:15.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.195+0000 7f4ec5254640 1 -- 172.21.15.17:0/1888284693 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc032830 con 0x7f4ec0154bc0 2024-09-05T07:58:15.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.195+0000 7f4ec84ba640 1 -- 172.21.15.17:0/1888284693 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ec0154bc0 msgr2=0x7f4ec015de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:15.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.195+0000 7f4ec84ba640 1 --2- 172.21.15.17:0/1888284693 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ec0154bc0 0x7f4ec015de60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc0097d0 tx=0x7f4ebc02a210 comp rx=0 tx=0).stop 2024-09-05T07:58:15.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.195+0000 7f4ec84ba640 1 -- 172.21.15.17:0/1888284693 shutdown_connections 2024-09-05T07:58:15.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.195+0000 7f4ec84ba640 1 --2- 172.21.15.17:0/1888284693 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ec0154bc0 0x7f4ec015de60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:15.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.195+0000 7f4ec84ba640 1 -- 172.21.15.17:0/1888284693 >> 172.21.15.17:0/1888284693 conn(0x7f4ec00738d0 msgr2=0x7f4ec0073ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:58:15.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.195+0000 7f4ec84ba640 1 -- 172.21.15.17:0/1888284693 shutdown_connections 2024-09-05T07:58:15.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.195+0000 7f4ec84ba640 1 -- 172.21.15.17:0/1888284693 wait complete. 2024-09-05T07:58:15.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.196+0000 7f4ec84ba640 1 Processor -- start 2024-09-05T07:58:15.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.196+0000 7f4ec84ba640 1 -- start start 2024-09-05T07:58:15.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.197+0000 7f4ec84ba640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ec00cda50 0x7f4ec0150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:15.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.197+0000 7f4ec84ba640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ec0154bc0 0x7f4ec00ce860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:15.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.197+0000 7f4ec84ba640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ec015b650 0x7f4ec00ceda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:15.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.197+0000 7f4ec84ba640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec015b130 con 0x7f4ec00cda50 2024-09-05T07:58:15.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.197+0000 7f4ec84ba640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec015ae50 con 0x7f4ec0154bc0 2024-09-05T07:58:15.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.197+0000 7f4ec84ba640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 -- 0x7f4ec015e3a0 con 0x7f4ec015b650 2024-09-05T07:58:15.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.198+0000 7f4ec6256640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ec00cda50 0x7f4ec0150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:15.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.198+0000 7f4ec6a57640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ec015b650 0x7f4ec00ceda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:15.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.198+0000 7f4ec6256640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ec00cda50 0x7f4ec0150210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48312/0 (socket says 172.21.15.17:48312) 2024-09-05T07:58:15.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.198+0000 7f4ec6256640 1 -- 172.21.15.17:0/1108390563 learned_addr learned my addr 172.21.15.17:0/1108390563 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-05T07:58:15.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.198+0000 7f4ec5a55640 1 --2- 172.21.15.17:0/1108390563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ec0154bc0 0x7f4ec00ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:15.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.201+0000 7f4ec6256640 1 -- 172.21.15.17:0/1108390563 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ec015b650 msgr2=0x7f4ec00ceda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:15.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.201+0000 7f4ec6256640 1 --2- 172.21.15.17:0/1108390563 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ec015b650 0x7f4ec00ceda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:15.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.201+0000 7f4ec6256640 1 -- 172.21.15.17:0/1108390563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ec0154bc0 msgr2=0x7f4ec00ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:15.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.201+0000 7f4ec6256640 1 --2- 172.21.15.17:0/1108390563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ec0154bc0 0x7f4ec00ce860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:15.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.201+0000 7f4ec6256640 1 -- 172.21.15.17:0/1108390563 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ec0158290 con 0x7f4ec00cda50 2024-09-05T07:58:15.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.204+0000 7f4ec6256640 1 --2- 172.21.15.17:0/1108390563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ec00cda50 0x7f4ec0150210 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc000c00 tx=0x7f4ebc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:58:15.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.207+0000 7f4eb6ffd640 1 -- 172.21.15.17:0/1108390563 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc041030 con 0x7f4ec00cda50 2024-09-05T07:58:15.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.207+0000 7f4eb6ffd640 1 -- 172.21.15.17:0/1108390563 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4ebc0304c0 con 0x7f4ec00cda50 2024-09-05T07:58:15.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.207+0000 7f4eb6ffd640 1 -- 172.21.15.17:0/1108390563 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc037040 con 0x7f4ec00cda50 2024-09-05T07:58:15.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.207+0000 7f4ec84ba640 1 -- 172.21.15.17:0/1108390563 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ec01f0360 con 0x7f4ec00cda50 2024-09-05T07:58:15.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.207+0000 7f4ec84ba640 1 -- 172.21.15.17:0/1108390563 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ec01f0920 con 0x7f4ec00cda50 2024-09-05T07:58:15.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.209+0000 7f4ec84ba640 1 -- 172.21.15.17:0/1108390563 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ec0154fa0 con 0x7f4ec00cda50 2024-09-05T07:58:15.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.228+0000 7f4eb6ffd640 1 -- 172.21.15.17:0/1108390563 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ebc044070 con 0x7f4ec00cda50 2024-09-05T07:58:15.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.228+0000 7f4eb6ffd640 1 --2- 172.21.15.17:0/1108390563 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f4ea406be80 0x7f4ea406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T07:58:15.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.228+0000 7f4ec5a55640 1 --2- 172.21.15.17:0/1108390563 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f4ea406be80 0x7f4ea406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T07:58:15.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.229+0000 7f4ec5a55640 1 --2- 172.21.15.17:0/1108390563 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f4ea406be80 0x7f4ea406e340 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0007fd0 tx=0x7f4eb0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T07:58:15.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.230+0000 7f4eb6ffd640 1 -- 172.21.15.17:0/1108390563 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5730+0+0 (secure 0 0 0) 0x7f4ebc0781f0 con 0x7f4ec00cda50 2024-09-05T07:58:15.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.496+0000 7f4eb6ffd640 1 -- 172.21.15.17:0/1108390563 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4ebc079ef0 con 0x7f4ec00cda50 2024-09-05T07:58:15.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:15.670+0000 7f4ec84ba640 1 -- 172.21.15.17:0/1108390563 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4ec00caaa0 con 0x7f4ec00cda50 2024-09-05T07:58:16.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:16.062+0000 7f4eb6ffd640 1 -- 172.21.15.17:0/1108390563 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) ==== 169+0+0 (secure 0 0 0) 0x7f4ebc07e1f0 con 0x7f4ec00cda50 2024-09-05T07:58:16.063 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2024-09-05T07:58:16.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:16.064+0000 7f4ec84ba640 1 -- 172.21.15.17:0/1108390563 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f4ea406be80 msgr2=0x7f4ea406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:16.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:16.064+0000 7f4ec84ba640 1 --2- 172.21.15.17:0/1108390563 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f4ea406be80 0x7f4ea406e340 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0007fd0 tx=0x7f4eb0009040 comp rx=0 tx=0).stop 2024-09-05T07:58:16.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:16.064+0000 7f4ec84ba640 1 -- 172.21.15.17:0/1108390563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ec00cda50 msgr2=0x7f4ec0150210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T07:58:16.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:16.064+0000 7f4ec84ba640 1 --2- 172.21.15.17:0/1108390563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ec00cda50 0x7f4ec0150210 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc000c00 tx=0x7f4ebc0046c0 comp rx=0 tx=0).stop 2024-09-05T07:58:16.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:16.064+0000 7f4ec84ba640 1 -- 172.21.15.17:0/1108390563 shutdown_connections 2024-09-05T07:58:16.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:16.064+0000 7f4ec84ba640 1 --2- 172.21.15.17:0/1108390563 >> [v2:172.21.15.26:6800/2736912541,v1:172.21.15.26:6801/2736912541] conn(0x7f4ea406be80 0x7f4ea406e340 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:16.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:16.064+0000 7f4ec84ba640 1 --2- 172.21.15.17:0/1108390563 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ec015b650 0x7f4ec00ceda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:16.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:16.064+0000 7f4ec84ba640 1 --2- 172.21.15.17:0/1108390563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ec0154bc0 0x7f4ec00ce860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:16.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:16.064+0000 7f4ec84ba640 1 --2- 172.21.15.17:0/1108390563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ec00cda50 0x7f4ec0150210 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T07:58:16.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:16.064+0000 7f4ec84ba640 1 -- 172.21.15.17:0/1108390563 >> 172.21.15.17:0/1108390563 conn(0x7f4ec00738d0 msgr2=0x7f4ec015da60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T07:58:16.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:16.065+0000 7f4ec84ba640 1 -- 172.21.15.17:0/1108390563 shutdown_connections 2024-09-05T07:58:16.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-05T07:58:16.065+0000 7f4ec84ba640 1 -- 172.21.15.17:0/1108390563 wait complete. 2024-09-05T07:58:16.077 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-05T07:58:16.077 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-05T07:58:16.077 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T07:58:16.077 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-09-05T07:58:16.077 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/daemon/state.py", line 146, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi017 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a" 2024-09-05T07:58:16.078 INFO:tasks.ceph.mds.a:Stopped 2024-09-05T07:58:16.079 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-05T07:58:16.079 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T07:58:16.093 INFO:tasks.ceph.mds.c.smithi017.stderr:2024-09-05T07:58:16.082+0000 b739640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c (PID: 41593) UID: 0 2024-09-05T07:58:16.094 INFO:tasks.ceph.mds.c.smithi017.stderr:2024-09-05T07:58:16.084+0000 b739640 -1 mds.c *** got signal Terminated *** 2024-09-05T07:58:17.538 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~0s 2024-09-05T07:58:17.538 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-09-05T07:58:17.538 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-09-05T07:58:17.538 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~0s 2024-09-05T07:58:22.180 INFO:tasks.ceph.mds.c:Stopped 2024-09-05T07:58:22.181 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-09-05T07:58:22.181 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T07:58:22.181 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-09-05T07:58:22.181 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/daemon/state.py", line 146, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi017 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e" 2024-09-05T07:58:22.181 INFO:tasks.ceph.mds.e:Stopped 2024-09-05T07:58:22.182 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-05T07:58:22.182 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T07:58:22.182 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-09-05T07:58:22.182 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/daemon/state.py", line 146, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi026 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b" 2024-09-05T07:58:22.182 INFO:tasks.ceph.mds.b:Stopped 2024-09-05T07:58:22.182 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-05T07:58:22.182 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T07:58:22.182 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-09-05T07:58:22.183 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/daemon/state.py", line 146, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi026 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d" 2024-09-05T07:58:22.183 INFO:tasks.ceph.mds.d:Stopped 2024-09-05T07:58:22.183 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-09-05T07:58:22.183 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T07:58:22.183 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-09-05T07:58:22.183 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/daemon/state.py", line 146, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi026 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f" 2024-09-05T07:58:22.183 INFO:tasks.ceph.mds.f:Stopped 2024-09-05T07:58:22.184 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-05T07:58:22.184 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-05T07:58:22.184 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T07:58:22.185 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-05T07:58:22.184+0000 7f7d18c46640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 36438) UID: 0 2024-09-05T07:58:22.185 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-05T07:58:22.184+0000 7f7d18c46640 -1 osd.0 28 *** Got signal Terminated *** 2024-09-05T07:58:23.848 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e has been restored 2024-09-05T07:58:23.849 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-09-05T07:58:23.849 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-09-05T07:58:23.849 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f has been restored 2024-09-05T07:58:28.285 INFO:tasks.ceph.osd.0:Stopped 2024-09-05T07:58:28.285 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-05T07:58:28.285 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T07:58:28.286 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-05T07:58:28.286+0000 7f0f450fa640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 36440) UID: 0 2024-09-05T07:58:28.286 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-05T07:58:28.286+0000 7f0f450fa640 -1 osd.1 29 *** Got signal Terminated *** 2024-09-05T07:58:34.387 INFO:tasks.ceph.osd.1:Stopped 2024-09-05T07:58:34.387 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-05T07:58:34.388 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T07:58:34.396 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-05T07:58:34.396+0000 7fc43458f640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 36448) UID: 0 2024-09-05T07:58:34.396 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-05T07:58:34.396+0000 7fc43458f640 -1 osd.2 31 *** Got signal Terminated *** 2024-09-05T07:58:40.489 INFO:tasks.ceph.osd.2:Stopped 2024-09-05T07:58:40.490 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-05T07:58:40.490 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T07:58:40.491 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-05T07:58:40.490+0000 7f31990e2640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 36454) UID: 0 2024-09-05T07:58:40.491 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-05T07:58:40.490+0000 7f31990e2640 -1 osd.3 32 *** Got signal Terminated *** 2024-09-05T07:58:41.178 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:58:41.181 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:58:46.591 INFO:tasks.ceph.osd.3:Stopped 2024-09-05T07:58:46.592 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-05T07:58:46.592 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T07:58:46.593 INFO:tasks.ceph.osd.4.smithi026.stderr:2024-09-05T07:58:46.592+0000 7fa7cf26f640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 36833) UID: 0 2024-09-05T07:58:46.593 INFO:tasks.ceph.osd.4.smithi026.stderr:2024-09-05T07:58:46.592+0000 7fa7cf26f640 -1 osd.4 33 *** Got signal Terminated *** 2024-09-05T07:58:52.693 INFO:tasks.ceph.osd.4:Stopped 2024-09-05T07:58:52.694 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-05T07:58:52.694 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T07:58:52.694 INFO:tasks.ceph.osd.5.smithi026.stderr:2024-09-05T07:58:52.694+0000 7f7b91a7a640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 36835) UID: 0 2024-09-05T07:58:52.695 INFO:tasks.ceph.osd.5.smithi026.stderr:2024-09-05T07:58:52.694+0000 7f7b91a7a640 -1 osd.5 34 *** Got signal Terminated *** 2024-09-05T07:58:58.795 INFO:tasks.ceph.osd.5:Stopped 2024-09-05T07:58:58.795 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-05T07:58:58.796 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T07:58:58.797 INFO:tasks.ceph.osd.6.smithi026.stderr:2024-09-05T07:58:58.796+0000 7f687afaf640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 36839) UID: 0 2024-09-05T07:58:58.797 INFO:tasks.ceph.osd.6.smithi026.stderr:2024-09-05T07:58:58.796+0000 7f687afaf640 -1 osd.6 35 *** Got signal Terminated *** 2024-09-05T07:59:04.898 INFO:tasks.ceph.osd.6:Stopped 2024-09-05T07:59:04.898 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-05T07:59:04.898 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T07:59:04.899 INFO:tasks.ceph.osd.7.smithi026.stderr:2024-09-05T07:59:04.899+0000 7fd0de1d3640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 36841) UID: 0 2024-09-05T07:59:04.900 INFO:tasks.ceph.osd.7.smithi026.stderr:2024-09-05T07:59:04.899+0000 7fd0de1d3640 -1 osd.7 35 *** Got signal Terminated *** 2024-09-05T07:59:05.198 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-05T07:59:10.703 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-05T07:59:10.703 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-05T07:59:11.001 INFO:tasks.ceph.osd.7:Stopped 2024-09-05T07:59:11.001 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-05T07:59:11.001 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-05T07:59:11.001 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T07:59:11.029 INFO:tasks.ceph.mgr.y:Stopped 2024-09-05T07:59:11.030 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-05T07:59:11.030 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T07:59:11.031 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-09-05T07:59:11.030+0000 7fd08ebc7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-mgr -f --cluster ceph -i x (PID: 36183) UID: 0 2024-09-05T07:59:11.060 INFO:tasks.ceph.mgr.x:Stopped 2024-09-05T07:59:11.060 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-05T07:59:11.060 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-05T07:59:11.060 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T07:59:11.087 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-09-05T07:59:11.075+0000 a0e9640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 36156) UID: 0 2024-09-05T07:59:11.087 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-09-05T07:59:11.076+0000 a0e9640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-05T07:59:11.233 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:59:11.236 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:59:16.007 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-05T07:59:41.306 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:59:41.309 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T07:59:42.421 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-09-05T07:59:47.623 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~5s 2024-09-05T07:59:47.669 INFO:tasks.ceph.mon.a:Stopped 2024-09-05T07:59:47.670 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-05T07:59:47.670 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T07:59:47.687 INFO:tasks.ceph.mon.b.smithi026.stderr:2024-09-05T07:59:47.674+0000 a0e9640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 36178) UID: 0 2024-09-05T07:59:47.687 INFO:tasks.ceph.mon.b.smithi026.stderr:2024-09-05T07:59:47.675+0000 a0e9640 -1 mon.b@1(leader) e1 *** Got Signal Terminated *** 2024-09-05T07:59:52.725 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-09-05T07:59:52.726 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-09-05T07:59:53.772 INFO:tasks.ceph.mon.b:Stopped 2024-09-05T07:59:53.772 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-05T07:59:53.772 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T07:59:53.790 INFO:tasks.ceph.mon.c.smithi026.stderr:2024-09-05T07:59:53.776+0000 a0e9640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 36180) UID: 0 2024-09-05T07:59:53.791 INFO:tasks.ceph.mon.c.smithi026.stderr:2024-09-05T07:59:53.778+0000 a0e9640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2024-09-05T07:59:57.727 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-09-05T07:59:57.727 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-09-05T07:59:59.874 INFO:tasks.ceph.mon.c:Stopped 2024-09-05T07:59:59.875 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-05T07:59:59.875 DEBUG:teuthology.orchestra.run.smithi017:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2024-09-05T07:59:59.919 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-05T07:59:59.919 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-05T08:00:00.029 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-05T08:00:00.030 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-05T08:00:00.086 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-05T08:00:00.087 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-05T08:00:00.144 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-05T08:00:00.144 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-05T08:00:00.203 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi026.front.sepia.ceph.com 2024-09-05T08:00:00.203 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-05T08:00:00.301 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi026.front.sepia.ceph.com 2024-09-05T08:00:00.301 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-05T08:00:00.399 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi026.front.sepia.ceph.com 2024-09-05T08:00:00.399 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-05T08:00:00.455 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi026.front.sepia.ceph.com 2024-09-05T08:00:00.455 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-05T08:00:00.532 INFO:tasks.ceph:Archiving mon data... 2024-09-05T08:00:00.533 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7890022/data/mon.a.tgz 2024-09-05T08:00:00.533 DEBUG:teuthology.orchestra.run.smithi017:> mktemp 2024-09-05T08:00:00.550 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.nXgpd5B4M8 2024-09-05T08:00:00.551 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.nXgpd5B4M8 2024-09-05T08:00:00.709 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.nXgpd5B4M8 2024-09-05T08:00:00.793 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.nXgpd5B4M8 is 307KB 2024-09-05T08:00:00.889 DEBUG:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.nXgpd5B4M8 2024-09-05T08:00:00.904 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7890022/data/mon.b.tgz 2024-09-05T08:00:00.904 DEBUG:teuthology.orchestra.run.smithi026:> mktemp 2024-09-05T08:00:00.924 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.wzi4r1cCZx 2024-09-05T08:00:00.924 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.wzi4r1cCZx 2024-09-05T08:00:01.072 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.wzi4r1cCZx 2024-09-05T08:00:01.157 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.wzi4r1cCZx is 325KB 2024-09-05T08:00:01.252 DEBUG:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.wzi4r1cCZx 2024-09-05T08:00:01.268 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7890022/data/mon.c.tgz 2024-09-05T08:00:01.268 DEBUG:teuthology.orchestra.run.smithi026:> mktemp 2024-09-05T08:00:01.324 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.qSpCoIYnke 2024-09-05T08:00:01.324 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.qSpCoIYnke 2024-09-05T08:00:01.452 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.qSpCoIYnke 2024-09-05T08:00:01.535 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.qSpCoIYnke is 325KB 2024-09-05T08:00:01.631 DEBUG:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.qSpCoIYnke 2024-09-05T08:00:01.645 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-05T08:00:01.646 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-05T08:00:01.648 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-05T08:00:01.991 DEBUG:tasks.ceph:valgrind exception message: valgrind error: Leak_PossiblyLost posix_memalign UnknownInlinedFun ceph::buffer::v15_2_0::create_aligned_in_mempool(unsigned int, unsigned int, int) 2024-09-05T08:00:02.233 INFO:tasks.ceph:Archiving crash dumps... 2024-09-05T08:00:02.235 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7890022/remote/smithi017/crash 2024-09-05T08:00:02.236 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-05T08:00:02.263 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7890022/remote/smithi026/crash 2024-09-05T08:00:02.265 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-05T08:00:02.288 INFO:tasks.ceph:Shutting down logrotate 2024-09-05T08:00:02.288 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T08:00:02.308 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-05T08:00:02.377 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-05T08:00:02.404 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-05T08:00:02.428 INFO:tasks.ceph:Compressing logs... 2024-09-05T08:00:02.428 DEBUG:teuthology.orchestra.run.smithi017:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-05T08:00:02.447 DEBUG:teuthology.orchestra.run.smithi026:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-05T08:00:02.470 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-05T08:00:02.470 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42401.log 2024-09-05T08:00:02.476 INFO:teuthology.orchestra.run.smithi017.stderr:gzip/var/log/ceph/ceph-osd.0.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42485.log 2024-09-05T08:00:02.476 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.42401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41996.log 2024-09-05T08:00:02.477 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.42485.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42401.log.gz 2024-09-05T08:00:02.477 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47452.log 2024-09-05T08:00:02.477 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42485.log.gz 2024-09-05T08:00:02.477 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47156.log 2024-09-05T08:00:02.477 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.47452.log: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.41996.log.gz 2024-09-05T08:00:02.477 INFO:teuthology.orchestra.run.smithi017.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42720.log 2024-09-05T08:00:02.477 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.47156.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47452.log.gz 2024-09-05T08:00:02.477 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42164.log 2024-09-05T08:00:02.477 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.42720.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47156.log.gz 2024-09-05T08:00:02.477 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36574.log 2024-09-05T08:00:02.477 INFO:teuthology.orchestra.run.smithi017.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42720.log.gz 2024-09-05T08:00:02.477 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.42164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43457.log 2024-09-05T08:00:02.477 INFO:teuthology.orchestra.run.smithi017.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42164.log.gz 2024-09-05T08:00:02.478 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43718.log 2024-09-05T08:00:02.478 INFO:teuthology.orchestra.run.smithi017.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36574.log.gz 2024-09-05T08:00:02.478 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43457.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-05T08:00:02.478 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43718.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43457.log.gz 2024-09-05T08:00:02.478 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43296.log 2024-09-05T08:00:02.478 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43718.log.gz 2024-09-05T08:00:02.478 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42038.log 2024-09-05T08:00:02.478 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41828.log 2024-09-05T08:00:02.478 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.42038.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43296.log.gz 2024-09-05T08:00:02.478 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43376.log 2024-09-05T08:00:02.478 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42122.log 2024-09-05T08:00:02.478 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41828.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42038.log.gz 2024-09-05T08:00:02.478 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43376.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41828.log.gz 2024-09-05T08:00:02.479 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43802.log 2024-09-05T08:00:02.479 INFO:teuthology.orchestra.run.smithi017.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43376.log.gz 2024-09-05T08:00:02.479 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43844.log 2024-09-05T08:00:02.479 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.42122.log: /var/log/ceph/ceph-client.admin.43802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41912.log 2024-09-05T08:00:02.479 INFO:teuthology.orchestra.run.smithi017.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42122.log.gz 2024-09-05T08:00:02.479 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43802.log.gz 2024-09-05T08:00:02.479 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47494.log 2024-09-05T08:00:02.479 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47028.log 2024-09-05T08:00:02.508 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36377.log 2024-09-05T08:00:02.508 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-05T08:00:02.508 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36548.log 2024-09-05T08:00:02.508 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36377.log: /var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36668.log 2024-09-05T08:00:02.508 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36377.log.gz 2024-09-05T08:00:02.508 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36628.log 2024-09-05T08:00:02.508 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36668.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36548.log.gz 2024-09-05T08:00:02.508 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-05T08:00:02.508 INFO:teuthology.orchestra.run.smithi026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36668.log.gz 2024-09-05T08:00:02.508 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36628.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-05T08:00:02.509 INFO:teuthology.orchestra.run.smithi026.stderr: 87.8%/var/log/ceph/ceph-mds.b.log: -- replaced with /var/log/ceph/ceph-client.admin.36628.log.gz 2024-09-05T08:00:02.509 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-05T08:00:02.509 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36468.log 2024-09-05T08:00:02.509 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36508.log 2024-09-05T08:00:02.509 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36588.log 2024-09-05T08:00:02.509 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36468.log.gz 2024-09-05T08:00:02.509 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36508.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-05T08:00:02.509 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36508.log.gz 2024-09-05T08:00:02.509 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36588.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2024-09-05T08:00:02.509 INFO:teuthology.orchestra.run.smithi026.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-05T08:00:02.509 INFO:teuthology.orchestra.run.smithi026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36588.log.gz 2024-09-05T08:00:02.509 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.b.log 2024-09-05T08:00:02.510 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/valgrind/mon.c.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2024-09-05T08:00:02.510 INFO:teuthology.orchestra.run.smithi026.stderr: 73.6% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2024-09-05T08:00:02.510 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/valgrind/mds.b.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.f.log 2024-09-05T08:00:02.510 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/valgrind/mon.b.log: gzip -5 --verbose 86.0% -- replaced with /var/log/ceph/valgrind/mds.b.log.gz 2024-09-05T08:00:02.510 INFO:teuthology.orchestra.run.smithi026.stderr: -- 73.6% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2024-09-05T08:00:02.510 INFO:teuthology.orchestra.run.smithi026.stderr: /var/log/ceph/valgrind/mds.d.log 2024-09-05T08:00:02.510 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/valgrind/mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-05T08:00:02.510 INFO:teuthology.orchestra.run.smithi026.stderr: 82.9% -- replaced with /var/log/ceph/valgrind/mds.f.log.gz 2024-09-05T08:00:02.510 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/valgrind/mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-05T08:00:02.510 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-osd.6.log: 86.0% -- replaced with /var/log/ceph/valgrind/mds.d.log.gz 2024-09-05T08:00:02.510 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-05T08:00:02.510 INFO:teuthology.orchestra.run.smithi026.stderr:gzip/var/log/ceph/ceph-osd.5.log: -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-05T08:00:02.510 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-05T08:00:02.510 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-mds.d.log: 93.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-05T08:00:02.511 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-05T08:00:02.512 INFO:teuthology.orchestra.run.smithi017.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41912.log.gz 2024-09-05T08:00:02.512 INFO:teuthology.orchestra.run.smithi017.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.43844.log.gz 2024-09-05T08:00:02.512 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.47494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42275.log 2024-09-05T08:00:02.512 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.47028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41645.log 2024-09-05T08:00:02.512 INFO:teuthology.orchestra.run.smithi017.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47494.log.gz 2024-09-05T08:00:02.512 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47028.log.gz 2024-09-05T08:00:02.512 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.42275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47284.log 2024-09-05T08:00:02.512 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42275.log.gz 2024-09-05T08:00:02.512 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43256.log 2024-09-05T08:00:02.512 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.47284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46650.log 2024-09-05T08:00:02.512 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41645.log.gz 2024-09-05T08:00:02.513 INFO:teuthology.orchestra.run.smithi017.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47284.log.gz 2024-09-05T08:00:02.513 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46776.log 2024-09-05T08:00:02.513 INFO:teuthology.orchestra.run.smithi017.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43256.log.gz 2024-09-05T08:00:02.513 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.46650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43456.log 2024-09-05T08:00:02.513 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43634.log 2024-09-05T08:00:02.513 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46650.log.gz 2024-09-05T08:00:02.513 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.46776.log: /var/log/ceph/ceph-client.admin.43456.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46776.log.gz 2024-09-05T08:00:02.513 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43028.log 2024-09-05T08:00:02.513 INFO:teuthology.orchestra.run.smithi017.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43456.log.gz 2024-09-05T08:00:02.513 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41485.log 2024-09-05T08:00:02.513 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43634.log: /var/log/ceph/ceph-client.admin.43028.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-05T08:00:02.513 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43634.log.gz 2024-09-05T08:00:02.513 INFO:teuthology.orchestra.run.smithi017.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43028.log.gz 2024-09-05T08:00:02.514 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43106.log 2024-09-05T08:00:02.514 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6%/var/log/ceph/ceph.audit.log: -- replaced with /var/log/ceph/ceph-client.admin.41485.log.gz 2024-09-05T08:00:02.514 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44638.log 2024-09-05T08:00:02.514 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46818.log 2024-09-05T08:00:02.514 INFO:teuthology.orchestra.run.smithi017.stderr: 89.1%/var/log/ceph/ceph-client.0.44638.log: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-05T08:00:02.514 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43106.log.gz 2024-09-05T08:00:02.514 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47824.log 2024-09-05T08:00:02.514 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.46818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44210.log 2024-09-05T08:00:02.514 INFO:teuthology.orchestra.run.smithi017.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46818.log.gz 2024-09-05T08:00:02.514 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.47824.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30104.log 2024-09-05T08:00:02.514 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.44210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43316.log 2024-09-05T08:00:02.514 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47824.log.gz 2024-09-05T08:00:02.514 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44210.log.gz 2024-09-05T08:00:02.515 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph.tmp-client.admin.30104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42215.log 2024-09-05T08:00:02.515 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30104.log.gz 2024-09-05T08:00:02.515 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44108.log 2024-09-05T08:00:02.515 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43316.log: /var/log/ceph/ceph-client.admin.42215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41703.log 2024-09-05T08:00:02.515 INFO:teuthology.orchestra.run.smithi017.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43316.log.gz 2024-09-05T08:00:02.515 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42215.log.gz 2024-09-05T08:00:02.515 INFO:teuthology.orchestra.run.smithi017.stderr:gzip/var/log/ceph/ceph-client.admin.44108.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46986.log 2024-09-05T08:00:02.515 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43760.log 2024-09-05T08:00:02.515 INFO:teuthology.orchestra.run.smithi017.stderr: 88.3%/var/log/ceph/ceph-client.admin.46986.log: -- replaced with /var/log/ceph/ceph-client.admin.41703.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46734.log 2024-09-05T08:00:02.515 INFO:teuthology.orchestra.run.smithi017.stderr: 2024-09-05T08:00:02.515 INFO:teuthology.orchestra.run.smithi017.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.44108.log.gz 2024-09-05T08:00:02.515 INFO:teuthology.orchestra.run.smithi017.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46986.log.gz 2024-09-05T08:00:02.515 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41600.log 2024-09-05T08:00:02.516 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43760.log.gz 2024-09-05T08:00:02.516 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47368.log 2024-09-05T08:00:02.516 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.46734.log: /var/log/ceph/ceph-client.admin.41600.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-05T08:00:02.516 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46734.log.gz 2024-09-05T08:00:02.516 INFO:teuthology.orchestra.run.smithi017.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41600.log.gz 2024-09-05T08:00:02.516 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.47368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42721.log 2024-09-05T08:00:02.516 INFO:teuthology.orchestra.run.smithi017.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47368.log.gz 2024-09-05T08:00:02.516 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41870.log 2024-09-05T08:00:02.516 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.42721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47908.log 2024-09-05T08:00:02.516 INFO:teuthology.orchestra.run.smithi017.stderr: 86.8%/var/log/ceph/ceph-client.admin.41870.log: -- replaced with /var/log/ceph/ceph-client.admin.42721.log.gz 2024-09-05T08:00:02.516 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44042.log 2024-09-05T08:00:02.516 INFO:teuthology.orchestra.run.smithi017.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41870.log.gz 2024-09-05T08:00:02.516 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.47908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42317.log 2024-09-05T08:00:02.517 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.44042.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47908.log.gz 2024-09-05T08:00:02.517 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42443.log 2024-09-05T08:00:02.517 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.42317.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.44042.log.gz 2024-09-05T08:00:02.517 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36195.log 2024-09-05T08:00:02.517 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4%/var/log/ceph/ceph-client.admin.42443.log: -- replaced with /var/log/ceph/ceph-client.admin.42317.log.gz 2024-09-05T08:00:02.517 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-05T08:00:02.517 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42443.log.gz 2024-09-05T08:00:02.517 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43048.log 2024-09-05T08:00:02.517 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose 92.3% -- replaced with /var/log/ceph/ceph-client.admin.36195.log.gz 2024-09-05T08:00:02.517 INFO:teuthology.orchestra.run.smithi017.stderr: -- /var/log/ceph/ceph-client.admin.42712.log 2024-09-05T08:00:02.517 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46692.log 2024-09-05T08:00:02.517 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43048.log.gz 2024-09-05T08:00:02.517 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.42712.log: gzip -5 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42712.log.gz 2024-09-05T08:00:02.517 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47596.log 2024-09-05T08:00:02.518 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.46692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42710.log 2024-09-05T08:00:02.518 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46692.log.gz/var/log/ceph/ceph-client.admin.47596.log: 2024-09-05T08:00:02.518 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47410.log 87.6% 2024-09-05T08:00:02.518 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47596.log.gz 2024-09-05T08:00:02.518 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.42710.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-05T08:00:02.518 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42710.log.gz 2024-09-05T08:00:02.518 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.47410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47950.log 2024-09-05T08:00:02.518 INFO:teuthology.orchestra.run.smithi017.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47410.log.gz 2024-09-05T08:00:02.518 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47114.log 2024-09-05T08:00:02.518 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.47950.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2024-09-05T08:00:02.518 INFO:teuthology.orchestra.run.smithi017.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47950.log.gz 2024-09-05T08:00:02.518 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.47114.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47114.log.gz 2024-09-05T08:00:02.518 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.c.log 2024-09-05T08:00:02.519 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.e.log 2024-09-05T08:00:02.519 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/valgrind/mon.a.log: /var/log/ceph/valgrind/mds.c.log: 73.5% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2024-09-05T08:00:02.519 INFO:teuthology.orchestra.run.smithi017.stderr: 68.3% -- replaced with /var/log/ceph/valgrind/mds.c.log.gz 2024-09-05T08:00:02.519 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/client.0.log 2024-09-05T08:00:02.519 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.a.log 2024-09-05T08:00:02.519 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/valgrind/client.0.log: /var/log/ceph/valgrind/mds.e.log: 68.9% -- replaced with /var/log/ceph/valgrind/client.0.log.gz 2024-09-05T08:00:02.519 INFO:teuthology.orchestra.run.smithi017.stderr: 82.9% -- replaced with /var/log/ceph/valgrind/mds.e.log.gz 2024-09-05T08:00:02.519 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42534.log 2024-09-05T08:00:02.519 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-05T08:00:02.519 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/valgrind/mds.a.log: /var/log/ceph/ceph-client.admin.42534.log: 86.0% -- replaced with /var/log/ceph/valgrind/mds.a.log.gz 2024-09-05T08:00:02.519 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42534.log.gz 2024-09-05T08:00:02.519 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42877.log 2024-09-05T08:00:02.519 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41954.log 2024-09-05T08:00:02.519 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.42877.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42877.log.gz 2024-09-05T08:00:02.520 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36428.log 2024-09-05T08:00:02.520 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-05T08:00:02.521 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41954.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41954.log.gz 2024-09-05T08:00:02.522 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46944.log 2024-09-05T08:00:02.523 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph.log: 94.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-05T08:00:02.523 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36459.log 2024-09-05T08:00:02.524 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.46944.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46944.log.gz 2024-09-05T08:00:02.525 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43013.log 2024-09-05T08:00:02.525 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36459.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.36459.log.gz 2024-09-05T08:00:02.526 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42716.log 2024-09-05T08:00:02.526 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-05T08:00:02.528 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43013.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43013.log.gz 2024-09-05T08:00:02.528 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47071.log 2024-09-05T08:00:02.528 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.42716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46418.log 2024-09-05T08:00:02.528 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42716.log.gz 2024-09-05T08:00:02.530 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.47071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42080.log 2024-09-05T08:00:02.530 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.46418.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47071.log.gz 2024-09-05T08:00:02.530 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46418.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47242.log 2024-09-05T08:00:02.530 INFO:teuthology.orchestra.run.smithi017.stderr: 2024-09-05T08:00:02.530 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43592.log 2024-09-05T08:00:02.530 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.42080.log: /var/log/ceph/ceph-client.admin.47242.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42080.log.gz 2024-09-05T08:00:02.531 INFO:teuthology.orchestra.run.smithi017.stderr: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41410.log 2024-09-05T08:00:02.531 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47242.log.gz 2024-09-05T08:00:02.533 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42706.log 2024-09-05T08:00:02.533 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41410.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43592.log.gz 2024-09-05T08:00:02.533 INFO:teuthology.orchestra.run.smithi017.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41410.log.gz 2024-09-05T08:00:02.533 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42359.log 2024-09-05T08:00:02.533 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47678.log 2024-09-05T08:00:02.533 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.42706.log: /var/log/ceph/ceph-client.admin.42359.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42706.log.gz 2024-09-05T08:00:02.533 INFO:teuthology.orchestra.run.smithi017.stderr: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47326.log 2024-09-05T08:00:02.533 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42359.log.gz 2024-09-05T08:00:02.534 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43910.log 2024-09-05T08:00:02.539 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.47678.log: /var/log/ceph/ceph-client.admin.47326.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47678.log.gz 2024-09-05T08:00:02.539 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46860.log 2024-09-05T08:00:02.539 INFO:teuthology.orchestra.run.smithi017.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47326.log.gz 2024-09-05T08:00:02.539 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42718.log 2024-09-05T08:00:02.539 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.46860.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46860.log.gz 2024-09-05T08:00:02.539 INFO:teuthology.orchestra.run.smithi017.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.43910.log.gz 2024-09-05T08:00:02.539 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47722.log 2024-09-05T08:00:02.539 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.42718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43455.log 2024-09-05T08:00:02.539 INFO:teuthology.orchestra.run.smithi017.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42718.log.gz 2024-09-05T08:00:02.539 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.47722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43550.log 2024-09-05T08:00:02.540 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43455.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47722.log.gz 2024-09-05T08:00:02.540 INFO:teuthology.orchestra.run.smithi017.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43455.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43041.log 2024-09-05T08:00:02.540 INFO:teuthology.orchestra.run.smithi017.stderr: 2024-09-05T08:00:02.540 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43976.log 2024-09-05T08:00:02.540 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43041.log: /var/log/ceph/ceph-client.admin.43550.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43550.log.gz 2024-09-05T08:00:02.540 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43041.log.gz 2024-09-05T08:00:02.540 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46902.log 2024-09-05T08:00:02.545 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-09-05T08:00:02.545 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36428.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36428.log.gz 2024-09-05T08:00:02.551 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47636.log 2024-09-05T08:00:02.551 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43976.log: /var/log/ceph/ceph-client.admin.46902.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46902.log.gz 2024-09-05T08:00:02.551 INFO:teuthology.orchestra.run.smithi017.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.43976.log.gz 2024-09-05T08:00:02.551 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43057.log 2024-09-05T08:00:02.551 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.47636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47866.log 2024-09-05T08:00:02.551 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47636.log.gz 2024-09-05T08:00:02.551 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43676.log 2024-09-05T08:00:02.551 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.47866.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43057.log.gz 2024-09-05T08:00:02.551 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47200.log 2024-09-05T08:00:02.551 INFO:teuthology.orchestra.run.smithi017.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47866.log.gz 2024-09-05T08:00:02.551 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43676.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-09-05T08:00:02.552 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.47200.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43676.log.gz 2024-09-05T08:00:02.552 INFO:teuthology.orchestra.run.smithi017.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47200.log.gz 2024-09-05T08:00:02.552 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42715.log 2024-09-05T08:00:02.552 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41784.log 2024-09-05T08:00:02.552 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-mds.e.log: /var/log/ceph/ceph-client.admin.42715.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42715.log.gz 2024-09-05T08:00:02.552 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47554.log 2024-09-05T08:00:02.552 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41784.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41784.log.gz 2024-09-05T08:00:02.552 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-05T08:00:02.552 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.47554.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47554.log.gz 2024-09-05T08:00:02.552 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-05T08:00:02.563 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46476.log 2024-09-05T08:00:02.576 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-mds.c.log: 92.7% 93.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-05T08:00:02.576 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-mds.c.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47764.log 2024-09-05T08:00:02.577 INFO:teuthology.orchestra.run.smithi017.stderr: 2024-09-05T08:00:02.577 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.46476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42965.log 2024-09-05T08:00:02.578 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.47764.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46476.log.gz 2024-09-05T08:00:02.578 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47764.log.gz 2024-09-05T08:00:02.579 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.42965.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42965.log.gz 2024-09-05T08:00:02.583 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-mds.f.log: 93.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-05T08:00:02.619 INFO:teuthology.orchestra.run.smithi026.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-05T08:00:02.642 INFO:teuthology.orchestra.run.smithi017.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-09-05T08:00:02.728 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-09-05T08:00:02.785 INFO:teuthology.orchestra.run.smithi026.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-05T08:00:03.001 INFO:teuthology.orchestra.run.smithi026.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-05T08:00:03.044 INFO:teuthology.orchestra.run.smithi026.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-05T08:00:03.098 INFO:teuthology.orchestra.run.smithi017.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-05T08:00:03.247 INFO:teuthology.orchestra.run.smithi026.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-05T08:00:03.284 INFO:teuthology.orchestra.run.smithi017.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-05T08:00:03.560 INFO:teuthology.orchestra.run.smithi017.stderr: 89.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-05T08:00:03.591 INFO:teuthology.orchestra.run.smithi026.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-05T08:00:03.740 INFO:teuthology.orchestra.run.smithi026.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-05T08:00:03.750 INFO:teuthology.orchestra.run.smithi017.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-05T08:00:03.808 INFO:teuthology.orchestra.run.smithi026.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-05T08:00:03.882 INFO:teuthology.orchestra.run.smithi017.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-05T08:00:13.557 INFO:teuthology.orchestra.run.smithi017.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.0.44638.log.gz 2024-09-05T08:00:13.559 INFO:teuthology.orchestra.run.smithi017.stderr: 2024-09-05T08:00:13.559 INFO:teuthology.orchestra.run.smithi017.stderr:real 0m11.099s 2024-09-05T08:00:13.559 INFO:teuthology.orchestra.run.smithi017.stderr:user 0m15.926s 2024-09-05T08:00:13.559 INFO:teuthology.orchestra.run.smithi017.stderr:sys 0m0.570s 2024-09-05T08:00:22.096 INFO:teuthology.orchestra.run.smithi026.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-09-05T08:00:22.098 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-09-05T08:00:22.098 INFO:teuthology.orchestra.run.smithi026.stderr:real 0m19.615s 2024-09-05T08:00:22.098 INFO:teuthology.orchestra.run.smithi026.stderr:user 0m24.614s 2024-09-05T08:00:22.098 INFO:teuthology.orchestra.run.smithi026.stderr:sys 0m0.718s 2024-09-05T08:00:22.098 INFO:tasks.ceph:Archiving logs... 2024-09-05T08:00:22.099 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7890022/remote/smithi017/log 2024-09-05T08:00:22.100 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-05T08:00:24.590 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7890022/remote/smithi026/log 2024-09-05T08:00:24.591 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-05T08:00:28.050 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/qa/tasks/ceph.py", line 1908, in task with contextutil.nested(*subtasks): File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph_91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_PossiblyLost posix_memalign UnknownInlinedFun ceph::buffer::v15_2_0::create_aligned_in_mempool(unsigned int, unsigned int, int) 2024-09-05T08:00:28.052 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-05T08:00:28.060 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/qa/tasks/ceph.py", line 1908, in task with contextutil.nested(*subtasks): File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph_91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_PossiblyLost posix_memalign UnknownInlinedFun ceph::buffer::v15_2_0::create_aligned_in_mempool(unsigned int, unsigned int, int) 2024-09-05T08:00:28.060 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-05T08:00:28.061 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-05T08:00:28.063 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-05T08:00:28.155 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-05T08:00:28.164 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-05T08:00:28.164 DEBUG:teuthology.orchestra.run.smithi017:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-05T08:00:28.166 DEBUG:teuthology.orchestra.run.smithi026:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-05T08:00:28.181 INFO:teuthology.orchestra.run.smithi017.stderr:bash: line 1: ntpq: command not found 2024-09-05T08:00:28.183 INFO:teuthology.orchestra.run.smithi026.stderr:bash: line 1: ntpq: command not found 2024-09-05T08:00:28.186 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-05T08:00:28.186 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2024-09-05T08:00:28.186 INFO:teuthology.orchestra.run.smithi017.stdout:^* hv01.front.sepia.ceph.com 3 6 377 42 +778us[ +755us] +/- 46ms 2024-09-05T08:00:28.186 INFO:teuthology.orchestra.run.smithi017.stdout:^+ hv02.front.sepia.ceph.com 3 8 377 233 -1411us[-1459us] +/- 57ms 2024-09-05T08:00:28.186 INFO:teuthology.orchestra.run.smithi017.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 103 +574us[ +553us] +/- 83ms 2024-09-05T08:00:28.186 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T08:00:28.188 INFO:teuthology.orchestra.run.smithi026.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-05T08:00:28.188 INFO:teuthology.orchestra.run.smithi026.stdout:=============================================================================== 2024-09-05T08:00:28.189 INFO:teuthology.orchestra.run.smithi026.stdout:^* hv01.front.sepia.ceph.com 3 6 377 37 +819us[ +801us] +/- 46ms 2024-09-05T08:00:28.189 INFO:teuthology.orchestra.run.smithi026.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 35 -1333us[-1333us] +/- 60ms 2024-09-05T08:00:28.189 INFO:teuthology.orchestra.run.smithi026.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 39 +590us[ +572us] +/- 84ms 2024-09-05T08:00:28.189 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T08:00:28.189 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-05T08:00:28.198 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-05T08:00:28.199 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-05T08:00:28.207 DEBUG:teuthology.orchestra.run.smithi017:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-05T08:00:28.300 DEBUG:teuthology.orchestra.run.smithi026:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-05T08:00:28.369 DEBUG:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-05T08:00:28.399 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T08:00:28.399 DEBUG:teuthology.orchestra.run.smithi026:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-05T08:00:28.428 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T08:00:28.429 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-05T08:00:28.438 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-05T08:00:28.447 INFO:teuthology.task.internal:Duration was 2592.868119 seconds 2024-09-05T08:00:28.447 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-05T08:00:28.457 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-05T08:00:28.457 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-05T08:00:28.460 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-05T08:00:28.500 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-05T08:00:28.509 INFO:teuthology.orchestra.run.smithi026.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-05T08:00:28.825 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-05T08:00:28.825 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi017.front.sepia.ceph.com 2024-09-05T08:00:28.825 DEBUG:teuthology.orchestra.run.smithi017:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-05T08:00:28.847 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi026.front.sepia.ceph.com 2024-09-05T08:00:28.848 DEBUG:teuthology.orchestra.run.smithi026:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-05T08:00:28.894 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-05T08:00:28.894 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-05T08:00:28.897 DEBUG:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-05T08:00:28.963 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-05T08:00:28.963 DEBUG:teuthology.orchestra.run.smithi017:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-05T08:00:28.966 DEBUG:teuthology.orchestra.run.smithi026:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-05T08:00:29.120 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-05T08:00:29.130 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-05T08:00:29.130 DEBUG:teuthology.orchestra.run.smithi017:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-05T08:00:29.154 DEBUG:teuthology.orchestra.run.smithi026:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-05T08:00:29.179 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-05T08:00:29.189 DEBUG:teuthology.orchestra.run.smithi017:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-05T08:00:29.197 DEBUG:teuthology.orchestra.run.smithi026:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-05T08:00:29.217 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = core 2024-09-05T08:00:29.241 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern = core 2024-09-05T08:00:29.264 DEBUG:teuthology.orchestra.run.smithi017:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-05T08:00:29.285 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T08:00:29.286 DEBUG:teuthology.orchestra.run.smithi026:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-05T08:00:29.319 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T08:00:29.319 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-05T08:00:29.328 INFO:teuthology.task.internal:Transferring archived files... 2024-09-05T08:00:29.329 DEBUG:teuthology.misc:Transferring archived files from smithi017:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7890022/remote/smithi017 2024-09-05T08:00:29.329 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-05T08:00:29.363 DEBUG:teuthology.misc:Transferring archived files from smithi026:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7890022/remote/smithi026 2024-09-05T08:00:29.363 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-05T08:00:29.397 INFO:teuthology.task.internal:Removing archive directory... 2024-09-05T08:00:29.398 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-05T08:00:29.400 DEBUG:teuthology.orchestra.run.smithi026:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-05T08:00:29.447 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-05T08:00:29.458 INFO:teuthology.task.internal:Not uploading archives. 2024-09-05T08:00:29.458 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-05T08:00:29.468 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-05T08:00:29.468 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-05T08:00:29.470 DEBUG:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-05T08:00:29.482 INFO:teuthology.orchestra.run.smithi017.stdout: 262217 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 5 08:00 /home/ubuntu/cephtest 2024-09-05T08:00:29.502 INFO:teuthology.orchestra.run.smithi026.stdout: 262217 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 5 08:00 /home/ubuntu/cephtest 2024-09-05T08:00:29.503 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-05T08:00:29.513 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-05T08:00:29.523 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: valgrind error: Leak_PossiblyLost posix_memalign UnknownInlinedFun ceph::buffer::v15_2_0::create_aligned_in_mempool(unsigned int, unsigned int, int) 2024-09-05T08:00:29.525 INFO:teuthology.run:Summary data: description: fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/5 tasks/dbench validater/valgrind} duration: 2592.868119239807 failure_reason: 'valgrind error: Leak_PossiblyLost posix_memalign UnknownInlinedFun ceph::buffer::v15_2_0::create_aligned_in_mempool(unsigned int, unsigned int, int)' flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-09-05T08:00:29.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-05T08:00:29.616 INFO:teuthology.run:FAIL